AI Chat Paper
Discover the SciOpen Platform and Achieve Your Research Goals with Ease.
Search articles, authors, keywords, DOl and etc.
{{expandStatus?'Exit ':''}}Advanced Search
Reinforcement learning (RL) can free automated vehicles (AVs) from the car-following constraints and provide more possible explorations for mixed behavior. This study uses deep RL as AVs’ longitudinal control and designs a multi-level objectives framework for AVs’ trajectory decision-making based on multi-agent DRL. The saturated signalized intersection is taken as the research object to seek the upper limit of traffic efficiency and realize the specific target control. The simulation results demonstrate the convergence of the proposed framework in complex scenarios. When prioritizing throughputs as the primary objective and emissions as the secondary objective, both indicators exhibit a linear growth pattern with increasing market penetration rate (MPR). Compared with MPR is 0%, the throughputs can be increased by 69.2% when MPR is 100%. Compared with linear adaptive cruise control (LACC) under the same MPR, the emissions can also be reduced by up to 78.8%. Under the control of the fixed throughputs, compared with LACC, the emission benefits grow nearly linearly as MPR increases, it can reach 79.4% at 80% MPR. This study employs experimental results to analyze the behavioral changes of mixed flow and the mechanism of mixed autonomy to improve traffic efficiency. The proposed method is flexible and serves as a valuable tool for exploring and studying the behavior of mixed flow behavior and the patterns of mixed autonomy.
Aragon-Gómez, R., Clempner, J. B., 2020. Traffic-signal control reinforcement learning approach for continuous-time Markov games. Eng Appl Artif Intell, 89, 103415.
Aslani, M., Mesgari, M. S., Wiering, M., 2017. Adaptive traffic signal control with actor-critic methods in a real-world traffic network with different traffic disruption events. Transp Res Part C Emerg Technol, 85, 732–752.
Bhatnagar, S., Sutton, R. S., Ghavamzadeh, M., Lee, M., 2009. Natural actor-critic algorithms. Automatica, 45, 2471–2482.
Chen, C., Wang, J., Xu, Q., Wang, J., Li, K., 2021. Mixed platoon control of automated and human-driven vehicles at a signalized intersection: Dynamical analysis and optimal control. Transp Res Part C Emerg Technol, 127, 103138.
Dai, P., Liu, K., Zhuge, Q., Sha, E. H. M., Lee, V. C. S., Son, S. H., 2016. Quality-of-experience-oriented autonomous intersection control in vehicular networks. IEEE Trans Intell Transport Syst, 17, 1956–1967.
Ding, H., Li, W., Xu, N., Zhang, J., 2022. An enhanced eco-driving strategy based on reinforcement learning for connected electric vehicles: Cooperative velocity and lane-changing control. J Intell Connect Veh, 5, 316–332.
Fayazi, S. A., Vahidi, A., 2018. Mixed-integer linear programming for optimal scheduling of autonomous vehicle intersection crossing. IEEE Trans Intell Veh, 3, 287–299.
Feng, Y., Yu, C., Liu, H. X., 2018. Spatiotemporal intersection control in a connected and automated vehicle environment. Transp Res Part C Emerg Technol, 89, 364–383.
Guan, Y., Ren, Y., Li, S. E., Sun, Q., Luo, L., Li, K., 2020. Centralized cooperation for connected and automated vehicles at intersections by proximal policy optimization. IEEE Trans Veh Technol, 69, 12597–12608.
Han, X., Ma, R., Zhang, H. M., 2020. Energy-aware trajectory optimization of CAV platoons through a signalized intersection. Transp Res Part C Emerg Technol, 118, 102652.
Jiang, H., Hu, J., An, S., Wang, M., Park, B. B., 2017. Eco approaching at an isolated signalized intersection under partially connected and automated vehicles environment. Transp Res Part C Emerg Technol, 79, 290–307.
Jing, S., Hui, F., Zhao, X., Rios-Torres, J., Khattak, A. J., 2019. Cooperative game approach to optimal merging sequence and on-ramp merging control of connected and automated vehicles. IEEE Trans Intell Transport Syst, 20, 4234–4244.
Kesting, A., Treiber, M., Schönhof, M., Helbing, D., 2008. Adaptive cruise control design for active congestion avoidance. Transp Res Part C Emerg Technol, 16, 668–683.
Kiran, B. R., Sobh, I., Talpaert, V., Mannion, P., Al Sallab, A. A., Yogamani, S. et al., 2022. Deep reinforcement learning for autonomous driving: A survey. IEEE Trans Intell Transport Syst, 23, 4909–4926.
Li, G., Li, S., Li, S., Qin, Y., Cao, D., Qu, X. et al., 2020. Deep reinforcement learning enabled decision-making for autonomous driving at intersections. Automot Innov, 3, 374–385.
Liu, C., Lin, C. W., Shiraishi, S., Tomizuka, M., 2018. Distributed conflict resolution for connected autonomous vehicles. IEEE Trans Intell Veh, 3, 18–29.
Makantasis, K., Kontorinaki, M., Nikolos, I., 2020. Deep reinforcement-learning-based driving policy for autonomous road vehicles. IET Intell Transp Syst, 14, 13–24.
Morales Medina, A. I., van de Wouw, N., Nijmeijer, H., 2018. Cooperative intersection control based on virtual platooning. IEEE Trans Intell Transport Syst, 19, 1727–1740.
Meng, X., Cassandras, C. G., 2022. Eco-driving of autonomous vehicles for nonstop crossing of signalized intersections. IEEE Trans Automat Sci Eng, 19, 320–331.
Mushtaq, A., Haq, I. U., Imtiaz, M. U., Khan, A., Shafiq, O., 2021. Traffic flow management of autonomous vehicles using deep reinforcement learning and smart rerouting. IEEE Access, 9, 51005–51019.
Phan, T. T., Ngoduy, D., Le, L. B., 2020. Space distribution method for autonomous vehicles at a signalized multi-lane intersection. IEEE Trans Intell Transport Syst, 21, 5283–5294.
Stryszowski, M., Longo, S., Velenis, E., Forostovsky, G., 2021. A framework for self-enforced interaction between connected vehicles: Intersection negotiation. IEEE Trans Intell Transport Syst, 22, 6716–6725.
Treiber, M., Hennecke, A., Helbing, D., 2000. Congested traffic states in empirical observations and microscopic simulations. Phys Rev E Stat Phys Plasmas Fluids Relat Interdiscip Topics, 62, 1805–1824.
Vahidi, A., Sciarretta, A., 2018. Energy saving potentials of connected and automated vehicles. Transp Res Part C Emerg Technol, 95, 822–843.
Wang, K., Wang, Y., Du, H., Nam, K., 2021. Game-theory-inspired hierarchical distributed control strategy for cooperative intersection considering priority negotiation. IEEE Trans Veh Technol, 70, 6438–6449.
Wu, J., Qu, X., 2022. Intersection control with connected and automated vehicles: A review. J Intell Connect Veh, 5, 260–269.
Xiao, L., Gao, F., 2011. Practical string stability of platoon of adaptive cruise control vehicles. IEEE Trans Intell Transport Syst, 12, 1184–1194.
Ye, Y., Zhang, X., Sun, J., 2019. Automated vehicle’s behavior decision making using deep reinforcement learning and high-fidelity simulation environment. Transp Res Part C Emerg Technol, 107, 155–170.
Yu, H., Jiang, R., He, Z., Zheng, Z., Li, L., Liu, R. et al., 2021. Automated vehicle-involved traffic flow studies: A survey of assumptions, models, speculations, and perspectives. Transp Res Part C Emerg Technol, 127, 103101.
Zhang, Y., Zhou, Y., Lu, H., Fujita, H., 2021. Cooperative multi-agent actor-critic control of traffic network flow based on edge computing. Future Gener Comput Syst, 123, 128–141.
Zhang, Z., Yang, X. T., 2021. Analysis of highway performance under mixed connected and regular vehicle environment. J Intell Connect Veh, 4, 68–79.
Zhou, M., Yu, Y., Qu, X., 2020. Development of an efficient driving strategy for connected and automated vehicles at signalized intersections: A reinforcement learning approach. IEEE Trans Intell Transport Syst, 21, 433–443.
This is an open access article under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).
京公网安备11010802044758号