AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Powered by AMiner. Clicking this button will take you away from SciOpen.
Home Journal of Intelligent and Connected Vehicles Article
PDF (4.5 MB)
Cite
EndNote(RIS) BibTeX
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Research Article | Open Access

Enhancing safety and efficiency in automated container terminals: Route planning for hazardous material AGV using LSTM neural network and Deep Q-Network

Fei Li1,†, Junchi Cheng2,†, Zhiqi Mao3( ), Yuhao Wang3, Pingfa Feng1
Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China
Information Science and Technology College, Dalian Maritime University, Dalian 116000, China
School of Vehicle and Mobility, Tsinghua University, Beijing 100084, China

† Fei Li and Junchi Cheng contributed equally to this work.

Show Author Information

Abstract

As the proliferation and development of automated container terminal continue, the issues of efficiency and safety become increasingly significant. The container yard is one of the most crucial cargo distribution centers in a terminal. Automated Guided Vehicles (AGVs) that carry materials of varying hazard levels through these yards without compromising on the safe transportation of hazardous materials, while also maximizing efficiency, is a complex challenge. This research introduces an algorithm that integrates Long Short-Term Memory (LSTM) neural network with reinforcement learning techniques, specifically Deep Q-Network (DQN), for routing an AGV carrying hazardous materials within a container yard. The objective is to ensure that the AGV carrying hazardous materials efficiently reaches its destination while effectively avoiding AGVs carrying non-hazardous materials. Utilizing real data from the Meishan Port in Ningbo, Zhejiang, China, the actual yard is first abstracted into an undirected graph. Since LSTM neural network can efficiently conveys and represents information in long time sequences and do not causes useful information before long time to be ignored, a two-layer LSTM neural network with 64 neurons per layer was constructed for predicting the motion trajectory of AGVs carrying non-hazardous materials, which are incorporated into the map as background AGVs. Subsequently, DQN is employed to plan the route for an AGV transporting hazardous materials, aiming to reach its destination swiftly while avoiding encounters with other AGVs. Experimental tests have shown that the route planning algorithm proposed in this study improves the level of avoidance of hazardous material AGV in relation to non-hazardous material AGVs. Compared to the method where hazardous material AGV follow the shortest path to their destination, the avoidance efficiency was enhanced by 3.11%. This improvement demonstrates potential strategies for balancing efficiency and safety in automated terminals. Additionally, it provides insights for designing avoidance schemes for autonomous driving AGVs, offering solutions for complex operational environments where safety and efficient navigation are paramount.

Keywords

Long Short-Term Memory (LSTM)Deep Q-Network (DQN)container yardroute planninghazardous material Automated Guided Vehicle (AGV)

References

[1]

Cai, P., He, J., Li, Y., 2023. Hybrid cooperative intersection management for connected automated vehicles and pedestrians. J Intell Connect Veh, 6, 91–101.
Crossref Google Scholar
[2]

Chen, P., Fu, Z., Lim, A., Rodrigues, B., 2004. Port yard storage optimization. IEEE Trans Automat Sci Eng, 1, 26–37.
Crossref Google Scholar
[3]

Chen, R., Meng, Q., Jia, P., 2022. Container port drayage operations and management: Past and future. Transp Res Part E Logist Transp Rev, 159, 102633.
Crossref Google Scholar
[4]

Dai, C., Zong, C., Zhang, D., Li, G., Chuyo, K., Zheng, H., et al., 2023. Human-like lane-changing trajectory planning algorithm for human-machine conflict mitigation. J Intell Connect Veh , 6, 46–63.
Crossref Google Scholar
[5]

Ding, H., Li, W., Xu, N., Zhang, J., 2022. An enhanced eco-driving strategy based on reinforcement learning for connected electric vehicles: Cooperative velocity and lane-changing control. J Intell Connect Veh, 5, 316–332.
Crossref Google Scholar
[6]

Fang, L., Guan, Z.W., Wang, T., Gong, J. F., Du, F., 2022. Collision avoidance model and its validation for intelligent vehicles based on deep learning LSTM. J Automot Saf Energy, 13, 104–111.
Google Scholar
[7]

Filom, S., Amiri, A. M., Razavi, S., 2022. Applications of machine learning methods in port operations–A systematic literature review. Transp Res Part E Logist Transp Rev, 161, 102722.
Crossref Google Scholar
[8]

Gunawardhana, J. A., Perera, H. N., Thibbotuwawa, A., 2021. Rule-based dynamic container stacking to optimize yard operations at port terminals. Marit Transp Res, 2, 100034.
Crossref Google Scholar
[9]

Han, L., Zhang, H., Fang, R.Y., Liu, G. P., Zhu, C.S., Chi, R. F., 2023. Global path planning strategy based on an improved deep reinforcement learning. J Automot Saf Energy, 14, 202–211.
Crossref Google Scholar
[10]

Li, H., Peng, J., Wang, X., Wan, J., 2021. Integrated resource assignment and scheduling optimization with limited critical equipment constraints at an automated container terminal. IEEE Trans Intell Transport Syst, 22, 7607–7618.
Crossref Google Scholar
[11]

Li, N., Sheng, H., Wang, P., Jia, Y., Yang, Z., Jin, Z., 2023. Modeling categorized truck arrivals at ports: Big data for traffic prediction. IEEE Trans Intell Transport Syst, 24, 2772–2788.
Crossref Google Scholar
[12]

Li, S., Wei, C., Wang, Y., 2022. Combining decision making and trajectory planning for lane changing using deep reinforcement learning. IEEE Trans Intell Transport Syst, 23, 16110–16136.
Crossref Google Scholar
[13]
Liu, Y., Wu, F., Liu, Z., Wang, K., Wang, F., Qu, X., 2023. Can language models be used for real-world urban-delivery route optimization? Innovation, 4, 100520.
Crossref
[14]

Pei, M., Zhu, H., Ling, J., Hu, Y., Yao, H., Zhong, L., 2023. Empowering highway network: Optimal deployment and strategy for dynamic wireless charging lanes. Commun Transport Res, 3, 100106.
Crossref Google Scholar
[15]

Qu, X., Lin, H., Liu, Y., 2023. Envisioning the future of transportation: Inspiration of ChatGPT and large models. Commun Transport Res, 3, 100103.
Crossref Google Scholar
[16]

Qu, X., Wang, S., Niemeier, D., 2022. On the urban-rural bus transit system with passenger-freight mixed flow. Commun Transport Res, 2, 100054.
Crossref Google Scholar
[17]

Skaf, A., Lamrous, S., Hammoudan, Z., Manier, M. A., 2021. Integrated quay crane and yard truck scheduling problem at port of Tripoli-Lebanon. Comput Ind Eng, 159, 107448.
Crossref Google Scholar
[18]

Sun, Y., Chu, Y., Xu, T., Li, J., Ji, X., 2022. Inverse reinforcement learning based: Segmented lane-change trajectory planning with consideration of interactive driving intention. IEEE Trans Veh Technol, 71, 11395–11407.
Crossref Google Scholar
[19]

Tan, C., Qin, T., He, J., Wang, Y., Yu, H., 2024. Yard space allocation of container port based on dual cycle strategy. Ocean Coast Manag, 247, 106915.
Crossref Google Scholar
[20]
Wang, K., Qian, Y., An, T., Zhang, Z., Zhang, J., 2022. LSTM-based prediction method of surrounding vehicle trajectory. In: 2022 International Conference on Artificial Intelligence in Everything (AIE), 100–105.
Crossref
[21]

Wang, K., Zhen, L., Wang, S., Laporte, G., 2018. Column generation for the integrated berth allocation, quay crane assignment, and yard assignment problem. Transp Sci, 52, 812–834.
Crossref Google Scholar
[22]

Xiang, X., Liu, C., Lee, L. H., Chew, E. P., 2022. Performance estimation and design optimization of a congested automated container terminal. IEEE Trans Automat Sci Eng, 19, 2437–2449.
Crossref Google Scholar
[23]
Yang, Z., Liu, D., Ma, L., 2022. Vehicle trajectory prediction based on LSTM network. In: 2022 International Conference on Artificial Intelligence and Computer Information Technology (AICIT), 1–4.
Crossref
[24]

Zhang, X. F., Wu, L., 2023. Behavior decision-making model for autonomous vehicles based on an ensemble deep reinforcement learning. J Automot Saf Energy, 14, 472–479.
Google Scholar
[25]

Zhao, G., Liu, J., Tang, L., Zhao, R., Dong, Y., 2020. Model and heuristic solutions for the multiple double-load crane scheduling problem in slab yards. IEEE Trans Automat Sci Eng, 17, 1307–1319.
Crossref Google Scholar
[26]

Zhen, L., 2016. Modeling of yard congestion and optimization of yard template in container ports. Transp Res Part B Methodol, 90, 83–104.
Crossref Google Scholar
[27]

Zhen, L., Lee, L. H., Chew, E. P., Chang, D. F., Xu, Z. X., 2012. A comparative study on two types of automated container terminal systems. IEEE Trans Automat Sci Eng, 9, 56–69.
Crossref Google Scholar
[28]

Zhu, J., Easa, S., Gao, K., 2022. Merging control strategies of connected and autonomous AGVs at freeway on-ramps: a comprehensive review. J Intell Connect Veh, 5, 99–111.
Crossref Google Scholar
[29]

Zhu, W., Qin, H., Lim, A., Zhang, H., 2012. Iterative deepening A* algorithms for the container relocation problem. IEEE Trans Automat Sci Eng, 9, 710–722.
Crossref Google Scholar
Journal of Intelligent and Connected Vehicles
Volume 7 Issue 1,
March 2024
Pages 64-77
DOI: 10.26599/JICV.2023.9210041
Cite this article:
Li F, Cheng J, Mao Z, et al. Enhancing safety and efficiency in automated container terminals: Route planning for hazardous material AGV using LSTM neural network and Deep Q-Network. Journal of Intelligent and Connected Vehicles, 2024, 7(1): 64-77. https://doi.org/10.26599/JICV.2023.9210041

156

Views

13

Downloads

1

Crossref

1

Scopus

Altmetrics
Received: 17 January 2024
Revised: 06 March 2024
Accepted: 18 March 2024
Published: 31 March 2024
© The author(s) 2024.

This is an open access article under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).
Return