AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Powered by AMiner. Clicking this button will take you away from SciOpen.
Home Tsinghua Science and Technology Article
PDF (3.5 MB)
Cite
EndNote(RIS) BibTeX
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Open Access

Spatial-Temporal ConvLSTM for Vehicle Driving Intention Prediction

Department of Automation, Tsinghua University, Beijing 100084, China
Department of Computer Science, Tsinghua University, Beijing 100084, China
National Laboratory for Information Science and Technology (TNList), Tsinghua University, Beijing 100084, China
Show Author Information

Abstract

Driving intention prediction from a bird’s-eye view has always been an active research area. However, existing research, on one hand, has only focused on predicting lane change intention in highway scenarios and, on the other hand, has not modeled the influence and spatiotemporal relationship of surrounding vehicles. This study extends the application scenarios to urban road scenarios. A spatial-temporal convolutional long short-term memory (ConvLSTM) model is proposed to predict the vehicle’s lateral and longitudinal driving intentions simultaneously. This network includes two modules: the first module mines the information of the target vehicle using the long short-term memory (LSTM) network and the second module uses ConvLSTM to capture the spatial interactions and temporal evolution of surrounding vehicles simultaneously when modeling the influence of surrounding vehicles. The model is trained and verified on a real road dataset, and the results show that the spatial-temporal ConvLSTM model is superior to the traditional LSTM in terms of accuracy, precision, and recall, which helps improve the prediction accuracy at different time horizons.

Keywords

driving intention predictionlane change intentionConvLSTM

References

[1]
S. Su, K. Muelling, J. M. Dolan, P. Palanisamy, and P. Mudalige, Learning vehicle cooperative lane-changing behavior from observed trajectories in the NGSIM dataset, in Proc. 2018 IEEE Intelligent Vehicles Symp., Suzhou, China, 2018, pp. 1412-1417.
Crossref
[2]
N. Deo and M. M. Trivedi, Convolutional social pooling for vehicle trajectory prediction, in Proc. IEEE/CVF Conf. Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA, 2018.
Crossref
[3]
G. Weidl, A. L. Madsen, V. Tereshchenko, W. Zhang, S. Wang, and D. Kasper, Situation awareness and early recognition of traffic maneuvers, in Proc. 9th EUROSIM & 57th SIMS, Oulu, Finland, 2016, pp. 8-18.
[4]
C. Y. Dong, J. M. Dolan, and B. Litkouhi, Intention estimation for ramp merging control in autonomous driving, in Proc. 2017 IEEE Intelligent Vehicles Symp. (IV), Los Angeles, CA, USA, 2017, pp. 1584-1589.
Crossref
[5]
D. J. Phillips, T. A. Wheeler, and M. J. Kochenderfer, Generalizable intention prediction of human drivers at intersections, in Proc. 2017 IEEE Intelligent Vehicles Symp. (IV), Los Angeles, CA, USA, 2017, pp. 1665-1670.
Crossref
[6]
Federal Highway Administration, Next generation simulation fact sheet, https://www.fhwa.dot.gov/publications/research/operations/its/06135/index.cfm, 2011.
[7]
F. Yu, H. F. Chen, X. Wang, W. Q. Xian, Y. Y. Chen, F. C. Liu, V. Madhavan, and T. Darrell, BDD100K: A diverse driving dataset for heterogeneous multitask learning, arXiv preprint arXiv:1805.04687, 2018.
Google Scholar
[8]
H. M. Mandalia and M. D. D. Salvucci, Using support vector machines for lane-change detection, Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 49, no. 22, pp. 1965-1969, 2005.
Crossref Google Scholar
[9]
S. B. Amsalu, A. Homaifar, F. Afghah, S. Ramyar, and A. Kurt, Driver behavior modeling near intersections using support vector machines based on statistical feature extraction, in Proc. 2015 IEEE Intelligent Vehicles Symp. (IV), Seoul, Republic of Korea, 2015, pp. 1270-1275.
Crossref
[10]
Y. L. Dou, F. J. Yan, and D. W. Feng, Lane changing prediction at highway lane drops using support vector machine and artificial neural network classifiers, in Proc. 2016 IEEE Int. Conf. Advanced Intelligent Mechatronics (AIM), Banff, Canada, 2016, pp. 901-906.
Crossref
[11]
S. W. Liu, K. Zheng, L. Zhao, and P. Z. Fan, A driving intention prediction method based on hidden Markov model for autonomous driving, Computer Communications, vol. 157, pp. 143-149, 2020.
Crossref Google Scholar
[12]
Y. Xing, C. Lv, H. J. Wang, D. P. Cao, and E. Velenis, An ensemble deep learning approach for driver lane change intention inference, Transportation Research Part C: Emerging Technologies, vol. 115, p. 102615, 2020.
Crossref Google Scholar
[13]
A. Girma, S. Amsalu, A. Workineh, M. Khan, and A. Homaifar, Deep learning with attention mechanism for predicting driver intention at intersection, arXiv preprint arXiv: 2006.05918, 2020.
Crossref Google Scholar
[14]
S. Mozaffari, O. Y. Al-Jarrah, M. Dianati, P. Jennings, and A. Mouzakitis, Deep learning-based vehicle behavior prediction for autonomous driving applications: A review, IEEE Transactions on Intelligent Transportation Systems, .
Crossref Google Scholar
[15]
S. Z. Dai, L. Li, and Z. H. Li, Modeling vehicle interactions via modified LSTM models for trajectory prediction, IEEE Access, vol. 7, pp. 38287-38296, 2019.
Crossref Google Scholar
[16]
J. Schlechtriemen, A. Wedel, J. Hillenbrand, G. Breuel, and K. D. Kuhnert, A lane change detection approach using feature ranking with maximized predictive power, in 2014 IEEE Intelligent Vehicles Symp. Proc., Dearborn, MI, USA, 2014, pp. 108-114.
Crossref
[17]
J. T. Connor, R. D. Martin, and L. E. Atlas, Recurrent neural networks and robust time series prediction, IEEE Transactions on Neural Networks, vol. 5, no. 2, pp. 240-254, 1994.
Crossref Google Scholar
[18]
S. Hochreiter and J. Schmidhuber, Long short-term memory, Neural Computation, vol. 9, no. 8, pp. 1735-1780, 1997.
Crossref Google Scholar
[19]
F. Karim, S. Majumdar, H. Darabi, and S. Harford, Multivariate LSTM-FCNs for time series classification, Neural Networks, vol. 116, pp. 237-245, 2019.
Crossref Google Scholar
[20]
M. Sundermeyer, R. Schlüter, and H. Ney, LSTM neural networks for language modeling, in Proc. 13th Annual Conf. Int. Speech Commun. Association, Portland, OR, USA, 2012.
Crossref
[21]
A. Alahi, K. Goel, V. Ramanathan, A. Robicquet, L. Fei-Fei, and S. Savarese, Social LSTM: Human trajectory prediction in crowded spaces, in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 2016, pp. 961-971.
Crossref
[22]
F. Altché and A. de La Fortelle, An LSTM network for highway trajectory prediction, in Proc. 2017 IEEE 20th Int. Conf. Intelligent Transportation Systems (ITSC), Yokohama, Japan, 2017, pp. 353-359.
Crossref
[23]
S. H. Park, B. Kim, C. M. Kang, C. C. Chung, and J. W. Choi, Sequence-to-sequence prediction of vehicle trajectory via LSTM encoder-decoder architecture, in Proc. 2018 IEEE Intelligent Vehicles Symp. (IV), Changshu, China, 2018, pp. 1672-1678.
Crossref
[24]
X. J. Shi, Z. R. Chen, H. Wang, D. Y. Yeung, W. K. Wong, and W. C. Woo, Convolutional LSTM network: A machine learning approach for precipitation nowcasting, in Proc. 28th Int. Conf. Neural Information Processing Systems, Cambridge, MA, USA, 2015, pp. 802-810.
[25]
L. Zhang, G. M. Zhu, P. Y. Shen, J. Song, S. A. Shah, and M. Bennamoun, Learning spatiotemporal features using 3DCNN and convolutional LSTM for gesture recognition, in Proc. 2017 IEEE Int. Conf. Computer Vision Workshops, Venice, Italy, 2017, pp. 3120-3128.
Crossref
[26]
D. J. Wang, Y. Yang, and S. M. Ning, DeepSTCL: A deep spatio-temporal convLSTM for travel demand prediction, in Proc. 2018 Int. Joint Conf. Neural Networks (IJCNN), Rio de Janeiro, Brazil, 2018, pp. 1-8.
Crossref
[27]
Z. N. Yuan, X. Zhou, and T. B. Yang, Hetero-convLSTM: A deep learning approach to traffic accident prediction on heterogeneous spatio-temporal data, in Proc. 24th ACM SIGKDD Int. Conf. Knowledge Discovery & Data Mining, London, UK, 2018, pp. 984-992.
Crossref
[28]
M. Abadi, P. Barham, J. M. Chen, Z. F. Chen, A. Davis, J. Dean, M. Devin, S. Ghemawat, G. Irving, M. Isard, et al., TensorFlow: A system for large-scale machine learning, in Proc. 12th USENIX Conf. Operating Systems Design and Implementation, Berkeley, CA, USA, 2016, pp. 265-283.
Tsinghua Science and Technology
Volume 27 Issue 3,
June 2022
Pages 599-609
DOI: 10.26599/TST.2020.9010061
Cite this article:
Huang H, Zeng Z, Yao D, et al. Spatial-Temporal ConvLSTM for Vehicle Driving Intention Prediction. Tsinghua Science and Technology, 2022, 27(3): 599-609. https://doi.org/10.26599/TST.2020.9010061

751

Views

87

Downloads

35

Crossref

33

Web of Science

37

Scopus

2

CSCD

Altmetrics
Received: 19 November 2020
Revised: 07 December 2020
Accepted: 14 December 2020
Published: 13 November 2021
© The author(s) 2022

The articles published in this open access journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).
Return