AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Powered by AMiner. Clicking this button will take you away from SciOpen.
Home Journal of Intelligent and Connected Vehicles Article
PDF (9.1 MB)
Cite
EndNote(RIS) BibTeX
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Research Article | Open Access

Roadside cross-camera vehicle tracking combining visual and spatial-temporal information for a cloud control system

Bolin Gao1, Zhuxin Li2, Dong Zhang3, Yanwei Liu2( ), Jiaxing Chen1, Ziyuan Lv2
School of Vehicle and Mobility, Tsinghua University, Beijing 100084, China
School of Electromechanical Engineering, Guangdong University of Technology, Guangzhou 510006, China
Department of Mechanical and Aerospace Engineering, Brunel University London, UB8 3PH, UK
Show Author Information

Abstract

Roadside cameras play a crucial role in road traffic, serving as an indispensable part of integrated vehicle-road-cloud systems due to their extensive visibility and monitoring capabilities. Nevertheless, these cameras face challenges in continuously tracking targets across perception domains. To address the issue of tracking vehicles across nonoverlapping perception domains between cameras, we propose a cross-camera vehicle tracking method within a Vehicle–Road–Cloud system that integrates visual and spatiotemporal information. A Gaussian model with microlevel traffic features is trained using vehicle information obtained through online tracking. Finally, the association of vehicle targets is achieved through the Gaussian model combining time and visual feature information. The experimental results indicate that the proposed system demonstrates excellent performance.

Keywords

integrated Vehicle–Road–Cloudcross-cameraonline trackingintercamera association

References

 
Bewley, A., Ge, Z., Ott, L., Ramos, F., Upcroft, B., 2016. Simple online and realtime tracking. In: 2016 IEEE International Conference on Image Processing (ICIP), 3464–3468.
Crossref
 
Bochinski, E., Eiselein, V., Sikora, T., 2017. High-speed tracking-by-detection without using image information. In: 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), 1–6.
Crossref
 
Bochinski, E., Senst, T., Sikora, T., 2018. Extending IOU based multi-object tracking by visual information. In: 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), 1–6.
Crossref
 
Cao, J., Pang, J., Weng, X., Khirodkar, R., Kitani, K., 2023. Observation-centric SORT: Rethinking SORT for robust multi-object tracking. In: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 9686–9696.
Crossref
 
Caspi, Y., Irani, M., 2000. A step towards sequence-to-sequence alignment. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662), 682–689.
 

Chen, M., Wu, Y. M., Gao, B. L., Zheng, K. Y., 2021. Vehicle target oriented bidirectional matching handover method for multi camera on roadside. Automot Eng, 43, 1435−1441.
Google Scholar
 

Collins, R. T., Lipton, A. J., Kanade, T., 2000. Introduction to the special section on video surveillance. IEEE Trans Pattern Anal Mach Intell, 22, 745−746.
Crossref Google Scholar
 
Dick, A. R., Brooks, M. J., 2004. A stochastic approach to tracking objects across multiple cameras. In: Proceedings of the 17th Australian joint conference on Advances in Artificial Intelligence, 160–170.
Crossref
 
Girshick, R., 2015. Fast R-CNN. In: 2015 IEEE International Conference on Computer Vision (ICCV), 1440–1448.
Crossref
 
He, Z., Lei, Y., Bai, S., Wu, W., 2019. Multi-camera vehicle tracking with powerful visual features and spatial-temporal cue. In: 2019 CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).
 
Javed, O., Rasheed, Z., Shafique, K., Shah, M., 2003. Tracking across multiple cameras with disjoint views. In: Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2, 952–957.
Crossref
 

Li, K. Q., Chang, X. Y., Li, J. W., Xu, Q., Gao, B. L., Pan, J. A., 2020. Cloud control system for intelligent and connected vehicles and its application. Automot Eng, 42, 1595−1605.
Google Scholar
 
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C. Y., et al., 2016. SSD: single shot multi-box detector. In: European Conference on Computer Vision, 21–37.
Crossref
 

Madden, C., Cheng, E. D., Piccardi, M., 2007. Tracking people across disjoint camera views by an illumination-tolerant appearance representation. Mach Vis Appl, 18, 233−247.
Crossref Google Scholar
 
Maggiolino, G., Ahmad, A., Cao, J., Kitani, K., 2023. Deep OC-sort: Multi-pedestrian tracking by adaptive identification. https://doi.org/10.48550/arXiv.2302.11813
Crossref
 
Porikli, F., Divakaran, A., 2003. Multi-camera calibration, object tracking and query generation. In: 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698), 1–653.
Crossref
 
Redmon, J., Divvala, S., Girshick, R., Farhadi, A., 2016. You only look once: Unified, real-time object detection. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 779–788.
Crossref
 

Ren, S., He, K., Girshick, R., Sun, J., 2017. Faster R-CNN: Towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell, 39, 1137−1149.
Crossref Google Scholar
 
Ren, P., Lu, K., Yang, Y., Yang, Y., Sun, G., Wang, W., et al., 2021. Multi-camera vehicle tracking system based on spatial-temporal filtering. In: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 4213–4219.
Crossref
 
Stein, G. P., 1999. Tracking from multiple view points: Self-calibration of space and time. In: Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149), 521–527.
 
Tang, S., Andres, B., Andriluka, M., Schiele, B., 2015. Subgraph decomposition for multi-target tracking. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 5033–5041.
Crossref
 
Tran, D. N. N., Pham, L. H., Jeon, H. J., Nguyen, H. H., Jeon, H. M., Tran, T. H. P., et al., 2022. A robust traffic-aware city-scale multi-camera vehicle tracking of vehicles. In: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 3150–3159.
Crossref
 

Velipasalar, S., Schlessman, J., Chen, C. Y., Wolf, W., Singh, J., 2008. A scalable clustered camera system for multiple object tracking. EURASIP J Image Video Process, 2008, 542808.
Crossref Google Scholar
 

Wang, X., Turetken, E., Fleuret, F., Fua, P., 2015. Tracking interacting objects using intertwined flows. IEEE Trans Pattern Anal Mach Intell, 38, 2312−2326.
Crossref Google Scholar
 
Wojke, N., Bewley, A., Paulus, D., 2017. Simple online and realtime tracking with a deep association metric. In: 2017 IEEE International Conference on Image Processing (ICIP), 3645–3649.
Crossref
 
Yao, H., Duan, Z., Xie, Z., Chen, J., Wu, X., Xu, D., et al., 2022. City-scale multi-camera vehicle tracking based on space-time-appearance features. In: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 3310–3318.
Crossref
 
Yang, X., Ye, J., Lu, J., Gong, C., Jiang, M., Lin, X., et al., 2022. Box-grained reranking matching for multi-camera multi-target tracking. In: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 3096–3106.
Crossref
Journal of Intelligent and Connected Vehicles
Volume 7 Issue 2,
June 2024
Pages 129-137
DOI: 10.26599/JICV.2023.9210034
Cite this article:
Gao B, Li Z, Zhang D, et al. Roadside cross-camera vehicle tracking combining visual and spatial-temporal information for a cloud control system. Journal of Intelligent and Connected Vehicles, 2024, 7(2): 129-137. https://doi.org/10.26599/JICV.2023.9210034

147

Views

11

Downloads

0

Crossref

0

Scopus

Altmetrics
Received: 23 November 2023
Revised: 17 January 2024
Accepted: 20 February 2024
Published: 30 June 2024
© The author(s) 2023.

This is an open access article under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).
Return