AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Powered by AMiner. Clicking this button will take you away from SciOpen.
Home Journal of Intelligent and Connected Vehicles Article
PDF (5.7 MB)
Cite
EndNote(RIS) BibTeX
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Research Article | Open Access

Real-time intersection vehicle turning movement counts from live UAV video stream using multiple object tracking

Yuhao Wang1, Ivan Wang-Hei Ho1,2( ), Yuhong Wang3
Department of Electrical and Electronic Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China
Otto Poon Charitable Foundation Smart Cities Research Institute, The Hong Kong Polytechnic University, Hong Kong SAR, China
Department of Civil and Environmental Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China
Show Author Information

Abstract

The intelligent transportation system (ITS) is committed to ensuring safe and effective next-generation traffic throughout a city. However, such efficient operation on urban traffic networks needs the support of big traffic data, especially Turning Movement Counts (TMC) at intersections. Generally, TMC data are more challenging to collect due to labor cost and accuracy problems. In this paper, we leverage the capabilities of Unmanned Aerial Vehicles (UAV) to collect real-time TMC data in a cost-efficient way. We proposed a real-time TMC data collection framework based on a live video stream. The vehicle tracking capability is boosted by multiple object tracking based on tracking by detection. In addition, a challenging case study was conducted, and our results demonstrate the feasibility and robustness of the proposed TMC data collection framework. Specifically, with a GTX 1650 graphics card, about 10 FPS can be achieved in real-time for the TMC data collection. The overall accuracy is 91.93%, and the best case is over 98% accurate. In the context of miscounting, the major reason is due to ID switching caused by background occlusion. The proposed framework is expected to provide real-time data for traffic capacity analysis and advanced traffic simulation such as digital twins.

Keywords

turning movement countsunmanned aerial vehiclesmulti objects trackingreal-time

References

[1]

Abdullah, M. S., Sanik, M. E., Mat Nor, A. H., Salim, S., Abdul Malek, K. Z., Razali, N. F. et al., 2022. Reliability of 15-minute drone footage volume for estimating urban traffic flow rates: A preliminary study. IOP Conf Ser: Earth Environ Sci, 1022, 012022.
Crossref Google Scholar
[2]
Ashworth, R., 1976. A video tape recording system for traffic data collection and analysis. Traffic Engineering & Control 17, 468–470.
[3]
Becker, U. J., 1989. Automatic traffic data collection using aerial video images. In: Second International Conference on Road Traffic Monitoring, 79–83.
[4]
Bewley, A., Ge, Z., Ott, L., Ramos, F., Upcroft, B., 2016. Simple online and realtime tracking. In: 2016 IEEE International Conference on Image Processing (ICIP), 3464–3468.
Crossref
[5]

Bélisle, F., Saunier, N., Bilodeau, G. A., le Digabel, S., 2017. Optimized video tracking for automated vehicle turning movement counts. Transportation Research Record, 2645, 104–112.
Crossref Google Scholar
[6]

Bonneson, J. A., Fitts J. W., 1995. Traffic data collection using video-based systems. TRANSP RES RECORD 1477, 31–40.
Google Scholar
[7]

Brahimi, M., Karatzas S., Theuriot J., Christoforou Z., 2020. Drones for traffic flow analysis of urban roundabouts. International journal of traffic and transportation engineering, 9, 62–71.
Google Scholar
[8]
Brockfeld, E., Wagner P., Lorkowski S., Mieth P., 2007. Benefits and limits of recent floating car data technology – An evaluation study. In: WCTR2007-11th World Conference on Transport Research, C2-830.
[9]

Bui, K. H N., Yi, H., Cho, J., 2020. A multi-class multi-movement vehicle counting framework for traffic analysis in complex areas using CCTV systems. Energies, 13, 2036.
Crossref Google Scholar
[10]
Chen, P. Y., Hsieh, J. W., Gochoo, M., Chang, M. C., Wang, C. Y., Chen, Y. S., et al., 2020. Drone-based vehicle flow estimation and its application to traffic conflict hotspot detection at intersections. In: 2020 IEEE International Conference on Image Processing (ICIP), 1521–1525.
Crossref
[11]
Dalal, N., Triggs, B., 2005. Histograms of oriented gradients for human detection. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), 886–893.
[12]
Du, Y., Zhao, Z., Song, Y., Zhao, Y., Su, F., Gong, T., et al., 2022. StrongSORT: Make DeepSORT great again. arXiv: 2202.13514. https://arxiv.org/abs/2202.13514.pdf
[13]

Ghods, A. H., Fu, L., 2014. Real-time estimation of turning movement counts at signalized intersections using signal phase information. Transp Res Part C Emerg Technol, 47, 128–138.
Crossref Google Scholar
[14]
Gloudemans, D., Work, D. B., 2021. Fast vehicle turning-movement counting using localization-based tracking. In: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 4150–4159.
Crossref
[15]

Huang, T., Wang, S., & Sharma, A., 2020. Highway crash detection and risk estimation using deep learning. Accident Analysis & Prevention, 135, 105392.
Crossref Google Scholar
[16]
Jain, N. K., Saini, R. K., Mittal, P., 2019. A review on traffic monitoring system techniques. In: Soft Computing: Theories and Applications, 569–577.
Crossref
[17]
Jocher, G., Stoken, A., Borovec, J., NanoCode, ChristopherSTAN, Liu, C., et al., 2020. ultralytics/yolov5: v3.1-Bug Fixes and Performance Improvements. https://zenodo.org/record/4154370
[18]

Kwasniak, A., Kerezman, A., 2017. Drones in transportation engineering: A discussion of current drone rules, equipment, and applications. Inst Transp Eng ITE J, 87, 40–43.
Google Scholar
[19]
Leduc, G., 2008. Road traffic data: collection methods and applications. JRC 47967.
[20]

Li, Q., Chen, Z., Li, X., 2022a. A review of connected and automated vehicle platoon merging and splitting operations. IEEE Trans Intell Transp Syst, 23, 22790–22806.
Crossref Google Scholar
[21]

Li, Q., Li, X., 2022. Generalized fundamental diagram with implications of congestion mitigation. J Transp Eng Part A Syst, 148, 04022021.
Crossref Google Scholar
[22]

Li, Q., Li, X., Huang, Z., Halkias, J., McHale, G., James, R., 2022b. Simulation of mixed traffic with cooperative lane changes. Computer Aided Civil Eng, 37, 1978–1996.
Crossref Google Scholar
[23]
Li, Q., Li, X., Yao, H., Liang, Z., 2021. Automated vehicle identification in mixed traffic. In: 2021 IEEE International Intelligent Transportation Systems Conference (ITSC), 1–5.
Crossref
[24]

Li, S., Yu, H., Zhang, J., Yang, K., & Bin, R., 2014. Video-based traffic data collection system for multiple vehicle types. IET Intelligent Transport Systems, 8, 164–174.
Crossref Google Scholar
[25]
Lingani, G. M., Rawat, D. B., Garuba, M., 2019. Smart traffic management system using deep learning for smart city applications. In: 2019 IEEE 9th Annual Computing and Communication Workshop and Conference (CCWC), 101–106.
Crossref
[26]

Mallikarjuna, C., Phanindra, A., Rao, K. R., 2009. Traffic data collection under mixed traffic conditions using video image processing. J Transp Eng, 135, 174–182.
Crossref Google Scholar
[27]

Nepal, U., Eslamiat, H., 2022. Comparing YOLOv3, YOLOv4 and YOLOv5 for autonomous landing spot detection in faulty UAVs. Sensors, 22, 464.
Crossref Google Scholar
[28]

Qureshi, K. N., A. H. Abdullah, 2013. A survey on intelligent transportation systems. Middle-East Journal of Scientific Research, 15, 629–642.
Google Scholar
[29]
Rajendran, S., Jayavel, K., Bharathi, N., 2021. Data collection and deep learning for traffic and road infrastructure management. In: Artificial Intelligence Techniques for Advanced Computing Applications. Singapore: Springer, 2021, 403–414.
Crossref
[30]
Redmon, J., Divvala, S., Girshick, R., Farhadi, A., 2016. You only look once: Unified, real-time object detection. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 779–788.
Crossref
[31]
Shahgholian, M., Gharavian, D., 2018. Advanced traffic management systems: An overview and A development strategy. https://arxiv.org/abs/1810.02530.pdf
[32]

Shan, D., Lei, T., Yin, X., Luo, Q., Gong, L., 2021. Extracting key traffic parameters from UAV video with on-board vehicle data validation. Sensors, 21, 5620.
Crossref Google Scholar
[33]
Smith, D., McIntyre, J., Anderson-Wilk, M., Moreau S., 2002. Handbook of simplified practice for traffic studies. Iowa DOT Project TR-455.
[34]
Sreekumar, U. K., Devaraj, R., Li, Q., Liu, K., 2017. TPCAM: Real-time traffic pattern collection and analysis model based on deep learning. In: 2017 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computed, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation, SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI, 1–4.
Crossref
[35]
Versavel, J., Boucke, B., 1998. Video for traffic data and incident detection by traficon. In: Fifth International Conference on Applications of Advanced Technologies in Transportation Engineering American Society of Civil Engineers, 33–40.
[36]
Wojke, N., Bewley, A., Paulus, D., 2017. Simple online and realtime tracking with a deep association metric. In: 2017 IEEE international conference on image processing (ICIP), 3645–3649.
Crossref
[37]

Xu, P., Li, X., Wu, Y. J., Noh, H., 2023. Network-level turning movement counts estimation using traffic controller event-based data. J Intell Transp Syst, 27, 677–691.
Crossref Google Scholar
[38]

Xu, R., Lin, H., Lu, K., Cao, L., Liu, Y., 2021. A forest fire detection system based on ensemble learning. Forests, 12, 217.
Crossref Google Scholar
[39]
Yang, F., Zhang, X., Liu, B., 2022. Video object tracking based on YOLOv7 and DeepSORT. https://arxiv.org/abs/2207.12202.pdf
[40]
Zhang, G., Avery, R. P., Wang, Y., 2007. Video-based vehicle detection and classification system for real-time traffic data collection using uncalibrated video cameras. Transp Res Record, 1993, 1, 138–147.
Crossref
[41]
Zhou, F., Zhao, H., Nie, Z., 2021. Safety helmet detection based on YOLOv5. In: 2021 IEEE International Conference on Power Electronics, Computer Applications (ICPECA), 6–11.
Crossref
[42]

Zhu, L., Yu, F. R., Wang, Y., Ning, B., Tang, T., 2019. Big data analytics in intelligent transportation systems: A survey. IEEE Trans Intell Transp Syst, 20, 383–398.
Crossref Google Scholar
[43]

Zhu, P., Wen, L., Du, D., Bian, X., Fan, H., Hu, Q. et al., 2022. Detection and tracking meet drones challenge. IEEE Trans Pattern Anal Mach Intell, 44, 7380–7399.
Crossref Google Scholar
[44]
Zong, S., Chen, S., Alinizzi, M., Li, Y., Labi, S., 2021. Using UAVs for vehicle tracking and collision risk assessment at intersections. https://arxiv.org/abs/2110.06775.pdf
Journal of Intelligent and Connected Vehicles
Volume 6 Issue 3,
September 2023
Pages 149-160
DOI: 10.26599/JICV.2023.9210014
Cite this article:
Wang Y, Ho IW-H, Wang Y. Real-time intersection vehicle turning movement counts from live UAV video stream using multiple object tracking. Journal of Intelligent and Connected Vehicles, 2023, 6(3): 149-160. https://doi.org/10.26599/JICV.2023.9210014

312

Views

15

Downloads

0

Crossref

0

Web of Science

0

Scopus

Altmetrics
Received: 06 May 2023
Revised: 29 June 2023
Accepted: 14 July 2023
Published: 30 September 2023
© The author(s) 2023.

This is an open access article under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).
Return