AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
PDF (1.7 MB)
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Review | Open Access

A review of vehicle detection methods based on computer vision

Changxi Ma1,2Fansong Xue1( )
School of Traffic and Transportation, Lanzhou Jiaotong University, Lanzhou 730070, China
Key Laboratory of Railway Industry on Plateau Railway Transportation Intelligent Management and Control, Lanzhou 730070, China
Show Author Information

Abstract

With the increasing number of vehicles, there has been an unprecedented pressure on the operation and maintenance of intelligent transportation systems and transportation infrastructure. In order to achieve faster and more accurate identification of traffic vehicles, computer vision and deep learning technology play a vital role and have made significant advancements. This study summarizes the current research status, latest findings, and future development trends of traditional detection algorithms and deep learning-based detection algorithms. Among the detection algorithms based on deep learning, this study focuses on the representative convolutional neural network models. Specifically, it examines the two-stage and one-stage detection algorithms, which have been extensively utilized in the field of intelligent transportation systems. Compared to traditional detection algorithms, deep learning-based detection algorithms can achieve higher accuracy and efficiency. The single-stage detection algorithm is more efficient for real-time detection, while the two-stage detection algorithm is more accurate than the single-stage detection algorithm. In the follow-up research, it is important to consider the balance between detection efficiency and detection accuracy. Additionally, vehicle missed detection and false detection in complex scenes, such as bad weather and vehicle overlap, should be taken into account. This will ensure better application of the research findings in engineering practice.

References

[1]
Alsanabani, A. A., Saeed, S. A., Al-Mkhlafi, M., Albishari, M., 2021. A low cost and real time vehicle detection using enhanced YOLOv4-tiny. In: 2021 IEEE International Conference on Artificial Intelligence and Computer Applications (ICAICA), 372–377.
[2]

Bertozzi, M., Broggi, A., Castelluccio, S., 1997. A real-time oriented system for vehicle detection. J Syst Archit Euromicro J, 43, 317–325.

[3]
Bochkovskiy, A., Wang, C. Y., Liao, H. Y. M., 2020. YOLOv4: Optimal speed and accuracy of object detection. https://doi.org/10.48550/arXiv.2004.10934
[4]

Bucher, T., Curio, C., Edelbrunner, J., Igel, C., Kastrup, D., Leefken, I., et al., 2003. Image processing and behavior planning for intelligent vehicles. IEEE Trans Ind Electron, 50, 62–75.

[5]

Cai, Y., Luan, T., Gao, H., Wang, H., Chen, L., Li, Y., et al., 2021. YOLOv4-5D: An effective and efficient object detector for autonomous driving. IEEE Trans Instrum Meas, 70, 1–13.

[6]

Cao, S. Y., Liu, Y. H., Li, X. Z., 2017. Vehicle target detection based on Fast R-CNN. Chinese Journal of Image Graphics, 22, 671–677.

[7]
Chen, K. H., Shou, T. D., Li, J. K. H., Tsai, C. M., 2018. Vehicles detection on expressway via deep learning: Single shot multibox object detector. In: 2018 International Conference on Machine Learning and Cybernetics (ICMLC), 467–473.
[8]
Chen, S., Lin, W., 2019. Embedded system real-time vehicle detection based on improved YOLO network. In: 2019 IEEE 3rd advanced information management, communicates, electronic and automation control conference (IMCEC), 1400–1403.
[9]
Choi, J., Chun, D., Kim, H., Lee, H. J., 2019. Gaussian YOLOv3: An accurate and fast object detector using localization uncertainty for autonomous driving. In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), 502–511.
[10]
Cireşan, D. C., Meier, U., Masci, J., Gambardella, L. M., Schmidhuber, J., 2011. High-performance neural networks for visual object classification. https://doi.org/10.48550/arXiv.1102.0183
[11]
Dalal, N., Triggs, B., 2005. Histograms of oriented gradients for human detection. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), 886–893.
[12]
Dean, T., Ruzon, M. A., Segal, M., Shlens, J., Vijayanarasimhan, S., Yagnik, J., 2013. Fast, accurate detection of 100, 000 object classes on a single machine. In: Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition, 1814–1821.
[13]

Dimitrakopoulos, G., Demestichas, P., 2010. Intelligent transportation systems. IEEE Veh Technol Mag, 5, 77–84.

[14]
Do, T. H., Tran, D. K., Hoang, D. Q., Vuong, D., Hoang, T. M., Dao, N. N., et al., 2021. A novel algorithm for estimating fast-moving vehicle speed in intelligent transport systems. In: 2021 International Conference on Information Networking (ICOIN), 499–503.
[15]

Du, S., Zhang, P., Zhang, B., Xu, H., 2021. Weak and occluded vehicle detection in complex infrared environment based on improved YOLOv4. IEEE Access, 9, 25671–25680.

[16]
Felzenszwalb, P., McAllester, D., Ramanan, D., 2008. A discriminatively trained, multiscale, deformable part model. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition, 1–8.
[17]

Felzenszwalb, P. F., Girshick, R. B., McAllester, D., Ramanan, D., 2010. Object detection with discriminatively trained part-based models. IEEE Trans Pattern Anal Mach Intell, 32, 1627–1645.

[18]
Fu, C. Y., Liu, W., Ranga, A., Tyagi, A., Berg, A. C., 2017. DSSD: Deconvolutional single shot detector. https://doi.org/10.48550/arXiv.1701.06659
[19]
Girshick, R., Donahue, J., Darrell, T., Malik, J., 2014. Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, 580–587.
[20]
Girshick, R., 2015. Fast R-CNN. In: 2015 IEEE International Conference on Computer Vision (ICCV), 1440–1448.
[21]

Girshick, R., Donahue, J., Darrell, T., Malik, J., 2016. Region-based convolutional networks for accurate object detection and segmentation. IEEE Trans Pattern Anal Mach Intell, 38, 142–158.

[22]
Gu, Y., Wang, B., Xu, B., 2018. A FPN-based framework for vehicle detection in aerial images. In: Proceedings of the 2018 2nd International Conference on Video and Image Processing, 60–64.
[23]

Guo, M., Xue, D., Li, P., Xu, H., 2020. Vehicle pedestrian detection method based on spatial pyramid pooling and attention mechanism. Information, 11, 583.

[24]
He, K., Gkioxari, G., Dollar, P., Girshick, R., 2017. Mask R-CNN. In: 2017 IEEE International Conference on Computer Vision (ICCV), 2961–2969.
[25]

He, K., Zhang, X., Ren, S., Sun, J., 2015. Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans Pattern Anal Mach Intell, 37, 1904–1916.

[26]
He, K., Zhang, X., Ren, S., Sun, J., 2016. Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 770–778.
[27]
Hsu, S. C., Huang, C. L., Chuang, C. H., 2018. Vehicle detection using simplified fast R-CNN. In: 2018 International Workshop on Advanced Image Technology (IWAIT), 1–3.
[28]
Hu, X., Wei, Z., Zhou, W., 2021. A video streaming vehicle detection algorithm based on YOLOv4. In: 2021 IEEE 5th Advanced Information Technology, Electronic and Automation Control Conference (IAEAC), 2081–2086.
[29]
Huo, Z., Xia, Y., Zhang, B., 2016. Vehicle type classification and attribute prediction using multi-task RCNN. In: 2016 9th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), 564–569.
[30]
Ioffe, S., Szegedy, C., 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In: Proceedings of the 32nd International Conference on Machine Learning, 448–456.
[31]
Jeong, J., Park, H. Kwak, N., 2017. Enhancement of SSD by concatenating feature maps for object detection. https://doi.org/10.48550/arXiv.1705.09587.
[32]
Kang, P. P., Yu, F. Q., Chen, Y., 2016. Improvement of deformable part model and its application in vehicle detection. Computer Engineering and Applications, 52, 209–213. (in Chinese)
[33]
Kitvimonrat, A., Watcharabutsarakham, S., 2021. Vehicle Manufacturer Recognition (VMR) using SSD model. In: 2021 18th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON), 724–727.
[34]

Krizhevsky, A., Sutskever, I., Hinton, G. E., 2017. ImageNet classification with deep convolutional neural networks. Commun ACM, 60, 84–90.

[35]
Law, H., Teng, Y., Russakovsky, O., Deng, J., 2019. CornerNet-lite: Efficient keypoint based object detection. https://doi.org/10.48550/arXiv.1904.08900
[36]
Leon, L. C., Hirata Jr, R., 2012. Vehicle detection using mixture of deformable parts models: Static and dynamic camera. In: 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images, 237–244.
[37]

LeCun, Y., Bottou, L., Bengio, Y., Haffner, P., 1998. Gradient-based learning applied to document recognition. Proc IEEE, 86, 2278–2324.

[38]

Li, G. J., Hu, J., Ai, J. Y., 2022. Vehicle detection based on improved SSD algorithm. Computer Engineering, 48, 266–274.

[39]
Li, H., Yuan, J., Liu, H., Cao, L., Chen, J., Zhang, Z., 2020. Incremental learning of infrared vehicle detection method based on SSD. In: 2020 IEEE 20th International Conference on Communication Technology (ICCT), 1423–1426.
[40]
Li, Z., Zhou, F., 2017. FSSD: Feature fusion single shot multibox detector. https://doi.org/10.48550/arXiv.1712.00960
[41]

Liang, L.M., Xiong, W., Lan, Z.M., 2021a. Improved CornerNet-Saccade algorithm for vehicle detection. J Chongqing Univ Technol, 35, 137–146. (in Chinese)

[42]

Liang, L.M., Xiong, W., Peng, R.J., 2021b. Center-based algorithm for multi-class vehicle detection. Sci Technol Eng, 21, 2767–2772.

[43]

Lim, Q., Lim, Y., Muhammad, H., Tan, D. W. M., Tan, U. X., 2021. Forward collision warning system for motorcyclist using smart phone sensors based on time-to-collision and trajectory prediction. J Intell Connect Veh, 4, 93–103.

[44]
Lin, M., Chen, Q., Yan, S., 2013. Network in network. https://doi.org/10.48550/arXiv.1312.4400
[45]
Lin, T. Y., Dollar, P., Girshick, R., He, K., Hariharan, B., Belongie, S., 2017. Feature pyramid networks for object detection. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2117–2125.
[46]
Lin, T. Y., Goyal, P., Girshick, R., He, K., Dollar, P., 2017. Focal loss for dense object detection. In: 2017 IEEE International Conference on Computer Vision (ICCV), 2999–3007.
[47]

Liu G., Zheng Y. L., Zhao M. R., 2020. Vehicle information detection based on improved RetinaNet. J Comput Appl, 40, 854–858.

[48]

Liu, K., He, J.J., Zhang, Y.P., 2019. Improved YOLO vehicle detection algorithm. Modern Electronics Technique, 42, 47–50.

[49]
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C. Y., et al., 2016. SSD: single shot MultiBox detector. In: European Conference on Computer Vision, 21–37.
[50]
Lowe, D. G., 1999. Object recognition from local scale-invariant features. In: Proceedings of the seventh IEEE international conference on computer vision, 1150–1157.
[51]

Meher, S. K., Murty, M. N., 2013. Efficient method of moving shadow detection and vehicle classification. AEU Int J Electron Commun, 67, 665–670.

[52]
Murugan, V., R, V. V., Nidhila, A., 2019. A deep learning RCNN approach for vehicle recognition in traffic surveillance system. In: 2019 International Conference on Communication and Signal Processing (ICCSP), 157–160.
[53]

Negri, P., Clady, X., Hanif, S. M., Prevost, L., 2008. A cascade of boosted generative and discriminative classifiers for vehicle detection. Eurasip J Adv Signal Process, 2008, 136.

[54]
Piao, Z., Zhao, B., Tang, L., Tang, W., Zhou, S., Jing, D., 2019. VDetor: an effective and efficient neural network for vehicle detection in aerial image. In: 2019 IEEE International Conference on Signal, Information and Data Processing (ICSIDP), 1–4.
[55]

Qiao, Y.T., Chen, W.P., Zhang, T.A., 2020. Lightweight vehicle detection network based on SSD. Radio Engineering, 50, 926–931.

[56]
Rahman, Z., Ami, A. M., Ullah, M. A., 2020. A real-time wrong-way vehicle detection based on YOLO and centroid tracking. In: 2020 IEEE Region 10 Symposium (TENSYMP), 916–920.
[57]
Redmon, J., Divvala, S., Girshick, R., Farhadi, A., 2016. You only look once: Unified, real-time object detection. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 779–788.
[58]
Redmon, J., Farhadi, A., 2017. YOLO9000: better, faster, stronger. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 7263–7271.
[59]
Raj, M., Chandan, S., 2018. Pedestrian and vehicle detection using night-vision camera through CNN on Indian Roads. In: 2018 International Conference on Advances in Computing, Communication Control and Networking (ICACCCN), 1136–1142.
[60]
Redmon, J., Farhadi, A., 2018. YOLOv3: An incremental improvement. In: IEEE Conference on Computer Vision and Pattern Recognition, 89–95.
[61]
Ren, Q., Geng, J., Li, J., 2018. Slighter Faster R-CNN for real-time detection of steel strip surface defects. In: 2018 Chinese Automation Congress (CAC), 2173–2178.
[62]

Ren, S., He, K., Girshick, R., Sun, J., 2017. Faster R-CNN: Towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell, 39, 1137–1149.

[63]

Rong, L., Gao, Q., Li, X., Lu, Y., Sun, D., 2021. Target detection algorithm based on RefineDet network and attention mechanism. Sens Micro Syst, 40, 130–133.

[64]
Saini, P., Bidhan, K., Malhotra, S., 2019. A detection system for stolen vehicles using vehicle attributes with deep learning. In: 2019 5th International Conference on Signal Processing, Computing and Control (ISPCC), 251–254.
[65]
Shen, Z., Liu, Z., Li, J., Jiang, Y. G., Chen, Y., Xue, X., 2017. DSOD: learning deeply supervised object detectors from scratch. In: 2017 IEEE International Conference on Computer Vision (ICCV), 1919–1927.
[66]

Shi, B., Li, X., Nie, T., Zhang, K., Wang, W., 2021. Multi-object recognition method based on improved YOLOv2 model. Inf Technol Contr, 50, 13–27.

[67]
Simonyan, K., Zisserman, A., 2014. Very deep convolutional networks for large-scale image recognition. https://doi.org/10.48550/arXiv.1409.1556
[68]
Sindhu, V. S., 2021. Vehicle identification from traffic video surveillance using YOLOv4. In: 2021 5th International Conference on Intelligent Computing and Control Systems (ICICCS), 1768–1775.
[69]

Song, H.H., Hui, F., Jing, S.C., 2019. Improved RetinaNet model for vehicle target detection. Comput Eng Appl, 55, 225–230.

[70]

Song, H.S., Zhang, X.Q., Zheng, B.F., Yan, T., 2018. Vehicle target detection in complex scenes based on deep learning method. Comput Appl Res, 35, 1270–1273.

[71]

Song, S.Q., Li, X., Zhu, X.F., 2021. Urban road vehicle detection method by aerial photography based on improved SSD. Transduc Miscrosyst Technol, 40, 114–117.

[72]
Sun, X., Huang, Q., Li, Y., Huang, Y., 2019. An improved vehicle detection algorithm based on YOLOV3. In: 2019 IEEE Intl Conf on Parallel & Distributed Processing with Applications, Big Data & Cloud Computing, Sustainable Computing & Communications, Social Computing & Networking (ISPA/BDCloud/SocialCom/SustainCom), 1445–1450.
[73]
Szegedy, C., Ioffe, S., Vanhoucke, V., Alemi, A. A., 2017. Inception-v4, inception-ResNet and the impact of residual connections on learning. In: Proceedings of the 31st AAAI Conference on Artificial Intelligence, 4278–4284.
[74]
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., et al., 2015. Going deeper with convolutions. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 1–9.
[75]
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z., 2016. Rethinking the inception architecture for computer vision. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2818–2826.
[76]

Tayara, H., Chong, K. T., 2018. Object detection in very high-resolution aerial images using one-stage densely connected feature pyramid network. Sensors, 18, 3341.

[77]
Tian, Z., Jin, Y., Cao, H., Wang, F., Chen, C., He, X., 2020. Real-time vehicle detection under complex road conditions. In: 2020 2nd International Conference on Industrial Artificial Intelligence (IAI), 1–4.
[78]

Uijlings, J. R., Sande, K. E., Gevers, T., Smeulders, A. W., 2013. Selective search for object recognition. Int J Comput Vis, 104, 154–171.

[79]
Viola, P., Jones, M., 2001. Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1–9.
[80]
Wang, C., Wang, H., Yu, F., Xia, W., 2021. A high-precision fast smoky vehicle detection method based on improved Yolov5 network. In: 2021 IEEE International Conference on Artificial Intelligence and Industrial Design (AIID), 255–259.
[81]

Wang, C., Zhou, Y., Li, J., 2022. Lightweight Yolov4 target detection algorithm fused with ECA mechanism. Processes, 10, 1285.

[82]

Wang, H., Yu, Y., Cai, Y., Chen, X., Chen, L., Li, Y., 2021. Soft-weighted-average ensemble vehicle detection method based on single-stage and two-stage deep learning models. IEEE Trans Intell Veh, 6, 100–109.

[83]
Wang, Z., Li, L., Li, L., Pi, J., Li, S., Zhou, Y., 2020. Object detection algorithm based on improved Yolov3-tiny network in traffic scenes. In: 2020 4th CAA International Conference on Vehicular Control and Intelligence (CVCI), 514–518.
[84]

Wei, W., Yang, R., Song, Y., 2021. Target detection of improved CenterNet to remote sensing images. Computer Engineering and Applications, 57, 191–199.

[85]

Xiao, D., Shan, F., Li, Z., Le, B. T., Liu, X., Li, X., 2019. A target detection model based on improved tiny-Yolov3 under the environment of mining truck. IEEE Access, 7, 123757–123764.

[86]

Xia, J.Z., Peng, H., Tang, J.F., 2021. Improved YOLOv4’s dense remote sensing target detection. Comput Eng Appl, 57, 247–256.

[87]

Xiong, T., Debrunner, C., 2004. Stochastic car tracking with line- and color-based features. IEEE Trans Intell Transport Syst, 5, 324–328.

[88]

Xu, C., Wang, G., Yan, S., Yu, J., Zhang, B., Dai, S., et al., 2020. Fast vehicle and pedestrian detection using improved mask R-CNN. Math Probl Eng, 2020, 1–15.

[89]

Xu, H., Yang, D.G., Jiang, Q.Q., 2022. Improvement of lightweight vehicle detection network based on SSD. Comput Eng Appl, 58, 209–217.

[90]
Xu, C., Ye, Q., Liu, J., Li, L., 2020. Research on vehicle detection based on YOLOv3. In: 2020 2nd International Conference on Information Technology and Computer Application (ITCA), 433–436.
[91]

Xu, Y., Yu, G., Wu, X., Wang, Y., Ma, Y., 2017. An enhanced viola-jones vehicle detection method from unmanned aerial vehicles imagery. IEEE Trans Intell Transp Syst, 18, 1845–1856.

[92]
Yonetsu, S., Iwamoto, Y., Chen, Y. W., 2019. Two-stage YOLOv2 for accurate license-plate detection in complex scenes. In: 2019 IEEE International Conference on Consumer Electronics (ICCE), 1–4.
[93]

Yang, Y.H., Zhong, B.J., Xu, Y.L., 2022. Application of improved SSD algorithm in intelligent transportation. Telecommun Eng, 62, 259-265. (in Chinese)

[94]

Yi, S., Zhou, S., Shen, L., 2021. Vehicle-based thermal imaging target detection method based on enhanced lightweight network. Infrared Technol, 43, 237–245.

[95]

Zhang, B.L., Qin, H.R., Jiang, S., 2021. A method of vehicle detection at night based on RetinaNet and optimized loss functions. Automot Eng, 43, 1195–1202.

[96]

Zhang, C.B., Tong, B.H., Cheng, J., 2020. Improved Yolo_v2 illegal vehicle detection method. Comput Eng Appl, 56, 104–110.

[97]
Zhang, S., Wen, L., Bian, X., Lei, Z., Li, S. Z., 2018. Single-shot refinement neural network for object detection. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 4203–4212.
[98]

Zheng, X., Huang, B., Ni, D., Xu, Q., 2018. A novel intelligent vehicle risk assessment method combined with multi-sensor fusion in dense traffic environment. J Intell Connect Veh, 1, 41–54.

[99]
Zhou, X. Y., Wang, D., Krahenbuhl, P., 2019. Objects as points. https://doi.org/10.48550/arXiv.1904.07850
[100]

Zhu, M.T., Xing, H., Fang, R.H., 2020. Vehicle detection based on YOLO-TridentNet. Journal of Chongqing University of Technology(Natural Science), 34, 1–8. (in Chinese)

[101]
Zhu, Q., Yeh, M. C., Cheng, K. T., Avidan, S., 2006. Fast human detection using a cascade of histograms of oriented gradients. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Volume 2 (CVPR’06), 1491–1498.
Journal of Intelligent and Connected Vehicles
Pages 1-18
Cite this article:
Ma C, Xue F. A review of vehicle detection methods based on computer vision. Journal of Intelligent and Connected Vehicles, 2024, 7(1): 1-18. https://doi.org/10.26599/JICV.2023.9210019

376

Views

93

Downloads

1

Crossref

0

Scopus

Altmetrics

Received: 11 June 2023
Revised: 01 August 2023
Accepted: 12 September 2023
Published: 31 March 2024
© The author(s) 2024.

This is an open access article under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).

Return