The paper aims to solve the problem of personnel intrusion identification within the limits of high-speed railways. It adopts the fusion method of millimeter wave radar and camera to improve the accuracy of object recognition in dark and harsh weather conditions.
This paper adopts the fusion strategy of radar and camera linkage to achieve focus amplification of long-distance targets and solves the problem of low illumination by laser light filling of the focus point. In order to improve the recognition effect, this paper adopts the YOLOv8 algorithm for multi-scale target recognition. In addition, for the image distortion caused by bad weather, this paper proposes a linkage and tracking fusion strategy to output the correct alarm results.
Simulated intrusion tests show that the proposed method can effectively detect human intrusion within 0–200 m during the day and night in sunny weather and can achieve more than 80% recognition accuracy for extreme severe weather conditions.
(1) The authors propose a personnel intrusion monitoring scheme based on the fusion of millimeter wave radar and camera, achieving all-weather intrusion monitoring; (2) The authors propose a new multi-level fusion algorithm based on linkage and tracking to achieve intrusion target monitoring under adverse weather conditions; (3) The authors have conducted a large number of innovative simulation experiments to verify the effectiveness of the method proposed in this article.
Han, X., Wang, H., Lu, J., & Zhao, C. (2017). Road detection based on the fusion of Lidar and image data. International Journal of Advanced Robotic Systems, 14(6), 172988141773810. doi: 10.1177/1729881417738102.
Liu, Y., & Liu, Y. (2021). A data fusion model for Millimeter-Wave radar and vision sensor in advanced driving assistance system. International Journal of Automotive Technology, 22(6), 1695–1709. doi: 10.1007/s12239-021-0146-8.
Wang, Z., Yu, G., Wu, X., Li, H., & Li, D. (2021). A camera and LiDAR data fusion method for railway object detection. IEEE Sensors Journal, 21(12), 13442–13454. doi: 10.1109/jsen.2021.3066714.
Wei, Z., Zhang, F., Chang, S., Liu, Y., Wu, H., & Feng, Z. (2022). MMWave radar and vision fusion for object detection in autonomous driving: A review. Sensors, 22(7), 2542. doi: 10.3390/s22072542.
Yao, T., Wang, C., & Qian, Y. (2021). Camera-radar fusion sensing system based on multi-layer perceptron. Journal of Shanghai Jiaotong University (Science), 26(5), 561–568. doi: 10.1007/s12204-021-2345-x.
Zhang, X., Zhou, M., Qiu, P., Huang, Y., & Li, J. (2019). Radar and vision fusion for the real-time obstacle detection and identification. Industrial Robot, 46(3), 391–395. doi: 10.1108/ir-06-2018-0113.