PDF (3.3 MB)
Collect
Submit Manuscript
Show Outline
Outline
Abstract
Keywords
References
Show full outline
Hide outline
Research paper | Open Access

Human intrusion detection for high-speed railway perimeter under all-weather condition

Pengyue Guo1()Tianyun Shi1Zhen Ma1Jing Wang2
Institute of Electronic Computing Technology, China Academy of Railway Sciences Corporation Limited, Beijing, China
School of Information and Electronics, Beijing Institute of Technology, Beijing, China
Show Author Information

Abstract

Purpose

The paper aims to solve the problem of personnel intrusion identification within the limits of high-speed railways. It adopts the fusion method of millimeter wave radar and camera to improve the accuracy of object recognition in dark and harsh weather conditions.

Design/methodology/approach

This paper adopts the fusion strategy of radar and camera linkage to achieve focus amplification of long-distance targets and solves the problem of low illumination by laser light filling of the focus point. In order to improve the recognition effect, this paper adopts the YOLOv8 algorithm for multi-scale target recognition. In addition, for the image distortion caused by bad weather, this paper proposes a linkage and tracking fusion strategy to output the correct alarm results.

Findings

Simulated intrusion tests show that the proposed method can effectively detect human intrusion within 0–200 m during the day and night in sunny weather and can achieve more than 80% recognition accuracy for extreme severe weather conditions.

Originality/value

(1) The authors propose a personnel intrusion monitoring scheme based on the fusion of millimeter wave radar and camera, achieving all-weather intrusion monitoring; (2) The authors propose a new multi-level fusion algorithm based on linkage and tracking to achieve intrusion target monitoring under adverse weather conditions; (3) The authors have conducted a large number of innovative simulation experiments to verify the effectiveness of the method proposed in this article.

References

 
China National Railway Group Co., LTD. (2015). High speed railway perimeter intrusion alarm system general technical scheme (interim) (TJ/QT003-2015).
 
Chen, X., Zhang, T., Wang, Y., Wang, Y., & Zhao, H. (2023). FUTR3D: A unified sensor fusion framework for 3D detection. In 2023 IEEE/CVf conference on computer vision and pattern recognition workshops (CVPRW) (pp. 172–181). Vancouver, BC: IEEE.
 
Dillon, R., Jordan, K., Jacqueline, H., & Ahmad, D. (2023). Real-time flying object detection with YOLOv8. doi: 10.48550/arXiv.2305.09972.
 
European Union Agency for Railways (2022). Retrieved from Report on railway safety and interoperability in the EU. Available from: https://www.era.europa.eu/library/corporate-publications_en
 
Garcia-Dominguez, J., Urena-Urena, J., Hernandez-Alonso, A., Mazo-Quintas, M., Vazquez, J., & Jesus Diaz, M. (2008), Multi-sensory system for obstacle detection on railways. In 2008 IEEE instrumentation and measurement technology conference, (pp. 2091–2096), Victoria, BC: IEEE.
 
Hachiga, A. (1993). The concepts and technologies of dependable and real-time computer systems for Shinkansen train control. In Dependable Computing and Fault-Tolerant Systems (pp. 225–252). Vienna: Springer.
 

Han, X., Wang, H., Lu, J., & Zhao, C. (2017). Road detection based on the fusion of Lidar and image data. International Journal of Advanced Robotic Systems, 14(6), 172988141773810. doi: 10.1177/1729881417738102.

 

Liu, Y., & Liu, Y. (2021). A data fusion model for Millimeter-Wave radar and vision sensor in advanced driving assistance system. International Journal of Automotive Technology, 22(6), 1695–1709. doi: 10.1007/s12239-021-0146-8.

 
Lukas, S., Philipp, H., Jason, R., & Didier, S. (2022). Fusion point pruning for optimized 2D object detection with radar-camera fusion. In 2022 IEEE/CVF winter conference on applications of computer vision (WACV) (pp. 1275–1282). Waikoloa, HI: IEEE.
 
Mockel, S., Scherer, F., & Schuster, P. (2003). Multi-sensor obstacle detection on railway tracks. In IEEE IV2003 intelligent vehicles symposium. Proceedings (Cat. No.03TH8683) (pp. 42–46). IEEE.
 
Measures for the Administration of High-speed Railway Safety Protection (2020). Beijing: Ministry of Transport of the People’s Republic of China.
 
Shuai, X., Shen, Y., Tang, Y., Shi, S., Ji, L., & Xing, G. (2021). Millieye: A lightweight mmwave radar and camera fusion system for robust object detection. In Proceedings of the international conference on internet-of-things design and implementation (pp. 145–157). Charlottesvle, VA: Association for Computing Machinery.
 
Wang, Z., & Jia, K. (2019). Frustum ConvNet: Sliding frustums to aggregate local point-wise features for amodal 3D object detection. In 2019 IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 1742–1749). Macau.
 

Wang, Z., Yu, G., Wu, X., Li, H., & Li, D. (2021). A camera and LiDAR data fusion method for railway object detection. IEEE Sensors Journal, 21(12), 13442–13454. doi: 10.1109/jsen.2021.3066714.

 

Wei, Z., Zhang, F., Chang, S., Liu, Y., Wu, H., & Feng, Z. (2022). MMWave radar and vision fusion for object detection in autonomous driving: A review. Sensors, 22(7), 2542. doi: 10.3390/s22072542.

 

Yao, T., Wang, C., & Qian, Y. (2021). Camera-radar fusion sensing system based on multi-layer perceptron. Journal of Shanghai Jiaotong University (Science), 26(5), 561–568. doi: 10.1007/s12204-021-2345-x.

 

Zhang, X., Zhou, M., Qiu, P., Huang, Y., & Li, J. (2019). Radar and vision fusion for the real-time obstacle detection and identification. Industrial Robot, 46(3), 391–395. doi: 10.1108/ir-06-2018-0113.

Railway Sciences
Pages 97-110
Cite this article:
Guo P, Shi T, Ma Z, et al. Human intrusion detection for high-speed railway perimeter under all-weather condition. Railway Sciences, 2024, 3(1): 97-110. https://doi.org/10.1108/RS-11-2023-0043
Metrics & Citations  
Article History
Copyright
Rights and Permissions
Return