Е-Публикации
Технически университет - София

Abstract: For reliable autonomous train operation, detecting and classifying obstacles on or near rail tracks, and accurately estimating the distance to these obstacles, is essential. This task is more challenging in low-light conditions, common for freight trains that operate primarily at night. This paper proposes a novel method, FuzzyH, for estimating the distance between a thermal camera and detected obstacles using image-plane homography. By leveraging the homography between the image and rail track planes, and incorporating a fuzzy logic system, the method improves distance estimation accuracy and eliminates the need for complex calibration. This paper also explores the symmetry and asymmetry of fuzzy membership functions and rules. The system was validated on Serbian railways under simulated real-world conditions, demonstrating reliable performance. A key contribution of this method is the use of fuzzy membership functions tailored to specific distance ranges, based on experimental data and domain knowledge, such as regulatory braking distances. This approach improves over traditional methods by offering reliable distance estimates in low-light environments and simplifying the calibration process, ultimately enhancing system accuracy and robustness.

References

1. Song M. Stević Ž. Badi I. Marinković D. Lv Y. Zhong K. Assessing Public Acceptance of Autonomous Vehicles Using a Novel IRN Piprecia—IRN Aroman Model Facta Univ. Ser. Mech. Eng. 2024 1 20
2. Ćirić I. Pavlović M. Banić M. Simonović M. Nikolić V. AI Powered Obstacle Distance Estimation for Onboard Autonomous Train Operation Teh. Vjesn. Tech. Gaz. 2022 29 611 619 10.17559/TV-20210223081612
3. Petrović E. Ćirić I. Pavlović M. Nikolić V. Distance Estimation Model for Thermal Vision Systems Using Gaussian Process Regression Innov. Mech. Eng. 2023 2 95 103
4. Wang Z. Zhao N. Zhu P. Track Obstacle Detection and Recognition Based on Point Cloud Data Processing Proceedings of the 4th International Conference on Artificial Intelligence and Computer Engineering (ICAICE ’23) New York, NY, USA 17–19 November 2023 10.1145/3652628.3652830
5. Tang Z. Yang J. Research on Active Obstacle Detection Algorithm of Rail Train Based on Multi-Sensor Proceedings of the 2023 8th International Conference on Cloud Computing and Big Data Analytics (ICCCBDA) Chengdu, China 26–28 April 2023
6. Brucker M. Cramariuc A. Cadena C. Local and Global Information in Obstacle Detection on Railway Tracks Proceedings of the 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) Detroit, MI, USA 1–5 October 2023
7. Pavlović M. Ćirić I. Ristić-Durrant D. Nikolić V. Simonović M. Ćirić M. Banić M. Advanced Thermal Camera Based System for Object Detection on Rail Tracks Therm. Sci. 2018 22 (Suppl. S5) S1551 S1561 10.2298/TSCI18S5551P
8. Jenefa A. Ande A. Shalini T.M. Real-Time Rail Safety: A Deep Convolutional Neural Network Approach for Obstacle Detection on Tracks Proceedings of the 2023 4th International Conference on Signal Processing and Communication (ICSPC) Coimbatore, India 23–24 May 2023 101 105 10.1109/ICSPC57692.2023.10125284
9. Qin Y. He D. Jin Z. Chen Y. Shan S. An Improved Deep Learning Algorithm for Obstacle Detection in Complex Rail Transit Environments IEEE Sens. J. 2024 24 4011 4022 10.1109/JSEN.2023.3340688
10. Raza A. Chelloug S.A. Alatiyyah M.H. Jalal A. Park J. Multiple Pedestrian Detection and Tracking in Night Vision Surveillance Systems Comput. Mater. Contin. 2023 76 1 14
11. Pavlović M. Ćirić I. Simonović M. Nikolić V. Application of different methods for distance estimation Proceedings of the 1st Virtual International Conference Path to a Knowledge Society—Managing Risks and Innovation—PaKSoM 2019 Virtuell, Serbia 9–10 December 2019
12. Salman Y.D. Ku-Mahamud K.R. Kamioka E. Distance measurement for self-driving cars using stereo camera Proceedings of the 6th International Conference on Computing and Informatics, ICOCI 2017, University Utara Malaysia Kuala Lumpur, Malaysia 25–27 April 2017
13. Zaarane A. Slimani I. Al Okaishi W. Atouf I. Hamdoun A. Distance measurement system for autonomous vehicles using stereo camera Array 2020 5 100016
14. Lee S. Hayes M.H. Paik J. Distance estimation using a single computational camera with dual off-axis color filtered apertures Opt. Express 2013 21 23116 23129 10.1364/OE.21.023116
15. Rahman A. Salam A. Islam M. Sarker P. An Image Based Approach to Compute Object Distance Int. J. Comput. Intell. Syst. 2008 1 304 312
16. Deepu R. Murali S. Raju V. A Mathematical model for the determination of distance of an object in a 2D image Proceedings of the International Conference on Image Processing, Computer Vision, and Pattern Recognition (IPCV) Las Vegas, NV, USA 22–25 July 2013
17. Dong X. Zhang F. Shi P. A novel approach for face to camera distance estimation by monocular vision Int. J. Innov. Comput. Inf. Control 2014 10 659 669
18. Deng-Yuan H. Chao-Ho C. Tsong-Yi C. Wu-Chih H. Kai-Wei F. Vehicle detection and inter-vehicle distance estimation using single-lens video camera on urban/suburb roads J. Vis. Commun. Image Represent. 2017 46 250 259
19. Giseok K. Jae-Soo C. Vision-Based Vehicle Detection and Inter-Vehicle Distance Estimation for Driver Alarm System Opt. Rev. 2012 19 388 393 10.1007/s10043-012-0063-1
20. Hoi-Kok C. Wan-Chi S. Steven L. Lawrence P. Chiu-Shing N. Accurate Distance Estimation Using Camera Orientation Compensation Technique for Vehicle Driver Assistance System In Proceedings of IEEE International Conference on Consumer Electronics (ICCE) Las Vegas, NV, USA 13–16 January 2012 10.1109/ICCE.2012.6161840
21. Qi S.H. Li J. Sun Z.P. Zhang J.T. Sun Y. Distance Estimation of Monocular Based on Vehicle Pose Information J. Phys. Conf. Ser. 2019 1168 032040 10.1088/1742-6596/1168/3/032040
22. Tuohy S. O’Cualain D. Jones E. Glavin M. Distance Determination for an Automobile Environment using Inverse Perspective Mapping in OpenCV In Proceedings of IET Irish Signals and Systems Conference (ISSC 2010) Online 23–24 June 2010 10.1049/cp.2010.0495
23. Rezaei M. Terauchi M. Klette R. Robust Vehicle Detection and Distance Estimation Under Challenging Lighting Conditions IEEE Trans. Intell. Transp. Syst. 2015 16 2723 2743 10.1109/TITS.2015.2421482
24. Adamshuk R. Carvalho D. Neme J.H. Margraf E. Okida S. Tusset A. Santos M.M. Amaral R. Ventura A. Carvalho S. On the Applicability of Inverse Perspective Mapping for the Forward Distance Estimation based on the HSV Colormap In Proceedings of IEEE International Conference on Industrial Technology (ICIT) Toronto, ON, Canada 22–25 March 2017 10.1109/ICIT.2017.7915504
25. Hartley R. Zisserman A. Multiple View Geometry in Computer Vision 2nd ed. Cambridge University Press New York, NY, USA 2004 32 36
26. Luo Y. Wang X. Liao Y. Fu Q. Shu C. Wu Y. He Y. A Review of Homography Estimation: Advances and Challenges Electronics 2023 12 4977 10.3390/electronics12244977
27. Zhou H. Hu W. Li Y. He C. Chen X. Deep Homography Estimation With Feature Correlation Transformer Proceedings of the 2023 IEEE International Conference on Multimedia and Expo (ICME) Brisbane, Australia 10–14 July 2023
28. Pavlović M. Nikolić V. Simonović M. Mitrović V. Ćirić I. Edge detection parameter optimization based on the genetic algorithm for rail track detection Facta Univ. Ser. Mech. Eng. 2019 17 333 344
29. Ćirić I. Milošević M. Ivačko N. Pavlović M. Krstić D. Intelligent computer vision system for score detection in basketball Facta Univ. Ser. Autom. Control Robot. 2021 20 123 134
30. Haseeb M.A. Ristić-Durrant D. Banić M. Stamenković D. Multi-DisNet: Machine Learning-Based Object Distance Estimation from Multiple Cameras In Proceedings of 12th International Conference on Computer Vision Systems Thessaloniki, Greece 23–25 September 2019 10.1007/978-3-030-34995-0_41
31. Zadeh L.A. Fuzzy Sets Inf. Control 1965 8 338 353 10.1016/S0019-9958(65)90241-X
32. Jin Z. Wang Z. Li J. Input-to-state stability of the nonlinear fuzzy systems via small-gain theorem and decentralized sliding-mode control IEEE Trans. Fuzzy Syst. 2022 30 2993 3008 10.1109/TFUZZ.2021.3099036
33. Jin Z. Qin Z. Zhang X. Guan C. A leader-following consensus problem via a distributed observer and fuzzy input-to-output small-gain theorem IEEE Trans. Control Netw. Syst. 2022 9 62 74 10.1109/TCNS.2022.3141690
34. Mendel J. Fuzzy logic systems for engineering: A tutorial Proc. IEEE 1995 83 345 377
35. Teodorović D. Fuzzy logic systems for transportation engineering the state Transp. Res. Part A 1999 33 337 364
36. Dongre J.K. Ajay R.R. The review focuses on the Mamdani Fuzzy Inference System for decision making in Fuzzy Inference Systems Rare Met. Mater. Eng. 2023 52 17 23
37. Precup R.E. Nguyen A.T. Blažič S. A survey on fuzzy control for mechatronics applications Int. J. Syst. Sci. 2024 55 771 813 10.1080/00207721.2023.2293486
38. Zhang X. Ding Y. Zhao H. Yi L. Guo T. Li A. Zou Y. Mixed Skewness Probability Modeling and Extreme Value Predicting for Physical System Input–Output Based on Full Bayesian Generalized Maximum-Likelihood Estimation IEEE Trans. Instrum. Meas. 2023 73 2504516 10.1109/TIM.2023.3343742

Issue