Skip to main content

Advertisement

SpringerLink
Log in

Fire Detection and Spatial Localization Approach for Autonomous Suppression Systems Based on Artificial Intelligence

  • Manuscript
  • Published:
Fire Technology Aims and scope Submit manuscript

Abstract

The development of autonomous fire suppression systems is widely studied these days to ensure human safety during fire disasters. The evolution in convolutional neural networks (CNNs) has placed substantial emphasis on fire detection through images. Compared to other image processing methods, CNN architectures have proved their efficiency in very accurately detecting fires. However, delayed detection and computational complexity due to manual feature extraction are still concerns for researchers. Therefore, in this research, an autonomous 3D fire location prediction system is presented using YOLOv4 as a fire detector and a self-stereo vision camera setup to locate the position of the fire in real-world coordinates. The single-stage strategy of YOLOv4 has exceptionally increased the detection speed. The results show that YOLOv4 has achieved the fastest ever speed of 30 frames per second in very accurately detecting fires. Obtained by the YOLOv4 model, the pixel coordinates from the center of the bottom line of the bounding boxes around a fire are used in a self-stereo vision camera system to predict the 3D real-world coordinates of the source fire. The study reveals that the proposed system is economical and sufficiently efficient to be used as an early fire detector and location predictor in common surveillance systems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11

Similar content being viewed by others

References

  1. Muhammad K, Ahmad J, Baik SW (2018) Early fire detection using convolutional neural networks during surveillance for effective disaster management. Neurocomputing 288:30–42. https://doi.org/10.1016/j.neucom.2017.04.083

    Article  Google Scholar 

  2. Muhammad K, Ahmad J, Lv Z, Bellavista P, Yang P, Baik SW (2019) Efficient deep CNN-based fire detection and localization in video surveillance applications. IEEE Trans Syst Man Cybern Syst 49(7):1419–1434. https://doi.org/10.1109/TSMC.2018.2830099

    Article  Google Scholar 

  3. Chen TH, Wu PH, Chiou YC (2004) An early fire-detection method based on image processing. Proc Int Conf Image Process ICIP 3:1707–1710. https://doi.org/10.1109/ICIP.2004.1421401

    Article  Google Scholar 

  4. Guo BHW, Zou Y, Fang Y, Goh YM, Zou PXW (2021) Computer vision technologies for safety science and management in construction: a critical review and future research directions. Saf Sci 135:105130. https://doi.org/10.1016/j.ssci.2020.105130

    Article  Google Scholar 

  5. Pustokhina IV, Pustokhin DA, Vaiyapuri T, Gupta D, Kumar S, Shankar K (2021) An automated deep learning based anomaly detection in pedestrian walkways for vulnerable road users safety. Saf Sci 142:105356. https://doi.org/10.1016/j.ssci.2021.105356

    Article  Google Scholar 

  6. Chen Z, Chen D, Zhang Y, Cheng X, Zhang M, Wu C (2020) Deep learning for autonomous ship-oriented small ship detection. Saf Sci 130:104812. https://doi.org/10.1016/j.ssci.2020.104812

    Article  Google Scholar 

  7. Garrity DJ, Yusuf SA (2019) A predictive decision-aid device to warn firefighters of catastrophic temperature increases using an AI-based time-series algorithm. Saf Sci 138:105237. https://doi.org/10.1016/j.ssci.2021.105237

    Article  Google Scholar 

  8. Foggia P, Saggese A, Vento M (2015) Real-time fire detection for video-surveillance applications using a combination of experts based on color, shape, and motion. IEEE Trans Circuits Syst Video Technol 25(9):1545–1556. https://doi.org/10.1109/TCSVT.2015.2392531

    Article  Google Scholar 

  9. Marbach G, Loepfe M, Brupbacher T (2006) An image processing technique for fire detection in video images. Fire Saf J 41(4):285–289. https://doi.org/10.1016/j.firesaf.2006.02.001

    Article  Google Scholar 

  10. Töreyin BU, Dedeoğlu Y, Güdükbay U, Çetin AE (2006) Computer vision based method for real-time fire and flame detection. Pattern Recognit Lett 27(1):49–58. https://doi.org/10.1016/j.patrec.2005.06.015

    Article  Google Scholar 

  11. Çelik T, Demirel H (2009) Fire detection in video sequences using a generic color model. Fire Saf J 44(2):147–158. https://doi.org/10.1016/j.firesaf.2008.05.005

    Article  Google Scholar 

  12. Qiu T, Yan Y, Lu G (2012) An autoadaptive edge-detection algorithm for flame and fire image processing. IEEE Trans Instrum Meas 61(5):1486–1493. https://doi.org/10.1109/TIM.2011.2175833

    Article  Google Scholar 

  13. Toulouse T, Rossi L, Akhloufi M, Celik T, Maldague X (2015) Benchmarking of wildland fire colour segmentation algorithms. IET Image Process 9(12):1064–1072. https://doi.org/10.1049/iet-ipr.2014.0935

    Article  Google Scholar 

  14. Jadon A, Omama M, Varshney A, Ansari MS, Sharma S (2019) FireNet: a specialized lightweight fire & smoke detection model for real-time IoT applications. http://arxiv.org/abs/1905.11922.

  15. Liu YH (2018) “Feature extraction and image recognition with convolutional neural networks.” J Phys Conf Ser. https://doi.org/10.1088/1742-6596/1087/6/062032

    Article  Google Scholar 

  16. Muhammad K, Ahmad J, Mehmood I, Rho S, Baik SW (2018) Convolutional neural networks based fire detection in surveillance videos. IEEE Access 6:18174–18183. https://doi.org/10.1109/ACCESS.2018.2812835

    Article  Google Scholar 

  17. Li P, Zhao W (2020) Image fire detection algorithms based on convolutional neural networks. Case Stud Therm Eng. https://doi.org/10.1016/j.csite.2020.100625

    Article  Google Scholar 

  18. Saponara S, Elhanashi A, Gagliardi A (2020) Real-time video fire/smoke detection based on CNN in antifire surveillance systems. J Real-Time Image Process. https://doi.org/10.1007/s11554-020-01044-0

    Article  Google Scholar 

  19. Kang LW, Wang IS, Chou KL, Chen SY, Chang YS (2019) “Image-based real-time fire detection using deep learning with data augmentation for vision-based surveillance applications,” 2019 16th IEEE International Conference on Advance Video Signal Based Surveillance, AVSS 2019, pp. 1–4, 2019. https://doi.org/10.1109/AVSS.2019.8909899.

  20. Wu Z, Xue R, Li H (2022) Real-time video fire detection via modified YOLOv5 network model. Fire Technol 58:1–27

    Article  Google Scholar 

  21. Ge Q, Wen C, Duan S (2014) Fire localization based on range-range-range model for limited interior space. IEEE Trans Instrum and Meas 63(9):2223–2237

    Article  Google Scholar 

  22. Wang G, Feng X (2018) Fire source range localization based on the dynamic optimization method for large-space buildings. Sensors. https://doi.org/10.3390/s18061954

    Article  Google Scholar 

  23. Islam T, Rahman HA, and Syrus MA, “using ZigBee based Wireless Sensor Network 2015,”. https://ieeexplore.ieee.org/document/7334000.

  24. Yuan F (2010) An integrated fire detection and suppression system based on widely available video surveillance. Mach Vis Appl 21(6):941–948. https://doi.org/10.1007/s00138-010-0276-x

    Article  Google Scholar 

  25. Ramasubramanian S, Muthukumaraswamy SA, Sasikala A (2020) Fire detection using artificial intelligence for fire-fighting robots. Proc Int Conf Intell Comput Control Syst. https://doi.org/10.1109/ICICCS48265.2020.9121017

    Article  Google Scholar 

  26. Mcneil JG, Starr J, Lattimer BY, (2013) Overview, “autonomous fire suppression using multispectral sensors” pp. 1504–1509.

  27. Pittman W, McNay J (2021) Applying intelligent visual flame detection in military aircraft hangars. https://www.aviationpros.com/airports/buildings-maintenance/hangar-hangar-doors/blog/21140728/applying-intelligent-visual-flame-detection-in-military-aircraft-hangars. Accessed 1 June 2023

  28. Bochkovskiy A, Wang CY, and Liao HYM, “YOLOv4: optimal speed and accuracy of object detection,” arXiv, 2020.

  29. Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit 779–788:2016. https://doi.org/10.1109/CVPR.2016.91

    Article  Google Scholar 

  30. Wang CY, Mark Liao HY, Wu YH, Chen PY, Hsieh JW, Yeh IH (2020) “CSPNet: a new backbone that can enhance learning capability of CNN.” IEEE Comput Soc Conf Comput Vis Pattern Recognit Work 2020:1571–1580. https://doi.org/10.1109/CVPRW50498.2020.00203

    Article  Google Scholar 

  31. Redmon J and Farhadi A (2018) “YOLOv3: An incremental improvement,” arXiv.

  32. He K, Zhang X, Ren S, Sun J (2014) Spatial pyramid pooling in deep convolutional networks for visual recognition. Lect Notes Comput Sci (including Subser Lect Notes Artif Intell Lect Notes Bioinformatics) 8691(3):346–361. https://doi.org/10.1007/978-3-319-10578-9_23

    Article  Google Scholar 

  33. Liu S, Qi L, Qin H, Shi J, Jia J (2018) Path aggregation network for instance segmentation. Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit. https://doi.org/10.1109/CVPR.2018.00913

    Article  Google Scholar 

  34. Hartley R, Zisserman A (2004) Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge

    Book  MATH  Google Scholar 

  35. Zhang Z, Member S (2000) A flexible new technique for camera calibration æ. EEE Trans on Pattern Anal Mach Intell 22(11):1330–1334

    Article  Google Scholar 

  36. Chino DYT, Avalhais LPS, Rodrigues JF, Traina AJM (2015) BoWFire: detection of fire in still images by integrating pixel color and texture analysis. In: 2015 28th SIBGRAPI conference on graphics, patterns and images, Salvador, Brazil, pp. 95–102. https://doi.org/10.1109/SIBGRAPI.2015.19

  37. Ko BC, Cheong KH, Nam JY (2009) Fire detection based on vision sensor and support vector machines. Fire Saf J 44(3):322–329. https://doi.org/10.1016/j.firesaf.2008.07.006

    Article  Google Scholar 

  38. Ko BC, Ham SJ, Nam JY (2011) Modeling and formalization of fuzzy finite automata for detection of irregular fire flames. IEEE Trans Circuits Syst Video Technol 21(12):1903–1912. https://doi.org/10.1109/TCSVT.2011.2157190

    Article  Google Scholar 

  39. “Fire | NIST.” https://www.nist.gov/fire (Accessed 02 Mar 2021).

  40. Yin ZJ, Wan BY, Yuan FN, Xia X, Shi JT (2017) A deep normalization and convolutional neural network for image smoke detection. IEEE Access 5:18429–18438

    Article  Google Scholar 

  41. Tzutalin, LabelImg.Git code (2015). https://github.com/tzutalin/labelImg.

  42. Brahmbhatt S, (2021) “Practical OpenCV,” Practical OpenCV, 2013. https://opencv.org/practical-opencv/ (Accessed 09 Mar 2021).

  43. Spizhevoy A, Rybnikov A (2018) OpenCV 3 computer vision with Python cookbook: leverage the power of OpenCV 3 and Python to build computer vision applications. Packt publishing Ltd, Birmingham

    Google Scholar 

  44. A. Rafiee, R. Dianat, M. Jamshidi, R. Tavakoli, and S. Abbaspour, “Fire and smoke detection using wavelet analysis and disorder characteristics,” In: ICCRD2011 - 2011 3rd International Conference on Computer Research and Development, 2011, vol. 3, pp. 262–265. https://doi.org/10.1109/ICCRD.2011.5764295

  45. Habiboglu YH, Günay O, Çetin AE (2012) Covariance matrix-based fire and flame detection method in video. Mach Vis Appl 23(6):1103–1113. https://doi.org/10.1007/s00138-011-0369-1

    Article  Google Scholar 

  46. Di Lascio R, Greco A, Saggese A, Vento M (2014) Improving fire detection reliability by a combination of videoanalytics. Lect Notes Comput Sci (including Subser Lect Notes Artif Intell Lect Notes Bioinf) 8814:477–484. https://doi.org/10.1007/978-3-319-11758-4_52

    Article  MathSciNet  Google Scholar 

  47. Li P, Zhao W (2020) Image fire detection algorithms based on convolutional neural networks. Case Stud Therm Eng. https://doi.org/10.1016/j.csite.2020.100625

    Article  Google Scholar 

Download references

Funding

This research is financially supported partially by the Institute of Civil Military Technology Cooperation funded by the Defense Acquisition Program Administration and Ministry of Trade, Industry and Energy of Korean government under grant no. UM19304RD3, and by the Korea Institute of Energy Technology Evaluation and Planning(KETEP) Grant funded by the Korea government (MOTIE) (20214000000090, Fostering human resources training in advanced hydrogen energy industry).

Author information

Authors and Affiliations

  1. Department of Naval Architecture and Ocean Engineering, Chungnam National University, 99 Daehak-Ro, Yuseong-Gu, Daejeon, 34134, Republic of Korea

    Afsah Latif & Hyun Chung

Authors
  1. Afsah Latif
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hyun Chung
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hyun Chung.

Ethics declarations

Competing interests

None declared.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Latif, A., Chung, H. Fire Detection and Spatial Localization Approach for Autonomous Suppression Systems Based on Artificial Intelligence. Fire Technol 59, 2621–2644 (2023). https://doi.org/10.1007/s10694-023-01426-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10694-023-01426-3

Keywords

Search

Navigation