Abstract
A computer vision-based integrated fire detection and automated suppression device capable of real-time functioning is proposed to enhance the fire safety. The developed multilayered algorithm considers color based clue detection and thereafter incorporates three filtration stages ‘Centroid Analysis’, ‘Histogram Analysis’ and ‘Variance Analysis’ for successful fire detection. Results from the proposed algorithm has been compared and validated against standard video datasets and was found to have an overall accuracy of 95.26% with 91.61% true positive detection rate, only 8.39% of false detection in positive fire videos and true negative rate of 98.91% with only 1.09% of false detection in negative nonfire videos. Additionally, our algorithm showed an average improvement of 7.95% in accuracy and 9.43% in precision over existing algorithms, demonstrating its sensitivity and reliability for effective fire detection and suppression. The algorithm also includes unique fire localization techniques to locate the detected fire, which was integrated with an Arduino based suppression unit to provide a real- time autonomous fire suppression. Laboratory-scale experimental validation has shown practical significance of the proposed system for any kind of personal, industrial, indoor, or outdoor environmental applications with a high precision value of 99.51% and a recall value of 95.93%.
Similar content being viewed by others
References
National Crime Records Bureau, Ministry of Home Affairs, Govt. of India (2018) Accidental deaths & suicides in India—2019. https://ncrb.gov.in/sites/default/files/ADSI-2018-FULL-REPORT-2018.pdf. Accessed 24 Mar 2021
Brushlinsky NN, Ahrens M, Sokolov SV, Wagner P (2020) World fire statistics report of center of fire statistics of CTIF 25 22
Fonollosa J, Solórzano A, Marco S (2018) Chemical sensor systems and associated algorithms for fire detection: a review. Sensors 18(2):553
Chen S-J, Hovde DC, Peterson KA, Marshall AW (2007) Fire detection using smoke and gas sensors. Fire Saf J 42(8):507–515
Lee K, Shim YS, Song YG, Han SD, Lee YS, Kang CY (2017) Highly sensitive sensors based on metal-oxide nanocolumns for fire detection. Sensors 17(2):303
Krüger S, Despinasse M-C, Raspe T, Nörthemann K, Moritz W (2017) Early fire detection: are hydrogen sensors able to detect pyrolysis of house hold materials? Fire Saf J 91:1059–1067
Liu Z, Kim AK (2003) Review of recent developments in fire detection technologies. J Fire Prot Eng 13(2):129–151
Cote AE, Powell P (2003) Fire protection handbook. 19th National Fire Protection Association, Quincy, Mass
Bu F, Gharajeh MS (2019) Intelligent and vision-based fire detection systems: A survey. Image Vis Comput 91:103803
Gaur A, Singh A, Kumar A, Kumar A, Kapoor K (2020) Video flame and smoke based fire detection algorithms: a literature review. Fire Technol 56(5):1943–1980
Khalil A, Rahman SU, Alam F, Ahmad I, Khalil I (2021) Fire detection using multi color space and background modeling. Fire Technol 57:1221–39
Kong SG, Jin D, Li S, Kim H (2016) Fast fire flame detection in surveillance video using logistic regression and temporal smoothing. Fire Saf J 79:37–43
Krüll W, Willms I, Zakrzewski RR, Sadok M, Shirer J, Zeliff B (2006) Design and test methods for a video-based cargo fire verification system for commercial aircraft. Fire Saf J 41(4):290–300
Phillips IW, Shah M, da Vitoria Lobo N (2002) Flame recognition in video. Pattern Recogn Lett 23(1–3):319–327
Chen TH, Wu PH, Chiou YC (2004) An early fire-detection method based on image processing. In: 2004 International Conference on Image Processing, 2004 ICIP'04, IEEE, vol 3, pp 1707–1710
Celik T, Demirel H, Ozkaramanli H, Uyguroglu M (2007) Fire detection using statistical color model in video sequences. J Vis Commun Image Represent 18(2):176–185
Celik T, Demirel H (2009) Fire detection in video sequences using a generic color model. Fire Saf J 44(2):147–158
Premal CE, Vinsley SS (2014) Image processing based forest fire detection using YCbCr colour model. In: 2014 International Conference on Circuits, Power and Computing Technologies [ICCPCT-2014], IEEE, pp 1229–1237
Marbach G, Loepfe M, Brupbacher T (2006) An image processing technique for fire detection in video images. Fire Saf J 41(4):285–289
Celik T (2010) Fast and efficient method for fire detection using image processing. ETRI J 32(6):881–890
Töreyin BU, Dedeoğlu Y, Güdükbay U, Cetin AE (2006) Computer vision based method for real-time fire and flame detection. Pattern Recogn Lett 27(1):49–58
Liu CB, Ahuja N (2004) Vision based fire detection. In: Proceedings of the 17th International Conference on Pattern Recognition, ICPR 2004, IEEE, vol 4, pp 134–137
Mahmoud MAI, Ren H (2018) Forest fire detection using a rule-based image processing algorithm and temporal variation. Math Probl Eng 2018:7612487. https://doi.org/10.1155/2018/7612487
Trambitckii K, Anding K, Musalimov V, Linss G (2015) Colour based fire detection method with temporal intensity variation filtration. J Phys Confer Ser 588(1):012038
Hossen MK, Chowdhury MH, Chowdhury IA (2018) Fire detection from video based on temporal variation, temporal periodicity and spatial variance analysis. Int J Eng Sci Math 7(2):359–68
Chen J, He Y, Wang J (2010) Multi-feature fusion based fast video flame detection. Build Environ 45(5):1113–1122
Patel P, Tiwari S (2012) Flame detection using image processing techniques. Int J Comput Appl 58(18):13–16. https://doi.org/10.5120/9381-3817
Yu C, Mei Z, Zhang Xi (2013) A real-time video fire flame and smoke detection algorithm. Proc Eng 62:891–898
Chi R, Zhe-Ming Lu, Ji Q-G (2017) Real-time multi-feature based fire flame detection in video. IET Image Proc 11(1):31–37
Ko BC, Cheong KH, Nam JY (2009) Fire detection based on vision sensor and support vector machines. Fire Saf J 44(3):322–9
Li Pu, Zhao W (2020) Image fire detection algorithms based on convolutional neural networks. Case Stud Thermal Eng 19:100625
Yuan C, Liu Z, Zhang Y (2019) Learning-based smoke detection for unmanned aerial vehicles applied to forest fire surveillance. J Intell Rob Syst 93(1):337–349
Muhammad K, Ahmad J, Mehmood I, Rho S, Baik SW (2018) Convolutional neural networks based fire detection in surveillance videos. IEEE Access 6:18174–83
Muhammad K, Ahmad J, Lv Z, Bellavista P, Yang P, Baik SW (2018) Efficient deep CNN-based fire detection and localization in video surveillance applications. IEEE Trans Syst Man Cybern Syst 49(7):1419–34
Çelik T, Özkaramanlı H, Demirel H (2007) Fire and smoke detection without sensors: image processing based approach. In: 2007 15th European Signal Processing Conference, IEEE, pp 1794–1798
Saeed F, Paul A, Rehman A, Hong WH, Seo H (2018) IoT-based intelligent modeling of smart home environment for fire prevention and safety. J Sensor Actuat Netw 7(1):11
Maluk C, Woodrow M, Torero JL (2017) The potential of integrating fire safety in modern building design. Fire Saf J 1(88):104–12
Sharma A, Singh PK, Kumar Y (2020) An integrated fire detection system using IoT and image processing technique for smart cities. Sustain Cities Soc 61:102332
Manjunatha KC, Mohana HS, Vijaya PA (2015) Implementation of computer vision based industrial fire safety automation by using neuro-fuzzy algorithms. Int J Inform Technol Comp Sci (IJITCS) 7(4):14–27
Yuan F (2010) An integrated fire detection and suppression system based on widely available video surveillance. Mach Vis Appl 21(6):941–948
Hu G, Li Z (2010) Design and key technology research into auto-targeting fire extinguishing system of interior large space. In: 2010 International Conference on Electrical and Control Engineering, IEEE, pp 687–690
McNeil JG, Lattimer BY (2017) Robotic fire suppression through autonomous feedback control. Fire Technol 53(3):1171–1199
Liu Z, Kim AK (1999) A review of water mist fire suppression systems—fundamental studies. J Fire Prot Eng 10(3):32–50
McBride WE (2001) Fine water mist fire protection system. In: Record of Conference Papers. IEEE incorporated Industry Applications Society. Forty-Eighth Annual Conference. 2001 Petroleum and Chemical Industry Technical Conference (Cat. No. 01CH37265), IEEE, pp 245–252
https://www.bendbulletin.com/localstate/extreme-fire-danger-in-central-oregon-forests-through-holiday-weekend/article_0bb12fa2-ed6a-11ea-b5e2-4740c03b4fa9.html. Accessed 25 Mar 2021
https://zenodo.org/record/836749/files/fire_videos.1406.zip?download=1. Accessed 25 Mar 2021
http://signal.ee.bilkent.edu.tr/VisiFire/. Accessed 25 Mar 2021
Shidik GF, Adnan FN, Supriyanto C, Pramunendar RA, Andono PN (2013) Multi color feature, background subtraction and time frame selection for fire detection. In: 2013 International Conference on Robotics, Biomimetics, Intelligent Computational Systems, IEEE, pp 115–120
Wang YL, Ye JY (2012) Research on the algorithm of prevention forest fire disaster in the Poyang Lake Ecological Economic Zone. Adv Mater Res 518:5257–5260
Han X-F, Jin JS, Wang M-J, Jiang W, Gao L, Xiao L-P (2017) Video fire detection based on Gaussian Mixture Model and multi-color features. SIViP 11(8):1419–1425
Jadon A, Omama M, Varshney A, Ansari MS, Sharma R (2019) FireNet: a specialized lightweight fire & smoke detection model for real-time IoT applications. arXiv preprint arXiv:1905.11922
Filonenko A, Hernández DC, Jo KH (2017) Fast smoke detection for video surveillance using CUDA. IEEE Trans Indus Inform 14(2):725–733
Yuan F, Fang Z, Shiqian Wu, Yang Y, Fang Y (2015) Real-time image smoke detection using staircase searching-based dual threshold AdaBoost and dynamic analysis. IET Image Proc 9(10):849–856
Emmy Prema C, Vinsley SS, Suresh S (2018) Efficient flame detection based on static and dynamic texture analysis in forest fire detection. Fire Technol 54(1):255–288
Emmy Prema C, Vinsley SS, Suresh S (2016) Multi feature analysis of smoke in YUV color space for early forest fire detection. Fire Technol 52(5):1319–1342
https://nfsa.org/wp-content/uploads/2018/03/Fire-Sprinkler-Guide-IBC-2015.pdf. Accessed 15 Sept 2022
Jack K (2011) Video demystified: a handbook for the digital engineer. Elsevier, Amsterdam
Acknowledgements
We would like to thank Dr. Pranibesh Mandal, assistant professor of mechanical engineering department at Jadavpur University, and Mr. Kanchan Sadhu of Bharat Petroleum Corporation Limited for their valuable insights and technical assistance throughout the project.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that are no financial or non-financial conflicts of interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Mondal, M.S., Prasad, V., Kumar, R. et al. Automating Fire Detection and Suppression with Computer Vision: A Multi-Layered Filtering Approach to Enhanced Fire Safety and Rapid Response. Fire Technol 59, 1555–1583 (2023). https://doi.org/10.1007/s10694-023-01392-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10694-023-01392-w