Abstract
Multi-sensor fire detection has been widely used, which allows monitoring multiple environmental indicators. However, most multi-sensor detection methods detect fires only by comparing the measurements of environmental indicators at each detection time with the preset thresholds. It is prone to fire false alarms due to neglecting the time series characteristics of environmental information. To improve the robustness and accuracy of fire detection, this paper proposes a new multi-sensor fire detection method based on long short-term memory (LSTM) networks, named EIF-LSTM. EIF-LSTM integrates environmental information fusion, which is divided into two steps. First, EIF-LSTM extracts the time series characteristics of the monitoring environment by processing multi-sensor time series readings, including environmental indicator variation information and environmental level information. Second, the normalized multi-sensor time series readings, environmental indicator variation information and environmental level information are fused together for fire prediction. The LSTM network realizes the extraction of environmental time series characteristics due to its ability to learn long-term dependencies. The addition of two kinds of time series information increases the detection dimension and enhances the fusion effect. Experimental results on a real-world fire dataset show that EIF-LSTM is capable of achieving state-of-the-art detection performance.
Similar content being viewed by others
Data availability
Data sharing not applicable to this article as no datasets were generated or analyzed during the current study.
References
Li Y, Zhang W, Liu Y et al (2022) A visualized fire detection method based on convolutional neural network beyond anchor. Appl Intell 52:1–16
Ahrens M, Evarts B, Fire loss in the United States during (2021) National Fire Protection Association (NFPA), 2022. https://www.nfpa.org/News-and-Research/Data-research-and-tools/US-Fire-Problem/Fire-loss-in-the-United-States
Gaur A, Singh A, Kumar A et al (2019) Fire sensing technologies: a review. IEEE Sens J 19(9):3191–3202
Hangauer A, Chen J, Strzoda R et al (2014) Performance of a fire detector based on a compact laser spectroscopic carbon monoxide sensor. Opt Express 22(11):13680–13690
Nakıp M, Güzeliş C (2019) Development of a multi-sensor fire detector based on machine learning models//2019 Innovations in Intelligent Systems and Applications Conference (ASYU). IEEE, 2019: 1–6
Peacock RD, Averill JD, Bukowski RW, et al (2005) Home smoke alarm tests, series 1, report of test FR 4016. https://www.nist.gov/el/nist-report-test-fr-4016
Nakip M, Güzelíş C, Yildiz O (2021) Recurrent trend predictive neural network for multi-sensor fire detection. IEEE Access 9:84204–84216
Madani K, Kachurka V, Sabourin C et al (2018) A human-like visual-attention-based artificial vision system for wildland firefighting assistance. Appl Intell 48(8):2157–2179
Chen TH, Wu PH, Chiou YC (2004) An early fire-detection method based on image processing//2004. In: international conference on image processing, 2004. ICIP'04. IEEE, 2004, vol 3, pp 1707–1710
Muhammad K, Ahmad J, Mehmood I et al (2018) Convolutional neural networks based fire detection in surveillance videos. IEEE Access 6:18174–18183
Muhammad K, Ahmad J, Lv Z et al (2018) Efficient deep CNN-based fire detection and localization in video surveillance applications. IEEE Trans Syst Man Cybernet Syst 49(7):1419–1434
Jiao Z, Zhang Y, Xin J, et al (2019) A deep learning based forest fire detection approach using UAV and YOLOv3//2019. In: 1st international conference on industrial artificial intelligence (IAI). IEEE, 2019 pp 1–5
Georgiev GD, Hristov G, Zahariev P et al (2020) Forest monitoring system for early fire detection based on convolutional neural network and UAV imagery//2020. In: 28th national conference with international participation (TELECOM). IEEE, pp 57–60
Zheng X, Chen F, Lou L et al (2022) Real-time detection of full-scale forest fire smoke based on deep convolution neural network. Remote Sens 14(3):536
Yu L, Wang N, Meng X (2005) Real-time forest fire detection with wireless sensor networks//Proceedings. In: 2005 international conference on wireless communications, networking and mobile computing, 2005. Ieee, vol 2. pp 1214–1217
Kadri B, Bouyeddou B, Moussaoui D (2018) Early fire detection system using wireless sensor networks//2018. In: international conference on applied smart systems (ICASS). IEEE, pp 1–4
Gharajeh MS (2019) FSB-system: a detection system for fire, suffocation, and burn based on fuzzy decision making, MCDM, and RGB model in wireless sensor networks. Wireless Pers Commun 105(4):1171–1213
Rizk M, Hmaydan H, Hajj M (2020) Proposition of low-cost wireless sensor network for real-time monitoring and early wildfire detection in Lebanon’s forests//2020. In: international conference on innovation and intelligence for informatics, computing and technologies (3ICT). IEEE, pp1–6
Bhattacharya S, Sherin M A, Poonguzhali P, et al (201) Experimental Analysis of WSN based Solution for Early Forest Fire Detection//2021. In: IEEE international conference on internet of things and intelligence systems (IoTaIS). IEEE, pp 136–141
Kumar A, Singh A, Kumar A et al (2018) Sensing technologies for monitoring intelligent buildings: a review. IEEE Sens J 18(12):4847–4860
Gong F, Li C, Gong W et al (2019) A real-time fire detection method from video with multifeature fusion. Comput Intell Neurosci 2019:1–17. https://doi.org/10.1155/2019/1939171
Wan Z, Zhuo Y, Jiang H, et al (2020) Fire detection from images based on single shot multibox detector. In: international conference on computer engineering and networks. Springer, Singapore, pp 302–313
Xie Y, Zhu J, Guo Y et al (2022) Early indoor occluded fire detection based on firelight reflection characteristics. Fire Saf J 128:103542
Baek J, Alhindi TJ, Jeong YS et al (2021) Intelligent multi-sensor detection system for monitoring indoor building fires. IEEE Sens J 21(24):27982–27992
Milke JA, Hulcher ME, Worrell CL et al (2003) Investigation of multi-sensor algorithms for fire detection. Fire Technol 39(4):363–382
de Venâncio PVAB, Lisboa AC, Barbosa AV (2022) An automatic fire detection system based on deep convolutional neural networks for low-power, resource-constrained devices. Neural Comput Appl 34:15349–15368
Wang S, Berentsen M, Kaiser T (2005) Signal processing algorithms for fire localization using temperature sensor arrays. Fire Saf J 40(8):689–697
Khan MJA, Imam MR, Uddin J, et al (2012) Automated fire fighting system with smoke and temperature detection//2012. In: 7th international conference on electrical and computer engineering. IEEE, pp 232–235
Xia D, Wang S, Zhu M, et al (2008) A method research on fire source localization using dual-line gas sensor array//2008. In: 7th world congress on intelligent control and automation. IEEE, pp 5862–5865
Solórzano A, Fonollosa J, Fernández L, et al (2017) Fire detection using a gas sensor array with sensor fusion algorithms//2017. In: ISOCS/IEEE international symposium on olfaction and electronic nose (ISOEN). IEEE, pp 1–3
Bao H, Li J, Zeng X Y, et al (2003) A fire detection system based on intelligent data fusion technology. In: proceedings of the 2003 international conference on machine learning and cybernetics (IEEE Cat. No. 03EX693). IEEE, vol 2. pp 1096–1101
Pei Y, Gan F (2009) Research on data fusion system of fire detection based on neural-network. In: 2009 Pacific-Asia conference on circuits, communications and systems. IEEE, pp 665–668
Chen X, Bu L (2010) Research of fire detection method based on multi-sensor data fusion. In: 2010 international conference on computational intelligence and software engineering. IEEE, pp 1–4
Sowah RA, Ofoli AR, Krakani SN et al (2016) Hardware design and web-based communication modules of a real-time multisensor fire detection and notification system using fuzzy logic. IEEE Trans Ind Appl 53(1):559–566
Zheng Xu, Kamruzzaman MM, Shi J (2022) Method of generating face image based on text description of generating adversarial network. J Electron Imaging. https://doi.org/10.1117/1.JEI.31.5.051411
Wu L, Chen L, Hao X (2021) Multi-sensor data fusion algorithm for indoor fire early warning based on BP neural network. Information 12(2):59
Vaswani A, Shazeer N, Parmar N, et al (2017) Attention is all you need. Adv Neural Inf Process Syst 30
Lim B, Arık SÖ, Loeff N et al (2021) Temporal fusion transformers for interpretable multi-horizon time series forecasting. Int J Forecast 37(4):1748–1764
El-Din AG, Smith DW (2002) A neural network model to predict the wastewater inflow incorporating rainfall events. Water Res 36(5):1115–1126
Cho K, Van Merriënboer B, Gulcehre C, et al (2014) Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078, https://arxiv.org/abs/1406.1078
Funding
This work was supported by the National Natural Science Foundation of China under Grants of 61762029 and 61972237, Guilin Science and Technology Development Program under Grant of 20190211-20 and the Natural Science Foundation of Shandong Province under grant of ZR2019MF017.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
These are no potential competing interests in our paper. And all authors have seen the manuscript and approved to submit to your journal. We confirm that the content of the manuscript has not been published or submitted for publication elsewhere.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Liu, P., Xiang, P. & Lu, D. A new multi-sensor fire detection method based on LSTM networks with environmental information fusion. Neural Comput & Applic 35, 25275–25289 (2023). https://doi.org/10.1007/s00521-023-08709-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-023-08709-4