Abstract
Forest fire poses a serious threat to wildlife, environment, and all mankind. This threat has prompted the development of various intelligent and computer vision based systems to detect forest fire. This article proposes a novel hybrid deep learning model to detect forest fire. This model uses a combination of convolutional neural network (CNN) and recurrent neural network (RNN) for feature extraction and two fully connected layers for final classification. The final feature map obtained from the CNN has been flattened and then fed as an input to the RNN. CNN extracts various low level as well as high level features, whereas RNN extracts various dependent and sequential features. The use of both CNN and RNN for feature extraction is proposed in this article for the first time in the literature of forest fire detection. The performance of the proposed system has been evaluated on two publicly available fire datasets—Mivia lab dataset and Kaggle fire dataset. Experimental results demonstrate that the proposed model is able to achieve very high classification accuracy and outperforms the existing state-of-the-art results in this regard.
Similar content being viewed by others
References
Barmpoutis P, Stathaki T, Dimitropoulos K, Grammalidis N (2020) Early fire detection based on aerial 360-Degree sensors, deep convolution neural networks and exploitation of fire dynamic textures. Remote Sens 12:3177
Borges PVK, Izquierdo E (2010) A probabilistic approach for vision-based fire detection in videos. IEEE Trans Circ Syst Video Technol 20(5):721–731
Celik T, Demirel H, Ozkaramanli H, Uyguroglu M (2007) Fire detection using statistical color model in video sequences. J Vis Commun Image Represent 18(2):176–185
Cruz H, Eckert M, Meneses J, Martínez JF (2016) Efficient forest fire detection index for application in unmanned aerial systems (UASs). Sensors 16(6):893–909
Du W, Wang Y, Qiao Y (2018) Recurrent spatial-temporal attention network for action recognition in videos. IEEE Trans Image Process 27:1347–1360
Foggia P, Saggese A, Vento M Mivia lab dataset, 2015, Retrieved September 2020 from http://mivia.unisa.it/datasets
Foggia P, Saggese A, Vento M (2015) Real-time fire detection for video-surveillance applications using a combination of experts based on color, shape, and motion. IEEE Trans Circ Syst Video Technol 25(9):1545–1556
Ghosh R, Vamshi C, Kumar P (2019) RNN Based online handwritten word recognition in Devanagari and Bengali scripts using horizontal zoning. Pattern Recogn 92:203–218
Gomes P, Santana P, Barata J (2014) A vision-based approach to fire detection. Int J Adv Robot Syst 11(9):1–12
Gong YJ, Li JJ, Zhou Y, Li Y, Chung HSH, Shi YH, Zhang J (2015) Genetic learning particle swarm optimization. IEEE Trans Cybern 46(10):2277–2290
Graves A, Liwicki M, Fernandez S, Bertolami R, Bunke H, Schmidhuber J (2009) A novel connectionist system for unconstrained handwriting recognition. IEEE Trans Pattern Anal Mach Intell 31(5):855–868
Ho CC (2009) Machine vision-based real-time early flame and smoke detection. Meas Sci Technol 20(4):1–13
Khatami A, Mirghasemi S, Khosravi A, Lim CP, Nahavandi S (2017) A new PSO-based approach to fire flame detection using K-Medoids clustering. Expert Syst Appl 68:69–80
Kim YH, Kim A, Jeong HY (2014) RGB Color model based the fire detection algorithm in video sequences on wireless sensor network. Int J Distrib Sens Netw 10(4):1–10
Kingma DP, Ba J (2015) Adam: A method for stochastic optimization. In: Proceedings of the 3rd International Conference on Learning Representations, San Diego, pp 1–15
Larsen A, Hanigan I, Reich BJ, Qin Y, Cope M, Morgan G, Rappold AG (2021) A deep learning approach to identify smoke plumes in satellite imagery in near-real time for health risk communication. J Expos Sci Environ Epidemiol 31:170–176
Li Z, Mihaylova LS, Isupova O, Rossi L (2018) Autonomous flame detection in videos with a Dirichlet process Gaussian mixture color model. IEEE Trans Ind Inf 14(3):1146–1154
Liu CB, Ahuja N (2004) Vision based fire detection. In: Proceedings of the 17th International Conference on Pattern Recognition. Cambridge, pp 134–137
Mahmoud MA, Ren H (2018) Forest fire detection using a rule-based image processing algorithm and temporal variation. Math Probl Eng 2018:1–8
Mao J, Xu W, et al. (2015) Deep captioning with multimodal recurrent neural networks (m-RNN). In: Proceedings of ICLR
Muhammad K, Ahmad J, Lv Z, Bellavista P, Yang P, Baik SW (2019) Efficient deep CNN Based fire detection and localization in video surveillance applications. IEEE Trans Syst Man Cybern Syst 49(7):1419–1434
Park M, Tran DQ, Jung D, Park S (2020) Wildfire-detection Method Using DenseNet and cycleGAN Data Augmentation-Based Remote Camera Imagery. Remote Sens 12:3715
Saied A (2018) FIRE Dataset. Retrieved October 2020 from https://www.kaggle.com/phylake1337/fire-dataset
Saripalli S, Montgomery JF, Sukhatme GS (2003) Visually guided landing of an unmanned aerial vehicle. IEEE Trans Robot Autom 19(3):371–380
Sousa MJ, Moutinho A, Almeida M (2975) Wildfire detection using transfer learning on augmented datasets. Expert Syst Appl 2020(11):142
Sudhakar S, Vijayakumar V, Kumar CS, Priya V, Ravi L, Subramaniyaswamy V (2020) Unmanned Aerial Vehicle (UAV) based Forest Fire Detection and monitoring for reducing false alarms in forest-fires. Comput Commun 149:1–16
Sun Z, Liu Y, Tao L (2018) Attack localization task allocation in wireless sensor networks based on multi-objective binary particle swarm optimization. J Netw Comput Appl 112:29–40
Töreyin BU, Dedeoǧlu Y, Güdükbay U, Cetin AE (2006) Computer vision based method for real-time fire and flame detection. Pattern Recogn Lett 27(1):49–58
Yuan C, Liu Z, Zhang Y (2016) Vision-based forest fire detection in aerial images for firefighting using UAVs. In: Proceedings of International Conference on Unmanned Aircraft Systems (ICUAS), Arlington, pp 1200–1205
Zhang Q, Xu J, Xu L, Guo H (2016) Deep convolutional neural networks for forest fire detection. In: Proceedings of the International Forum on Management, Education and Information Technology Application, Guangzhou, pp 568–575
Zhao Y, Ma J, Li X, Zhang J (2018) Saliency detection and deep learning-based wildfire identification in UAV imagery. Sensors 18(3):712–731
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Ghosh, R., Kumar, A. A hybrid deep learning model by combining convolutional neural network and recurrent neural network to detect forest fire. Multimed Tools Appl 81, 38643–38660 (2022). https://doi.org/10.1007/s11042-022-13068-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-022-13068-8