Skip to main content

Advertisement

Log in

A hybrid deep learning model by combining convolutional neural network and recurrent neural network to detect forest fire

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Forest fire poses a serious threat to wildlife, environment, and all mankind. This threat has prompted the development of various intelligent and computer vision based systems to detect forest fire. This article proposes a novel hybrid deep learning model to detect forest fire. This model uses a combination of convolutional neural network (CNN) and recurrent neural network (RNN) for feature extraction and two fully connected layers for final classification. The final feature map obtained from the CNN has been flattened and then fed as an input to the RNN. CNN extracts various low level as well as high level features, whereas RNN extracts various dependent and sequential features. The use of both CNN and RNN for feature extraction is proposed in this article for the first time in the literature of forest fire detection. The performance of the proposed system has been evaluated on two publicly available fire datasets—Mivia lab dataset and Kaggle fire dataset. Experimental results demonstrate that the proposed model is able to achieve very high classification accuracy and outperforms the existing state-of-the-art results in this regard.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Barmpoutis P, Stathaki T, Dimitropoulos K, Grammalidis N (2020) Early fire detection based on aerial 360-Degree sensors, deep convolution neural networks and exploitation of fire dynamic textures. Remote Sens 12:3177

    Article  Google Scholar 

  2. Borges PVK, Izquierdo E (2010) A probabilistic approach for vision-based fire detection in videos. IEEE Trans Circ Syst Video Technol 20(5):721–731

    Article  Google Scholar 

  3. Celik T, Demirel H, Ozkaramanli H, Uyguroglu M (2007) Fire detection using statistical color model in video sequences. J Vis Commun Image Represent 18(2):176–185

    Article  Google Scholar 

  4. Cruz H, Eckert M, Meneses J, Martínez JF (2016) Efficient forest fire detection index for application in unmanned aerial systems (UASs). Sensors 16(6):893–909

    Article  Google Scholar 

  5. Du W, Wang Y, Qiao Y (2018) Recurrent spatial-temporal attention network for action recognition in videos. IEEE Trans Image Process 27:1347–1360

    Article  MathSciNet  Google Scholar 

  6. Foggia P, Saggese A, Vento M Mivia lab dataset, 2015, Retrieved September 2020 from http://mivia.unisa.it/datasets

  7. Foggia P, Saggese A, Vento M (2015) Real-time fire detection for video-surveillance applications using a combination of experts based on color, shape, and motion. IEEE Trans Circ Syst Video Technol 25(9):1545–1556

    Article  Google Scholar 

  8. Ghosh R, Vamshi C, Kumar P (2019) RNN Based online handwritten word recognition in Devanagari and Bengali scripts using horizontal zoning. Pattern Recogn 92:203–218

    Article  Google Scholar 

  9. Gomes P, Santana P, Barata J (2014) A vision-based approach to fire detection. Int J Adv Robot Syst 11(9):1–12

    Article  Google Scholar 

  10. Gong YJ, Li JJ, Zhou Y, Li Y, Chung HSH, Shi YH, Zhang J (2015) Genetic learning particle swarm optimization. IEEE Trans Cybern 46(10):2277–2290

    Article  Google Scholar 

  11. Graves A, Liwicki M, Fernandez S, Bertolami R, Bunke H, Schmidhuber J (2009) A novel connectionist system for unconstrained handwriting recognition. IEEE Trans Pattern Anal Mach Intell 31(5):855–868

    Article  Google Scholar 

  12. Ho CC (2009) Machine vision-based real-time early flame and smoke detection. Meas Sci Technol 20(4):1–13

    Article  Google Scholar 

  13. Khatami A, Mirghasemi S, Khosravi A, Lim CP, Nahavandi S (2017) A new PSO-based approach to fire flame detection using K-Medoids clustering. Expert Syst Appl 68:69–80

    Article  Google Scholar 

  14. Kim YH, Kim A, Jeong HY (2014) RGB Color model based the fire detection algorithm in video sequences on wireless sensor network. Int J Distrib Sens Netw 10(4):1–10

    Article  Google Scholar 

  15. Kingma DP, Ba J (2015) Adam: A method for stochastic optimization. In: Proceedings of the 3rd International Conference on Learning Representations, San Diego, pp 1–15

  16. Larsen A, Hanigan I, Reich BJ, Qin Y, Cope M, Morgan G, Rappold AG (2021) A deep learning approach to identify smoke plumes in satellite imagery in near-real time for health risk communication. J Expos Sci Environ Epidemiol 31:170–176

    Article  Google Scholar 

  17. Li Z, Mihaylova LS, Isupova O, Rossi L (2018) Autonomous flame detection in videos with a Dirichlet process Gaussian mixture color model. IEEE Trans Ind Inf 14(3):1146–1154

    Article  Google Scholar 

  18. Liu CB, Ahuja N (2004) Vision based fire detection. In: Proceedings of the 17th International Conference on Pattern Recognition. Cambridge, pp 134–137

  19. Mahmoud MA, Ren H (2018) Forest fire detection using a rule-based image processing algorithm and temporal variation. Math Probl Eng 2018:1–8

    Article  Google Scholar 

  20. Mao J, Xu W, et al. (2015) Deep captioning with multimodal recurrent neural networks (m-RNN). In: Proceedings of ICLR

  21. Muhammad K, Ahmad J, Lv Z, Bellavista P, Yang P, Baik SW (2019) Efficient deep CNN Based fire detection and localization in video surveillance applications. IEEE Trans Syst Man Cybern Syst 49(7):1419–1434

    Article  Google Scholar 

  22. Park M, Tran DQ, Jung D, Park S (2020) Wildfire-detection Method Using DenseNet and cycleGAN Data Augmentation-Based Remote Camera Imagery. Remote Sens 12:3715

    Article  Google Scholar 

  23. Saied A (2018) FIRE Dataset. Retrieved October 2020 from https://www.kaggle.com/phylake1337/fire-dataset

  24. Saripalli S, Montgomery JF, Sukhatme GS (2003) Visually guided landing of an unmanned aerial vehicle. IEEE Trans Robot Autom 19(3):371–380

    Article  Google Scholar 

  25. Sousa MJ, Moutinho A, Almeida M (2975) Wildfire detection using transfer learning on augmented datasets. Expert Syst Appl 2020(11):142

    Google Scholar 

  26. Sudhakar S, Vijayakumar V, Kumar CS, Priya V, Ravi L, Subramaniyaswamy V (2020) Unmanned Aerial Vehicle (UAV) based Forest Fire Detection and monitoring for reducing false alarms in forest-fires. Comput Commun 149:1–16

    Article  Google Scholar 

  27. Sun Z, Liu Y, Tao L (2018) Attack localization task allocation in wireless sensor networks based on multi-objective binary particle swarm optimization. J Netw Comput Appl 112:29–40

    Article  Google Scholar 

  28. Töreyin BU, Dedeoǧlu Y, Güdükbay U, Cetin AE (2006) Computer vision based method for real-time fire and flame detection. Pattern Recogn Lett 27(1):49–58

    Article  Google Scholar 

  29. Yuan C, Liu Z, Zhang Y (2016) Vision-based forest fire detection in aerial images for firefighting using UAVs. In: Proceedings of International Conference on Unmanned Aircraft Systems (ICUAS), Arlington, pp 1200–1205

  30. Zhang Q, Xu J, Xu L, Guo H (2016) Deep convolutional neural networks for forest fire detection. In: Proceedings of the International Forum on Management, Education and Information Technology Application, Guangzhou, pp 568–575

  31. Zhao Y, Ma J, Li X, Zhang J (2018) Saliency detection and deep learning-based wildfire identification in UAV imagery. Sensors 18(3):712–731

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rajib Ghosh.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ghosh, R., Kumar, A. A hybrid deep learning model by combining convolutional neural network and recurrent neural network to detect forest fire. Multimed Tools Appl 81, 38643–38660 (2022). https://doi.org/10.1007/s11042-022-13068-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-13068-8

Keywords

Navigation