Skip to main content
SpringerLink
Log in

Machine learning based approach for multimedia surveillance during fire emergencies

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Video based surveillance of manmade disasters such as fire has become very hot topic in research and it is playing an important role in the development of smart environment. The disasters like fire cause many economic and social damages. We can prevent these damages by early detection of the fire. The current advancement in embedded processing have permitted the detection of fire using vision-based i.e. Convolutional Neural Networks (CNNs) for the surveillance. Therefore, we proposed a method using machine learning techniques for Multimedia Surveillance during fire emergencies. Our proposed model has two main deep neural networks models. Firstly, we used a hybrid model made of Adaboost and many Mulit-layer perceptron (MLP) neural networks. The purpose of hybrid Adaboost-MLP model is to predict fire efficiently. This model used different sensors data like smoke, heat, and gas for training. After predicting the fire, we proposed a CNN model to detect the fire immediately. These results show that our trained model has near 91% fire detection accuracy. We can the false positive results are quite low. These results can be improved more by further training.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Abdel-Basset M, Manogaran G, Abdel-Fatah L, Mirjalili S (2018) An improved nature inspired meta-heuristic algorithm for 1-D bin packing problems. Pers Ubiquitous Comput 1117–1132. doi:https://doi.org/10.1007/s00779-018-1132-7

  2. Abdel-Basset M, Manogaran G, Mohamed M, Rushdy E (2018) Internet of things in smart education environment: supportive framework in the decision-making process. Concurr Comput. https://doi.org/10.1002/cpe.4515

  3. Abdul R, Paul A, Gul MJ et al (2018) Exploiting small world problems in a SIoT environment. Energies 11:2089. https://doi.org/10.3390/en11082089

    Article  Google Scholar 

  4. Andrew LM, Awni YH, Andrew YN (2013) Rectifier nonlinearities improve neural network acoustic models. Proc 30 th Int Conf Mach Learn Atlanta, Georgia: 1–6

  5. Anwar S, Hwang K, Sung W (2015) Fixed point optimization of deep convolutional neural networks for object recognition. ICASSP, IEEE international conference on acoustics, speech and signal processing - proceedings. IEEE, Brisbane, QLD, Australia: 1131–1135

  6. Çelik T, Demirel H (2009) Fire detection in video sequences using a generic color model. Fire Saf J 44:147–158. https://doi.org/10.1016/j.firesaf.2008.05.005

    Article  Google Scholar 

  7. Çelik T, Özkaramanlı H, Demirel H (2007) Fire and smoke detection without sensors: image procecessing based approach. 15th European Signal Processing Conference (EUSIPCO). IEEE, Poznan, Poland: 1794–1798

  8. Chan TH, Jia K, Gao S et al (2015) PCANet: a simple deep learning baseline for image classification? IEEE Trans Image Process 24:5017–5032. https://doi.org/10.1109/TIP.2015.2475625

    Article  MathSciNet  MATH  Google Scholar 

  9. Chen TC, Wu P, Chiou Y (2004) An early fire-detection method based on image processing: 1707–1710

  10. Chino DYT, Avalhais LPS, Rodrigues Jr. JF, Traina AJM (2015) BoWFire: detection of fire in still images by integrating pixel color and texture analysis. 28th SIBGRAPI conference on graphics, patterns and images. IEEE, Salvador, Brazil: 95–102

  11. Ciresan DC, Meier U, Masci J, et al (2011) Flexible, high performance convolutional neural networks for image classification. In: proceedings of the twenty-second international joint conference on artificial intelligence. IJCAI, Barcelona, Catalonia, Spain: 1237–1242

  12. Cun YL, Boser B, Denker JS, et al (1989) Handwritten digit recognition with a Back-propagation network. In: David T (ed) Advances in neural information processing systems 2. Morgan Kaufmann: 396–404

  13. Fraustino JD, Liu B, Yan J (2012) Social media use during disasters: a review of the Knowledge Base and gaps. Dep Homel Secur Sci Technol Cent Excell 1–39

  14. Freund Y (1995) Boosting a weak learning algorithm by majority. Inf Comput. https://doi.org/10.1006/inco.1995.1136

  15. Fukushima K (1980) Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol Cybern 36:193–202. https://doi.org/10.1007/BF00344251

    Article  MATH  Google Scholar 

  16. (2018) Gas explosion in harlem blows up 2 buildings, 2 women dead & 17 injured. In: WIKIPEDIA. http://wordondastreet.com/gas-explosion-harlem-blows-2-buildings-2-women-dead-17-injured/. Accessed 16 Dec 2018

  17. Guo L, Ge PS, Zhang MH et al (2012) Pedestrian detection for intelligent transportation systems combining AdaBoost algorithm and support vector machine. Expert Syst Appl 39:4274–4286. https://doi.org/10.1016/j.eswa.2011.09.106

    Article  Google Scholar 

  18. Habiboǧlu YH, Günay O, Çetin AE (2012) Covariance matrix-based fire and flame detection method in video. Mach Vis Appl 23:1103–1113. https://doi.org/10.1007/s00138-011-0369-1

    Article  Google Scholar 

  19. Hubel DH, Wiesel TN (1977) Functional architecture of macaque monkey visual cortex. Proc R Soc B Biol Sci 198:1–59. https://doi.org/10.1098/rspb.1977.0085

    Article  Google Scholar 

  20. Jiang B, Yang J, Lv Z et al (2017) Internet cross-media retrieval based on deep learning. J Vis Commun Image Represent 48:356–366. https://doi.org/10.1016/j.jvcir.2017.02.011

    Article  Google Scholar 

  21. Li W, Zhao R, Xiao T, Wang X (2014) DeepReID: Deep Filter Pairing Neural Network for Person Re-Identification. IEEE Conference on Computer Vision and Pattern Recognition. IEEE, Columbus, OH, USA: 152–159

  22. Liu H, Tian HQ, Li YF, Zhang L (2015) Comparison of four Adaboost algorithm based artificial neural networks in wind speed predictions. Energy Convers Manag 92:67–81. https://doi.org/10.1016/j.enconman.2014.12.053

    Article  Google Scholar 

  23. Luo P, Tian Y, Wang X, Tang X (2014) Switchable Deep Network for Pedestrian Detection. IEEE Conference on Computer Vision and Pattern Recognition. IEEE, Columbus, OH, USA: 899–905

  24. Mueller M, Karasev P, Kolesov I, Tannenbaum A (2013) Optical flow estimation for flame detection in videos. IEEE Trans Image Process 22:2786–2797. https://doi.org/10.1109/TIP.2013.2258353

    Article  Google Scholar 

  25. Narwani S, Selva Kumar A (2016) Real-time fire detection for video surveillance applications using a combination of experts based on color, shape and motion. IEEE Trans Circ Syst Video Technol 25:1545–1556. https://doi.org/10.1109/TCSVT.2015.2392531

    Article  Google Scholar 

  26. (2018) November 2015 Paris attacks. In: WIKIPEDIA. https://en.wikipedia.org/wiki/November_2015_Paris_attacks. Accessed 16 Dec 2018

  27. Paul A, Jiang YC, Wang JF, Yang JF (2012) Parallel reconfigurable computing-based mapping algorithm for motion estimation in advanced video coding. ACM Transactions on Embedded Computing Systems (TECS) 11(S2):40

    Article  Google Scholar 

  28. Paul A, Chen B-W, Bharanitharan K, Wang J-F (2013) Video search and indexing with reinforcement agent for interactive multimedia services. ACM Trans Embed Comput Syst 12:1–16. https://doi.org/10.1145/2423636.2423643

    Article  Google Scholar 

  29. Paul A, Ahmad A, Rathore MM, Jabbar S (2016) Smartbuddy: defining human behaviors using big data analytics in social internet of things. IEEE Wirel Commun 23:68–74. https://doi.org/10.1109/MWC.2016.7721744

    Article  Google Scholar 

  30. Paul A, Daniel A, Ahmad A, Rho S (2017) Cooperative cognitive intelligence for internet of vehicles. IEEE Syst J 11(3):1249–1258. https://doi.org/10.1109/JSYST.2015.2411856

    Article  Google Scholar 

  31. Rafei M, Sorkhabi SE, Mosavi MR (2014) Multi-objective optimization by means of multi-dimensional MLP neural networks. Neural Netw World 24:31–56. https://doi.org/10.14311/NNW.2014.24.002

    Article  Google Scholar 

  32. Rehman A, Rathore MM, Paul A et al (2018) Vehicular traffic optimisation and even distribution using ant colony in smart city environment. IET Intell Transp Syst:1–8. https://doi.org/10.1049/iet-its.2017.0308

  33. Rosario DL, Antonio G, Alessia S, Mario V (2014) Improving fire detection reliability by a combination of video analytics. International conference image analysis and recognition. Springer, Cham: 477–478

  34. Saeed F, Paul A, Rehman A et al (2018) IoT-based intelligent modeling of smart home environment for fire prevention and safety. J Sens Actuator Netw 7:11. https://doi.org/10.3390/jsan7010011

    Article  Google Scholar 

  35. Vadim K, Maxime O, Minsu C, Laptev I (2016) ContextLocNet: context-aware deep network models for weakly supervised localization. European conference on computer vision (ECCV): 350–365

  36. Wenlu Z, Rongjian L, Houtao D et al (2015) Deep convolutional neural networks for multi-modality isointense infant brain image segmentation. Neuroimage 108:214–224. https://doi.org/10.1016/j.neuroimage.2014.12.061

    Article  Google Scholar 

  37. Xu B, Wang N, Chen T, Li M (2015) Empirical evaluation of rectified activations in convolutional network. doi:https://doi.org/10.1016/S0266-8920(98)00020-4

  38. Yang J, Jiang B, Li B et al (2017) A fast image retrieval method designed for network big data. IEEE Trans Ind Inform 13:2350–2359. https://doi.org/10.1109/TII.2017.2657545

    Article  Google Scholar 

Download references

Acknowledgements

This study was also supported by the National Research Foundation of Korea (NRF) grant funded by the Korean Government (NRF-2017R1C1B5017464). This study was also supported by the National Research Foundation of Korea (NRF) grant funded by the Korean government (MSIP) (NRF-2016R1A2A1A05005459).

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Kyungpook National University, Daegu, 702-701, Korea

    Faisal Saeed & Anand Paul

  2. School of Architectural, Civil, Environmental and Energy Engineering, Kyungpook National University, Daegu, 702-701, Korea

    Won Hwa Hong & Hyuncheol Seo

Authors
  1. Faisal Saeed
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anand Paul
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Won Hwa Hong
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hyuncheol Seo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Anand Paul.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Saeed, F., Paul, A., Hong, W.H. et al. Machine learning based approach for multimedia surveillance during fire emergencies. Multimed Tools Appl 79, 16201–16217 (2020). https://doi.org/10.1007/s11042-019-7548-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-019-7548-x

Keywords

Search

Navigation