Abstract
Typically, image-based smoke detection is formulated as a frame classification task that aims to automatically assign the captured frames to the predefined “smoke” or “smoke-free” classes. This classification is based on the visual content of the images. In other words, the keystone of such a solution is the choice of the visual descriptor(s) used to encode the visual characteristics of the smoke into numerical vectors. In this paper, we propose to learn a new feature space to represent the visual descriptors extracted from the video frames in an unsupervised manner. This mapping is intended to yield better discrimination between smoke-free images and those showing smoke patterns. The proposed approach is inspired by the linear hyperspectral unmixing techniques. It defines the axes of the new feature space as the vertices of a minimum-volume simplex enclosing all image pixels in the frame. The obtained empirical results prove that the proposed feature mapping approach reinforces the discrimination power of the visual descriptors and produces better smoke detection performance. In addition, the proposed approach exhibits the valuable ability to automatically determine the most relevant visual descriptors.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Alamgir N et al (2018) Combining multi-channel color space with local binary co-occurrence feature descriptors for accurate smoke detection from surveillance videos. Fire Saf J 102:1–10
Bchir O, Ismail MMB, Frigui H (2013) Mixture analysis based on spectral summarization. In: IEEE Whispers Gainsville, Florida
Ben-Hur A, Horn D, Siegelmann H, Vapnik VN (2001) Support vector clustering. J Mach Learn Res 2:125–137
Berman M, Kiiveri H, Lagerstrom R, Ernst A, Dunne R, Huntington JF (2004) ICE: a statistical approach to identifying endmembers in hyperspectral images: learning from Earth’s shapes and colors. IEEE Trans Geosci Remote Sens 42:2085–2095
Bezdek JC, Ehrlich R, Full W (1984) FCM: the fuzzy c-means clustering algorithm. Comput Geosci 10:191–203
Bishop CM (2006) Pattern recognition and machine learning, vol 1. Springer, New York
Calderara S, Piccinini P, Cucchiara R (2011) Vision based smoke detection system using image energy and color information. Mach Vis Appl 22:705–719
Celik T, Ozkaramanli H, Demirel H (2007) Fire and smoke detection without sensors: image processing based approach, In: 15th European signal processing conference, Poznan
Chen T-H, Kao C-L, Chang S-M (2003) An intelligent real-time fire-detection method based on video processing. In: IEEE 37th annual 2003 international carnahan conference on security technology. Proceedings, pp 104–111
Chen T-H, Wu P-H, Chiou Y-C (2004) An early fire-detection method based on image processing, in Image Processing. In: 2004 International conference on ICIP’04, pp 1707–1710
Cong X et al (2017) Optimising the deployment of virtual machine image replicas in cloud storage clusters. Int J High Perform Comput Netw 10(4):423–435
Crouse MS, Nowak RD, Baraniuk RG (1998) Wavelet-based statistical signal processing using hidden Markov models. IEEE Trans Signal Process 46:886–902
Freund Y, Schapire RE (1997) A decision-theoretic generalization of on-line learning and an application to boosting. J Comput Syst Sci 55:119
https://ru-clip.net/rev/very+early+smoke+detection/. Accessed on 4 Dec 2019
Keshava N, Mustard JF (2002) Spectral unmixing. IEEE Signal Process Mag 19:44–57
Kolesov I, Karasev P, Tannenbaum A, Haber E (2010) Fire and smoke detection in video with optimal mass transport based optical flow and neural networks. In: 17th IEEE international conference on image processing (ICIP), pp 761–764
Lin G et al (2017) Smoke detection in video sequences based on dynamic texture using volume local binary patterns. TIIS 11(11):5522–5536
Long F, Zhang H, Feng DD (2003) Fundamentals of content-based image retrieval. Multimedia information retrieval and management. Springer, Berlin, pp 1–26
Manjunath BS, Ohm J-R, Vasudevan VV, Yamada A (2001) Color and texture descriptors. In: IEEE transactions on circuits and systems for video technology, vol 11, pp 703–715
Morerio P, Marcenaro L, Regazzoni CS, Gera G (2012) Early fire and smoke detection based on colour features and motion analysis. In: 2012 19th IEEE international conference on image processing (ICIP), pp 1041–1044
Mouhib I, El Ouadghiri D, Naanani H (2017) Homomorphic encryption as a service for outsourced images in mobile cloud computing environment. Int J Cloud Appl Comput 7(2):27–40
Ojansivu V, Heikkilä J (2008) Blur insensitive texture classification using local phase quantization. Image and signal processing. Springer, Berlin, pp 236–243
Päivärinta J, Rahtu E, Heikkilä J (2011) Volume local phase quantization for blur-insensitive dynamic texture classification. In: Image analysis, pp 360–369
Panda S, Naik S (2018) An efficient data replication algorithm for distributed systems. Int J Cloud Appl Comput 8(3):60–77
Papageorgiou O, Poggio (1998) A general framework for object detection. In: International conference on computer vision
Partio M, Cramariuc B, Gabbouj M, Visa A (2002) Rock texture retrieval using gray level co-occurrence matrix. In: Proceedings of the 5th Nordic signal processing symposium
Pietikäinen M (2005) Image analysis with local binary patterns. Image analysis. Springer, Berlin, pp 115–118
Pundir AS, Balasubramanian R (2017) Deep belief network for smoke detection. Fire Technol 53(6):1943–1960
Qi K, Hai H, Xie D-Q (2018) A watermarking based authentication and image restoration in two-layer multimedia sensor networks. Int J High Perform Comput Netw 12(1):65–73
Tian H, Li W, Ogunbona P, Nguyen DT, Zhan C (2011) Smoke detection in videos using non-redundant local binary pattern-based features. In: IEEE 13th international workshop on multimedia signal processing (MMSP), pp 1–4
Torabnezhad M, Aghagolzadeh A, HadiSeyedarabi H (2013) Visible and IR image fusion algorithm for short range smoke detection. In RSI/ISM international conference on robotics and mechatronics, pp 38–42
Toreyin BU, Dedeoglu Y, Cetin AE (2005) Wavelet based real-time smoke detection in video. In: European signal processing conference, pp 4–8
Toreyin BU, Dedeoglu Y, Cetin AE (2006) Contour based smoke detection in video using wavelets. In: 2006 14th European signal processing conference, pp 1–5
Wang Y, Liu Z, Huang J-C (2000) Multimedia content analysis-using both audio and visual clues. Sig Process Mag IEEE 17:12–36
Wold S, Esbensen K, Geladi P (1987) Principal component analysis. Chemometr Intell Lab Syst 2:37–52
Ye W et al (2015) Dynamic texture based smoke detection using Surfacelet transform and HMT model. Fire Saf J 73:91–101
Yin M et al (2018) Recurrent convolutional network for video-based smoke detection. Multimed Tools Appl 78:1–20
Yuan F (2011) Video-based smoke detection with histogram sequence of LBP and LBPV pyramids. Fire Saf J 46:132–139
Yuan F, Liao G, Fan W, Zhou H (2005) Vision based fire detection using mixture Gaussian model. In: Proceedings of the 8th international symposium on fire safety science, pp 1575–1583
Yuan F et al (2015) Real-time image smoke detection using staircase searching-based dual threshold AdaBoost and dynamic analysis. IET Image Proc 9(10):849–856
Zare A, Gader P (2007) Sparsity promoting iterated constrained endmember detection in hyperspectral imagery. IEEE Geosci Remote Sens Lett 4:446
Acknowledgments
This project was supported by the Research Groups Program (Research Group number RG-1439-033), Deanship of Scientific Research, King Saud University, Riyadh, Saudi Arabia.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors have no conflicts of interest to declare that are relevant to the content of this article.
Additional information
Communicated by V. Loia.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Asiri, N., Bchir, O., Ismail, M.M.B. et al. Image-based smoke detection using feature mapping and discrimination. Soft Comput 25, 3665–3674 (2021). https://doi.org/10.1007/s00500-020-05396-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-020-05396-4