Abstract
Smoke detection is the most commonly used method in early warning of fire and is widely used in forest detection. Most existing smoke detection methods contain empty spaces and obstacles which interfere with detection and extract false smoke roots. This study developed a new smoke roots search algorithm based on a multi-feature fusion dynamic extraction strategy. This determines smoke origin candidate points and region based on a multi-frame discrete confidence level. The results show that the new method provides a more complete smoke contour with no background interference, compared to the results using existing methods. Unlike video-based methods that rely on continuous frames, an adaptive threshold method was developed to build the judgment image set composed of non-consecutive frames. The smoke roots origin search algorithm increased the detection rate and significantly reduced false detection rate compared to existing methods.
Similar content being viewed by others
References
Alamgir N, Nguyen K, Chandran V, Boles W (2018) Combining multichannel color space with local binary co-occurrence feature descriptors for accurate smoke detection from surveillance videos. Fire Saf J 102:1–10. https://doi.org/10.1016/j.firesaf.2018.09.003
Appana DK, Islam R, Khan SA, Kim JM (2017) A video-based smoke detection using smoke flow pattern and spatial-temporal energy analyses for alarm systems. Inf Sci 418–419:91–101. https://doi.org/10.1016/j.ins.2017.08.001
Barmpoutis P, Dimitropoulos K, Grammalidis N (2013) Real time video fire detection using spatio-temporal consistency energy. IEEE AVSS 2013. https://doi.org/10.1109/AVSS.2013.6636667
Cheng SH, Ma JY, Zhang SJ (2019) Smoke detection and trend prediction method based on deeplabv3+ and generative adversarial network. J Electron Imaging 28:033006–033006. https://doi.org/10.1117/1.JEI.28.3.033006
Gao Y, Cheng PL (2021) Full-scale video-based detection of smoke from forest fires combining ViBe and MSER algorithms. Fire Technol. https://doi.org/10.1007/s10694-020-01052-3
Gao Y, Cheng PL (2019) Forest fire smoke detection based on visual smoke root and diffusion model. Fire Technol 55(5):1801–1826. https://doi.org/10.1007/s10694-019-00831-x
Gaur A, Singh A, Kumar A, Kapoor K (2020) Video flame and smoke- based fire detection algorithms: a literature review. Fire Technol 56(5):1943–1980. https://doi.org/10.1007/s10694-020-00986-y
He LJ, Gong XL, Zhang SR, Wang LJ, Li F (2021) Efficient attention based deep fusion CNN for smoke detection in fog environment. Neurocomputing 434:224–238. https://doi.org/10.1016/j.neucom.2021.01.024
Jadon A, Omama M, Varshney A, Ansari MS, Sharma R (2019) Firenet: a specialized lightweight fire & smoke detection model for real-time iot applications, CVPR (cs.CV) (May 2019). https://arxiv.org/abs/1905.11922.
Li CH, Yang B, Ding H, Shi HL, Jiang XP, Sun J (2020) Real-time video-based smoke detection with high accuracy and efficiency. Fire Saf J 117:103184. https://doi.org/10.1016/j.firesaf.2020.103184
Nguyen VT, Quach CH, Pham MT (2020) Video smoke detection for surveillance cameras based on deep learning in indoor environment. In: 2020 4th International Conference on Recent Advances in Signal Processing, Telecommunications Computing (SigTelCom), pp. 82–86. https://doi.org/10.1109/SigTelCom49868.2020.9199056.
Piccinini P, Calderara S, Cucchiara R (2008) Reliable smoke detection in the domains of image energy and color. In: 2008 15th IEEE International Conference on Image Processing, pp. 1376–1379. https://doi.org/10.1109/AVSS.2013.6636667.
Prema CE, Vinsley SS, Suresh S (2016) Multi feature analysis of smoke in YUV color space for early forest fire detection. Fire Technol 52(5):1319–1342. https://doi.org/10.1007/s10694-016-0580-8
Savci MM, Yildirim Y, Saygili G, Toreyin BU (2019) Fire detection in h.264 compressed video. ICASSP 2019:8310–8314. https://doi.org/10.1109/ICASSP.2019.8683666
Sousa JVR, Gamboa PV (2020) Aerial forest fire detection and monitoring using a small UAV. KEG 5:242–256 https://doi.org/10.18502/keg.v5i6.7038.
Wang SD, He YP, Yang HY, Wang KX, Wang J (2017) Video smoke detection using shape, color, and dynamic features. J Intell Fuzzy Syst 33:305–313. https://doi.org/10.3233/JIFS-161605
Wang SW, Yu F, Zhou CL, Jiang MH (2020) Straw burning detection method based on improved frame difference method and deep learning. IEEE ICIVC pp. 29–33. https://doi.org/10.1109/ICIVC50857.2020.9177456.
Wu XH, Cao YC, Lu XB, Leung H (2021) Patchwise dictionary learning for video forest fire smoke detection in wavelet domain. Neural Comput Appl. https://doi.org/10.1007/s00521-020-05541-y
Xia X, Yuan FN, Zhang L, Yang LZ, Shi JT (2019) From traditional methods to deep ones: review of visual smoke recognition, detection, and segmentation. Int J Image Graph 24(10):1627–1647. https://doi.org/10.11834/jig.190230.
Xu G, Zhang YM, Zhang QX, Lin GH, Wang Z, Jia Y, Wang JJ (2019) Video smoke detection based on deep saliency network. Fire Saf J 105:277–285. https://doi.org/10.1016/j.firesaf.2019.03.004
Ye W, Zhao JH, Wang S, Wang Y, Zhang DY, Yuan ZY (2015) Dynamic texture-based smoke detection using surfacelet transform and HMT model. Fire Saf J 73:91–101. https://doi.org/10.1016/j.firesaf.2015.03.001
Ye SP, Bai ZC, Chen HF, Bohush R, Ablameyko S (2017) An effective algorithm to detect both smoke and flame using color and wavelet analysis. Pattern Recognit Image Anal 27(1):131–138. https://doi.org/10.1134/S1054661817010138
Yuan FN, Fang ZJ, Wu SQ, Yang Y, Fang YM (2015) Real-time image smoke detection using staircase searching-based dual threshold AdaBoost and dynamic analysis. IET Image Process 9(10):849–856. https://doi.org/10.1049/iet-ipr.2014.1032
Yuan C, Liu ZX, Zhang YM (2017a) Aerial images-based forest fire detection for firefighting using optical remote sensing techniques and unmanned aerial vehicles. J Intell Robot Syst 88(2–4):635–654. https://doi.org/10.1007/s10846-016-0464-7
Yuan FN, Xia X, Shi JT, Li HD, Li G (2017b) Non-linear dimensionality reduction and Gaussian process-based classification method for smoke detection. IEEE Access 5:6833–6841. https://doi.org/10.1109/ACCESS.2017.2697408
Yuan C, Liu ZX, Zhang YM (2018) Learning-based smoke detection for unmanned aerial vehicles applied to forest fire surveillance. J Intell Robot Syst 93(1–2):337–349. https://doi.org/10.1007/s10846-018-0803-y
Zhang TY, Suen CY (1984) A fast parallel algorithm for thinning digital patterns. Commun ACM27 (3):236–239. https://doi.org/10.1145/357994.358023.
Zhao YQ, Zhou Z, Xu MM (2015) Forest fire smoke video detection using spatiotemporal and dynamic texture features. JECE 2015:1–7. https://doi.org/10.1155/2015/706187
Zhao N, Wang XW, Yin SL (2021) Research of fire smoke detection algorithm based on video. IJEIJ 13:1–9. https://doi.org/10.6636/IJEIE.202103_13(1).01
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Project funding: The work was supported by the National Natural Science Foundation of China (grants no. 32171797 and 31800549).
The online version is available at http://www.springerlink.com.
Corresponding editor: Yu Lei.
Rights and permissions
About this article
Cite this article
Lou, L., Chen, F., Cheng, P. et al. Smoke root detection from video sequences based on multi-feature fusion. J. For. Res. 33, 1841–1856 (2022). https://doi.org/10.1007/s11676-022-01461-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11676-022-01461-w