• Laser & Optoelectronics Progress
  • Vol. 58, Issue 4, 0400003 (2021)
Changyou Chen and Jiansheng Yang*
Author Affiliations
  • College of Electrical Engineering, Guizhou University, Guiyang, Guizhou 550025, China
  • show less
    DOI: 10.3788/LOP202158.0400003 Cite this Article Set citation alerts
    Changyou Chen, Jiansheng Yang. Review on Smoke Detection Algorithms for Video Images[J]. Laser & Optoelectronics Progress, 2021, 58(4): 0400003 Copy Citation Text show less
    References

    [1] Xiang X B. Research on smoke detection algorithm based on video[D]. Hangzhou: Zhejiang University(2017).

    [2] Xiao X, Kong F Z, Liu J H. Monitoring video fire detection algorithm based on dynamic characteristics and static characteristics[J]. Computer Science, 46, 284-286, 299(2019).

    [3] Uğur TÖreyin B. DedeoğluY, Enis Çetin A. Wavelet based real-time smoke detection in video. [C] ∥ 2005 13th European Signal Processing Conference, September 4-8, 2005,Antalya, Turkey. New York: IEEE, 15037050(2005).

    [4] Zhou B L, Song Y L, Yu M H. Fire smoke detection algorithm based on image disposal[J]. Fire Science and Technology, 35, 390-393(2016).

    [5] Wang L, Li A G. Early fire recognition based on multi-feature fusion of video smoke. [C]∥2017 36th Chinese Control Conference (CCC), July 26-28, 2017, Dalian, China. New York: IEEE, 5318-5323(2017).

    [6] Hu Y C, Lu X B. Real-time video fire smoke detection by utilizing spatial-temporal ConvNet features[J]. Multimedia Tools and Applications, 77, 29283-29301(2018).

    [7] Cao J T, Qin Y Y, Ji X F. Review on video based flame detection algorithm[J]. Journal of Data Acquisition and Processing, 35, 35-52(2020).

    [8] James M. Flame and smoke estimation for fire detection in videos based on optical flow and neural networks[J]. International Journal of Research in Engineering and Technology, 3, 324-328(2014). http://www.researchgate.net/publication/273301137_FLAME_AND_SMOKE_ESTIMATION_FOR_FIRE_DETECTION_IN_VIDEOS_BASED_ON_OPTICAL_FLOW_AND_NEURAL_NETWORKS

    [9] Agrawal S, Panda R, Bhuyan S et al. Tsallis entropy based optimal multilevel thresholding using cuckoo search algorithm[J]. Swarm and Evolutionary Computation, 11, 16-30(2013).

    [10] Bhandari A K, Singh V K, Kumar A et al. Cuckoo search algorithm and wind driven optimization based study of satellite image segmentation for multilevel thresholding using Kapur's entropy[J]. Expert Systems with Applications, 41, 3538-3560(2014).

    [11] Bhandari A K, Singh N, Kumar I V. Lightning search algorithm-based contextually fused multilevel image segmentation[J]. Applied Soft Computing, 91, 106243(2020). http://www.sciencedirect.com/science/article/pii/S1568494620301836

    [12] Zhang S M, Tang Z M. The research of color image segmentation algorithm based on HIS color space[J]. Journal of China West Normal University (Natural Sciences), 33, 304-307(2012).

    [13] Chmelar P, Benkrid A. Efficiency of HSV over RGB Gaussian mixture model for fire detection. [C]∥2014 24th International Conference Radioelektronika, April 15-16, 2014, Bratislava, Slovakia. New York: IEEE, 1-4(2014).

    [14] Appana D K, Islam R, Khan S A et al[J]. spatial-temporal energy analyses for alarm systems. Information Sciences, 418/419, 91-101(2017).

    [15] Emmy Prema C, Vinsley S S, Suresh S. Multi feature analysis of smoke in YUV color space for early forest fire detection[J]. Fire Technology, 52, 1319-1342(2016).

    [16] Zhang D D, Zhang G, Chen X J et al. Flame identification algorithm based on improved multi-feature fusion of YCbCr and region growth[J]. Laser & Optoelectronics Progress, 57, 061022(2020).

    [17] Zhao Z M, Zhu Z L, Liu Y J et al. Fuzzy C-means clustering algorithm for image segmentation insensitive to cluster size[J]. Laser & Optoelectronics Progress, 57, 021001(2020).

    [18] Tian H D, Li W Q, Wang L et al. A novel video-based smoke detection method using image separation. [C]∥2012 IEEE International Conference on Multimedia and Expo, July 9-13, 2012, Melbourne, VIC, Australia. New York: IEEE, 532-537(2012).

    [19] Wei W, Wu Q. Moving target detection algorithm based on improved Gaussian mixture modeling and three-frame differencing[J]. Computer Engineering and Design, 35, 949-352(2014).

    [20] Yu C Y, Mei Z B, Zhang X. A real-time video fire flame and smoke detection algorithm[J]. Procedia Engineering, 62, 891-898(2013). http://www.sciencedirect.com/science/article/pii/S1877705813013222

    [21] Chen H Y, Cui Y J, Li S et al. An improved GMM-based algorithm with optimal multi-color subspaces for color difference classification of solar cells[J]. IEEE Transactions on Semiconductor Manufacturing, 31, 503-513(2018). http://ieeexplore.ieee.org/document/8447240/

    [22] Murgia J, Meurie C, Ruichek Y. An improved colorimetric invariants and RGB-depth-based codebook model for background subtraction using Kinect[M]. ∥ Gelbukh A, Espinoza F C, Galicia-Haro S N. Human-inspired computing and its applications. MICAI 2014. Lecture notes in computer science. Cham: Springer, 8856, 380-392(2014).

    [23] Huang W, Liu L, Yue C et al. The moving target detection algorithm based on the improved visual background extraction[J]. Infrared Physics & Technology, 71, 518-525(2015).

    [24] Yang T, Guan H Y. Algorithm of smoke detection based on the frame of high frequency energy and correlation[J]. Microcomputer & Its Applications, 34, 32-35(2015).

    [25] Ma Y J, Chen M L, Liu P P et al. ViBe algorithm-based ghost suppression method[J]. Laser & Optoelectronics Progress, 57, 021007(2020).

    [26] Pundir A S, Raman B. Deep belief network for smoke detection[J]. Fire Technology, 53, 1943-1960(2017). http://link.springer.com/10.1007/s10694-017-0665-z

    [27] Cheng Y H[J]. Wang J. A motion image detection method based on the inter-frame difference method. Applied Mechanics, Materials, 490/491, 1283-1286(2014).

    [28] Yu C Y, Fang J, Wang J J et al. Video fire smoke detection using motion and color features[J]. Fire Technology, 46, 651-663(2010).

    [29] Liu K, Liu X, Chang L P et al. Video smoke detection based on YUV color space and multiple feature fusion[J]. Chinese Journal of Sensors and Actuators, 32, 237-243(2019).

    [30] Wu X, Lu X, Leung H. A video based fire smoke detection using robust AdaBoost[J]. Sensors, 18, 3780(2018). http://www.ncbi.nlm.nih.gov/pubmed/30400645

    [31] Hu X L[M]. Digital image processing(2011).

    [32] Zhang D F[M]. Digital image processing(MATLAB edition)(2015).

    [33] Chiranjeevi P, Sengupta S. Moving object detection in the presence of dynamic backgrounds using intensity and textural features[J]. Journal of Electronic Imaging, 20, 043009(2011).

    [34] Yuan F N. Video-based smoke detection with histogram sequence of LBP and LBPV Pyramids[J]. Fire Safety Journal, 46, 132-139(2011).

    [35] Li J H, Fan R X, Chen Z B. Forest fire recognition based on color and texture features[J]. Journal of South China University of Technology (Natural Science Edition), 48, 70-83(2020).

    [36] Zhao Y, Jia W, Hu R X et al. Completed robust local binary pattern for texture classification[J]. Neurocomputing, 106, 68-76(2013). http://www.sciencedirect.com/science/article/pii/S0925231212008545

    [37] Zhang Y J, Shao M L. Video smoke detection based on wavelet texture features[J]. Optical Technique, 39, 0348(2013). http://en.cnki.com.cn/Article_en/CJFDTOTAL-GXJS201304014.htm

    [38] Liu C, Zheng H, Li X et al. A method of moving vehicle detection in all-weather based on melted multi-channel HOG feature[J]. Geomatics and Information Science of Wuhan University, 40, 1048-1053(2015).

    [39] Wang Y, Li M, Zhang C X et al. Weighted-fusion feature of MB-LBPUH and HOG for facial expression recognition[J]. Soft Computing, 24, 5859-5875(2020).

    [40] Qiu J J. The research on forest fire smoke detection algorithm based on feature fusion[D]. Qinhuangdao: Yanshan University(2016).

    [41] Peng Y S, Wang Y. Real-time forest smoke detection using hand-designed features and deep learning[J]. Computers and Electronics in Agriculture, 167, 105029(2019). http://www.sciencedirect.com/science/article/pii/S016816991931419X

    [42] Luo S, Yan C W, Wu K L et al. Smoke detection based on condensed image[J]. Fire Safety Journal, 75, 23-35(2015).

    [43] Yin M X, Wang L, Sun L Y. Adaptive smoke detection algorithm based on multi-feature fusion[J]. Building Science, 35, 26-31(2019).

    [44] Cai M, Lu X B, Wu X H et al. Intelligent video analysis-based forest fires smoke detection algorithms. [C]∥2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD), August 13-15, 2016, Changsha, China. New York: IEEE, 1504-1508(2016).

    [45] Wang H F, Zhang Y, Fan X. Rapid early fire smoke detection system using slope fitting in video image histogram[J]. Fire Technology, 56, 695-714(2020). http://link.springer.com/article/10.1007/s10694-019-00899-5

    [46] Li J, Yuan W, Zeng Y et al. A modified method of video-based smoke detection for transportation hub complex[J]. Procedia Engineering, 62, 940-945(2013). http://www.sciencedirect.com/science/article/pii/S1877705813013283

    [47] Deng L. Study on video smoke detection algorithm[D]. Chengdu: University of Electronic Science and Technology of China(2015).

    [48] Lee C, Lin C, Hong C et al. Smoke detection using spatial and temporal analyses[J]. International Journal of Innovative Computing Information and Control, 8, 4749(2012).

    [49] Calderara S, Piccinini P, Cucchiara R. Vision based smoke detection system using image energy and color information[J]. Machine Vision and Applications, 22, 705-719(2011).

    [50] Wang T, Liu Y, Xie Z P. A new video smoke detection method based on wave analysis[J]. Electronics and Information Journal, 33, 1024-1029(2011).

    [51] Muhammad Z S, Tjokorda A. Budi Wirayuda et al. Early Smoke detection on video using wavelet energy[J]. Journal on Computing, 2, 2460-9056(2017). http://www.researchgate.net/publication/321169910_Early_Smoke_Detection_on_Video_Using_Wavelet_Energy/download

    [52] Yuan F N. A fast accumulative motion orientation model based on integral image for video smoke detection[J]. Pattern Recognition Letters, 29, 925-932(2008).

    [53] Hu Y C, Lu X B. Real-time video fire smoke detection by utilizing spatial-temporal ConvNet features[J]. Multimedia Tools and Applications, 77, 29283-29301(2018).

    [54] Gubbi J, Marusic S, Palaniswami M. Smoke detection in video using wavelets and support vector machines[J]. Fire Safety Journal, 44, 1110-1115(2009). http://www.sciencedirect.com/science/article/pii/S0379711209001155

    [55] Xu Z G, Xu J L. Automatic fire smoke detection based on image visual features. [C]∥2007 International Conference on Computational Intelligence and Security Workshops (CISW 2007), December 15-19, 2007, Heilongjiang, China. New York: IEEE, 316-319(2007).

    [56] Cui Y, Dong H, Zhou E Z. An early fire detection method based on smoke texture analysis and discrimination. [C]∥2008 Congress on Image and Signal Processing, May 27-30, 2008, Sanya, Hainan, China. New York: IEEE, 95-99(2008).

    [57] Srisuwan T, Ruchanurucks M. Smoke detection using GLCM, wavelet, and motion[J]. Proceedings of SPIE, 9069, 90691H(2014).

    [58] Tung T X, Kim J M. An effective four-stage smoke-detection algorithm using video images for early fire-alarm systems[J]. Fire Safety Journal, 46, 276-282(2011).

    [59] Chen J Z, space-time analysis[EB/OL]. -10-07)[2020-05-13]. https:∥arxiv., org/abs/1310, 1855(2013).

    [60] Wang Y B. Smoke recognition based on machine vision. [C]∥2016 International Symposium on Computer, Consumer and Control (IS3C), July 4-6, 2016, Xi'an, China. New York: IEEE, 668-671(2016).

    [61] Ye W, Zhao JH, Wang S et al. Dynamic texture based smoke detection using surfacelet transform and HMT model[J]. Fire Safety Journal, 73, 91-101(2015).

    [62] Freund Y, Schapire R E. A decision-theoretic generalization of on-line learning and an application to boosting[J]. Journal of Computer and System Sciences, 55, 119-139(1997). http://dl.acm.org/citation.cfm?id=712093

    [63] Yuan F N. A double mapping framework for extraction of shape-invariant features based on multi-scale partitions with AdaBoost for video smoke detection[J]. Pattern Recognition, 45, 4326-4336(2012).

    [64] Maruta H, Iida Y, Kurokawa F. Smoke detection method using Local Binary Patterns and AdaBoost. [C]∥2013 IEEE International Symposium on Industrial Electronics, May 28-31, 2013, Taipei, Taiwan, China. New York: IEEE, 1-6(2013).

    [65] Zhao Y Q, Li Q J, Gu Z. Early smoke detection of forest fire video using CS Adaboost algorithm[J]. Optik - International Journal for Light and Electron Optics, 126, 2121-2124(2015).

    [66] Xie Z P, Wang T, Liu Y. New video smoke detection method using Bayesian decision[J]. Computer Engineering and Applications, 50, 173-176(2014).

    [67] Chen K, Li Y H, You F et al[J]. Smoke detection algorithm about video image with multiple features based on serial and parallel processing model Computer and Modernization, 2017, 1-6, 22.

    [68] Xu G, Zhang Y M, Zhang Q X et al. Deep domain adaptation based video smoke detection using synthetic smoke images[J]. Fire Safety Journal, 93, 53-59(2017). http://www.sciencedirect.com/science/article/pii/S0379711217302436

    [69] Yao L S, Xu G M, Zhao F. Facial expression recognition based on local feature fusion of convolutional neural network[J]. Laser & Optoelectronics Progress, 57, 041513(2020).

    [70] Zhao L. Research of fire smoke detection algorithm based on video[D]. Quanzhou: Huaqiao University(2017).

    [71] Krizhevsky A, Hinton G[2020-05-13]. Convolutional deep belief networks on cifar-10 [2020-05-13].https:∥www.cs.toronto.edu/~kriz/conv-cifar10-aug2010.pdf..

    [72] Krizhevsky A, Sutskever I, Hinton G E. ImageNet classification with deep convolutional neural networks[J]. Communications of the ACM, 60, 84-90(2017).

    [73] Zeiler M D, Fergus R. Visualizing and understanding convolutional networks[M]. ∥ Fleet D, Pajdla T, Schiele B, et al. Computer Vision - ECCV 2014. Lecture Notes in Computer Science.Cham: Springer, 8689, 818-833(2014).

    [74] Szegedy C, Liu W, Jia Y et al. Going deeper with convolutions. [C]∥2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA. New York: IEEE, 1-9(2015).

    [75] Simonyan K. -09-04)[2020-05-13]. https:∥arxiv., org/abs/1409, 1556(2014).

    [76] He K M, Zhang X Y, Ren S Q et al. Deep residual learning for image recognition. [C]∥2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA. New York: IEEE, 770-778(2016).

    [77] Xu G, Zhang Y M, Zhang Q X et al. Video smoke detection based on deep saliency network[J]. Fire Safety Journal, 105, 277-285(2019). http://www.sciencedirect.com/science/article/pii/s0379711218302741

    [78] Liang M, Hu X L. Recurrent convolutional neural network for object recognition. [C]∥2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA. New York: IEEE, 3367-3375(2015).

    [79] Feng L J, Wang H Q, Wang K. Fire smoke recognition by convolutional neural network based on targetregion[J]. Laser & Optoelectronics Progress, 57, 161004(2020).

    [80] Cao S Y, Liu Y H, Li X Z. Vehicle detection method based on fast R-CNN[J]. Journal of Image and Graphics, 22, 671-677(2017).

    [81] Ren S Q, He K M, Girshick R et al. Faster R-CNN:towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39, 1137-1149(2017).

    [82] Li X, Shi B B, Liu Y et al. Multi-target recognition method based on improved YOLOv2 model[J]. Laser & Optoelectronics Progress, 57, 101010(2020).

    [83] Redmon J, Farhadi A.YOLO9000: better. -12-25)[2020-05-13]. https:∥arxiv., org/abs/1612, 08242(2016).

    [84] Redmon J, Divvala S, Girshick R et al. You only look once: unified, real-time object detection. [C]∥2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA. New York: IEEE, 779-788(2016).

    [85] Du C X, Yan Y Y, Liu Y A et al. Video fire detection method based on YOLOv2[J]. Computer Science, 46, 301-304(2019).

    [86] Liu X P, Li Y Q, Liu L et al. Improved YOLOV3 target recognition algorithm with embedded SENet structure[J]. Computer Engineering, 45, 243-248(2019).

    [87] Cheng S H, Ma J Y, Zhang S J et al[J]. Smoke detection algorithm combined with improved Gaussian mixture and YOLOv2 Acta Metrologica Sinica, 2019, 798-803.

    [88] Tan W, Zhou B, Zhang H et al. Research on real-time vehicle detection algorithm based on SSD[J]. Computer & Digital Engineering, 47, 2763-2766(2019).

    [89] Yin Z J, Wan B Y, Yuan F N et al. A deep normalization and convolutional neural network for image smoke detection[J]. IEEE Access, 5, 18429-18438(2017). http://ieeexplore.ieee.org/document/8022860

    [90] Lin G H, Zhang Y M, Xu G et al. Smoke detection on video sequences using 3D convolutional neural networks[J]. Fire Technology, 55, 1827-1847(2019). http://link.springer.com/article/10.1007/s10694-019-00832-w

    [91] Tao C Y, Zhang J, Wang P. Smoke detection based on deep convolutional neural networks. [C]∥2016 International Conference on Industrial Informatics - Computing Technology, Intelligent Technology, Industrial Information Integration (ICIICII), December 3-4, 2016, Wuhan, China. New York: IE, 150-153(2016).

    [92] Dung N M, Kim D, Ro S. A video smoke detection algorithm based on cascade classification and deep learning[J]. KSII Transactions on Internet and Information Systems, 12, 6018-6033(2018). http://www.researchgate.net/publication/330365740_A_Video_Smoke_Detection_Algorithm_Based_on_Cascade_Classification_and_Deep_Learning

    [93] Wan B Y. Study on smoke detection algorithm based on deep learning[D]. Nanchang: Jiangxi Science and Technology Normal University(2018).

    [94] Feng J X, Li H, Liu Z G. New flame color space: IFCS[J]. Computer Engineering and Applications, 55, 203-210, 264(2019).

    [95] He L F, Huang S W. An efficient krill herd algorithm for color image multilevel thresholding segmentation problem[J]. Applied Soft Computing, 89, 106063(2020). http://dl.acm.org/doi/abs/10.1016/j.asoc.2020.106063

    Changyou Chen, Jiansheng Yang. Review on Smoke Detection Algorithms for Video Images[J]. Laser & Optoelectronics Progress, 2021, 58(4): 0400003
    Download Citation