• Laser & Optoelectronics Progress
  • Vol. 58, Issue 22, 2215001 (2021)
Bin Yang, Xiao Yun*, Kaiwen Dong, Xixiang Liu, and Han Huang
Author Affiliations
  • School of Information and Control Engineering, China University of Mining and Technology, Xuzhou, Jiangsu 221116, China
  • show less
    DOI: 10.3788/LOP202158.2215001 Cite this Article Set citation alerts
    Bin Yang, Xiao Yun, Kaiwen Dong, Xixiang Liu, Han Huang. Human’s Dangerous Action Recognition in Petrochemical Scene Using Machine Vision[J]. Laser & Optoelectronics Progress, 2021, 58(22): 2215001 Copy Citation Text show less
    Method for identifying dangerous actions of personnel in petrochemical scenes based on machine vision
    Fig. 1. Method for identifying dangerous actions of personnel in petrochemical scenes based on machine vision
    Process of skeleton-based human action recognition
    Fig. 2. Process of skeleton-based human action recognition
    Skeleton-based human action recognition network
    Fig. 3. Skeleton-based human action recognition network
    Judgment method of the spatial position relationship between human and cell phone
    Fig. 4. Judgment method of the spatial position relationship between human and cell phone
    Judgment result of the spatial position relationship between human and cell phone
    Fig. 5. Judgment result of the spatial position relationship between human and cell phone
    Example of cell phone call action data set
    Fig. 6. Example of cell phone call action data set
    Loss value and accuracy rate
    Fig. 7. Loss value and accuracy rate
    Test result
    Fig. 8. Test result
    Confusion matrix (only skeleton information)
    Fig. 9. Confusion matrix (only skeleton information)
    Confusion matrix (adding object detection)
    Fig. 10. Confusion matrix (adding object detection)
    Experimental results of simulated petrochemical scene
    Fig. 11. Experimental results of simulated petrochemical scene
    Experimental results of actual petrochemical scene
    Fig. 12. Experimental results of actual petrochemical scene
    Examples of smoking action data set
    Fig. 13. Examples of smoking action data set
    Results of smoking action recognition
    Fig. 14. Results of smoking action recognition
    Action No.Action label
    0walking
    1walking_suspected_calling
    2walking_and_calling
    Table 1. Initial action categories
    Action labelRecall /%Precision /%
    walking98.0795.50
    walking_suspected_calling71.4775.90
    walking_and_calling74.5170.66
    Table 2. Action recognition results (before adding the object detection module)
    Action labelRecall /%Precision /%
    walking98.0796.58
    walking_suspected_calling99.2185.78
    walking_and_calling81.9299.18
    Table 3. Action recognition results (after adding the object detection module)
    Bin Yang, Xiao Yun, Kaiwen Dong, Xixiang Liu, Han Huang. Human’s Dangerous Action Recognition in Petrochemical Scene Using Machine Vision[J]. Laser & Optoelectronics Progress, 2021, 58(22): 2215001
    Download Citation