• Laser & Optoelectronics Progress
  • Vol. 59, Issue 18, 1810012 (2022)
Hanbing Qu and Zhentang Jia*
Author Affiliations
  • College of Electronics and Information Engineering, Shanghai University of Electric Power, Shanghai 200090, China
  • show less
    DOI: 10.3788/LOP202259.1810012 Cite this Article Set citation alerts
    Hanbing Qu, Zhentang Jia. Lightweight and High-Resolution Human Pose Estimation Method[J]. Laser & Optoelectronics Progress, 2022, 59(18): 1810012 Copy Citation Text show less
    Network structure
    Fig. 1. Network structure
    DenseNet
    Fig. 2. DenseNet
    Improved dense network module. (a) Residual unit; (b) dense cell
    Fig. 3. Improved dense network module. (a) Residual unit; (b) dense cell
    Comparison of fusion methods. (a) Final fusion method of original HRNet; (b) improved final fusion method
    Fig. 4. Comparison of fusion methods. (a) Final fusion method of original HRNet; (b) improved final fusion method
    Model training loss function curve. (a) First stage loss value; (b) second stage loss value
    Fig. 5. Model training loss function curve. (a) First stage loss value; (b) second stage loss value
    Comparison of prediction accuracy of various parts of different methods
    Fig. 6. Comparison of prediction accuracy of various parts of different methods
    Validation results. (a) Key parts overlap detection map;(b) obstacle occlusion detection map;(c) multi-person detection map
    Fig. 7. Validation results. (a) Key parts overlap detection map;(b) obstacle occlusion detection map;(c) multi-person detection map
    Sample analysis of insufficient model performance
    Fig. 8. Sample analysis of insufficient model performance
    Serial numberNameSerial numberName
    0Nose9Right knee
    1Neck10Right ankle
    2Right shoulder11Left hip
    3Right elbow12Left knee
    4Right wrist13Left ankle
    5Left shoulder14Right eye
    6Left elbow15Left eye
    7Left wrist16Right ear
    8Right crotch17Left ear
    Table 1. Key points in COCO dataset
    Method#Params /MBGFLOPsModel size /MBAP /%AP50 /%AP75 /%APL /%APM /%
    CPN27.06.2314.068.6
    SimpleBaseline‐5034.09.0129.070.488.678.367.177.2
    SimpleBaseline‐10153.012.4202.071.489.379.368.178.1
    HRNetV128.516.0109.474.992.582.871.380.9
    HigherHRNet28.647.9109.866.487.572.861.274.2
    HRNet28.57.1109.074.490.581.970.881.0
    Proposed method10.16.530.674.892.683.272.277.7
    Table 2. Validation and comparison of different methods under COCO dataset
    MethodHeadShoulderElbowWristCrotchLapAnkleMean
    DeeperCut2197.294.587.382.486.281.777.286.6
    SimpleBaseline‐5096.495.389.083.288.484.079.688.5
    SimpleBaseline‐10196.995.989.584.488.484.580.789.1
    HRNet97.195.990.386.489.187.183.390.3
    Proposed method97.895.490.183.988.587.282.888.9
    Table 3. Comparison of different methods under MPII dataset
    Model#Params /MBAP /%
    HRNet28.574.4
    Proposed(A)9.873.6
    Proposed(B)10.174.8
    Table 4. Ablation experiment under COCO validation dataset
    ModelTraining time /hSingle image detection time /msAccuracy (PCK) /%
    CPMs131106.385.5
    HRNet5452.290.3
    Proposed model4524.088.9
    Table 5. Speed real-time comparison
    Hanbing Qu, Zhentang Jia. Lightweight and High-Resolution Human Pose Estimation Method[J]. Laser & Optoelectronics Progress, 2022, 59(18): 1810012
    Download Citation