• Laser & Optoelectronics Progress
  • Vol. 56, Issue 7, 071505 (2019)
Youwen Huang, Chaolun Wan*, and Heng Feng
Author Affiliations
  • School of Information Engineering, Jiangxi University of Science and Technology, Ganzhou, Jiangxi 341000, China
  • show less
    DOI: 10.3788/LOP56.071505 Cite this Article Set citation alerts
    Youwen Huang, Chaolun Wan, Heng Feng. Multi-Feature Fusion Human Behavior Recognition Algorithm Based on Convolutional Neural Network and Long Short Term Memory Neural Network[J]. Laser & Optoelectronics Progress, 2019, 56(7): 071505 Copy Citation Text show less
    System block diagram
    Fig. 1. System block diagram
    CNN and parameters of each layer
    Fig. 2. CNN and parameters of each layer
    CNN hidden layer dimension and vectorization
    Fig. 3. CNN hidden layer dimension and vectorization
    Schematic of proposed LSTM model
    Fig. 4. Schematic of proposed LSTM model
    Network structure of model
    Fig. 5. Network structure of model
    KTH data training accuracy
    Fig. 6. KTH data training accuracy
    Recognition ratio of different weight ratios
    Fig. 7. Recognition ratio of different weight ratios
    AlgorithmAccuracy /%
    Method in Ref. [4]93.7
    Method in Ref. [3]90.2
    Method in Ref. [13]90.2
    Method in Ref. [14]93.7
    Model without concat93.3
    Proposed method94.2
    Table 1. Comparison of accuracy of different algorithms on KTH dataset
    AlgorithmAccuracy /%
    Method in Ref. [18]88.0
    Method in Ref. [19]88.4
    Proposed method88.89
    Table 2. Comparison of accuracy of different algorithms on UCF Sports dataset
    Actual classificationModel prediction
    WalkingJoggingRunningBoxingHand wavingHand clapping
    Walking0.950.050.000.000.000.00
    Jogging0.100.850.050.000.000.00
    Running0.000.100.900.000.000.00
    Boxing0.000.000.001.000.000.00
    Hand waving0.000.000.000.001.000.00
    Hand clapping0.000.000.000.000.050.95
    Table 3. Behavior recognition confusion matrix based on KTH dataset
    Youwen Huang, Chaolun Wan, Heng Feng. Multi-Feature Fusion Human Behavior Recognition Algorithm Based on Convolutional Neural Network and Long Short Term Memory Neural Network[J]. Laser & Optoelectronics Progress, 2019, 56(7): 071505
    Download Citation