• Laser & Optoelectronics Progress
  • Vol. 55, Issue 1, 11002 (2018)
Wang Linlin1、*, Liu Jinghao1, and Fu Xiaomei2
Author Affiliations
  • 1School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China
  • 2School of Marine Science and Technology, Tianjin University, Tianjin 300072, China
  • show less
    DOI: 10.3788/LOP55.011002 Cite this Article Set citation alerts
    Wang Linlin, Liu Jinghao, Fu Xiaomei. Facial Expression Recognition Based on Fusion of Local Features and Deep Belief Network[J]. Laser & Optoelectronics Progress, 2018, 55(1): 11002 Copy Citation Text show less
    Log-Gabor magnitude features of local facial expression image
    Fig. 1. Log-Gabor magnitude features of local facial expression image
    Second-order HOG features of local facial expression image
    Fig. 2. Second-order HOG features of local facial expression image
    Structure of DBN
    Fig. 3. Structure of DBN
    Flowchart of facial expression recognition based on fusion of local features and DBN
    Fig. 4. Flowchart of facial expression recognition based on fusion of local features and DBN
    Sample images. (a) JAFFE database; (b) CK database; (c) CK+ database
    Fig. 5. Sample images. (a) JAFFE database; (b) CK database; (c) CK+ database
    Examples of facial expression database image preprocessing. (a) JAFFE database; (b) CK database; (c) CK+ database
    Fig. 6. Examples of facial expression database image preprocessing. (a) JAFFE database; (b) CK database; (c) CK+ database
    Expression recognition rate of DBN with different RBM layers
    Fig. 7. Expression recognition rate of DBN with different RBM layers
    Database1 RBMlayer2 RBMlayers3 RBMlayers4 RBMlayers
    JAFFE344.86228.90265.38711.62
    CK337.76402.75537.88669.64
    CK+369.32461.98542.23743.40
    Table 1. Training and recognition time of DBN with different RBM layers
    FeatureJAFFEdatabaseCKdatabaseCK+database
    Gabor87.9690.2088.42
    Log-Gabor93.5294.7793.29
    HOG85.1988.2486.83
    Secondorder HOG92.5994.1292.68
    Log-Gabor+Second order HOG96.3097.3995.73
    Table 2. Recognition rate based on different features
    AlgorithmJAFFEdatabaseCKdatabaseCK+database
    KNN75.0078.4377.44
    SVM82.4183.0181.10
    DBN96.3097.3995.73
    Table 3. Recognition rate of different algorithms%
    MethodRecognition rate /%
    PHOG+LBP+SVM[24]87.43
    Local Gabor+RFLD+KNN[25]89.67
    LDN+SVM[26]90.60
    HOG+bagging ELM[27]94.37
    Proposed method96.30
    Table 4. Comparison of recognition rate of different methods on JAFFE database
    MethodRecognition rate /%
    Local Gabor+RFLD+KNN[25]91.51
    LBP+MTSL[28]91.53
    CLBP+SVM[29]94.20
    GLDPE[30]97.08
    Proposed method97.39
    Table 5. Comparison of recognition rate of different methods on CK database
    MethodRecognitionrate /%
    Geometric features+LBP+SVM[31]90.08
    HOG+DBN+Gabor+SAE[19]91.11
    PHOG+LBP+SVM[24]94.63
    Boosted DBN[20]96.70
    Proposed method95.73
    Table 6. Comparison of recognition rate of different methods on CK+ database
    Wang Linlin, Liu Jinghao, Fu Xiaomei. Facial Expression Recognition Based on Fusion of Local Features and Deep Belief Network[J]. Laser & Optoelectronics Progress, 2018, 55(1): 11002
    Download Citation