Lightweight Facial Expression Recognition Method Based on Convolutional Attention

Pengbo Yin; Weimin Pan; Haijun Zhang

doi:10.3788/LOP202158.1210023

[1] Tian Y I, Kanade T, Cohn J F. Recognizing action units for facial expression analysis[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23, 97-115(2001).

[2] Won C. Recognition of facial emotion using multi-scale LBP[J]. Journal of Korea Multimedia Society, 17, 1383-1392(2014). http://www.dbpia.co.kr/Journal/ArticleDetail/NODE06071197

[3] Zhang H Y, Wang H S. Double-channel facial expression recognition based on local binary pattern and gradient features[J]. Laser & Optoelectronics Progress, 57, 141005(2020).

[4] Chu J H, Tang W H, Zhang S et al. An attention model-based facial expression recognition algorithm[J]. Laser & Optoelectronics Progress, 57, 121015(2020).

[5] Yang X, Shang Z H. Facial expression recognition based on improved AlexNet[J]. Laser & Optoelectronics Progress, 57, 141026(2020).

[6] Chen W D, Hu H F. Joint prominent expression feature regions in auxiliary task learning network for facial expression recognition[J]. Electronics Letters, 55, 22-24(2019).

[7] Ding H, Sricharan K, Chellappa R. Exprgan: facial expression editing with controllable expression intensity[EB/OL]. (2017-09-12)[2020-08-25]. https://arxiv.org/abs/1709.03842v1

[8] Ding H, Zhou S K, Chellappa R. FaceNet2ExpNet: regularizing a deep face recognition net for expression recognition[C]. //2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017), May 30-June 3, 2017, Washington, DC, USA, 118-126(2017).

[9] Barsoum E, Zhang C, Ferrer C C et al. Training deep networks for facial expression recognition with crowd-sourced label distribution[EB/OL]. (2016-09-24)[2020-08-23]. https://arxiv.org/1608.01041

[10] Szegedy C, Vanhoucke V, Ioffe S et al. Rethinking the inception architecture for computer vision[C]. //2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA., 2818-2826(2016).

[11] Ekman P, Friesen W V. A technique for the measurement of facial action[J]. Facial Action Coding System (FACS), 13, 102-108(1978). http://ci.nii.ac.jp/naid/10012554953

[12] Woo S, Park J, Lee J Y et al. CBAM: convolutional block attention module[M]. //Ferrari V, Hebert M, Sminchisescu C, et al. Computer vision-ECCV 2018. Lecture notes in computer science, 11211, 3-19(2018).

[13] Barros P, Churamani N, Sciutti A. The FaceChannel: a light-weight deep neural network for facial expression recognition[C]. //2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), November 16-20, 2020, Buenos Aires, Argentina, 652-656(2020).

[14] Cao Q, Shen L, Xie W D et al. VGGFace2: a dataset for recognising faces across pose and age[C]. //2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018), May 15-19, 2018, Xi'an, China, 67-74(2018).

[15] Mollahosseini A, Chan D, Mahoor M H. Going deeper in facial expression recognition using deep neural networks[C]. //2016 IEEE Winter Conference on Applications of Computer Vision (WACV), March 7-10, 2016, Lake Placid, NY, USA., 1-10(2016).

[16] Zeng G H, Zhou J C, Jia X et al. Hand-crafted feature guided deep learning for facial expression recognition[C]. //2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018), May 15-19, 2018, Xi'an, China., 423-430(2018).

[17] Ming Z H, Chazalon J, Luqman M M et al. FaceLiveNet: end-to-end networks combining face verification with interactive facial expression-based liveness detection[C]. //2018 24th International Conference on Pattern Recognition (ICPR), August 20-24, 2018, Beijing, China, 3507-3512(2018).

[18] Miao S, Xu H Y, Han Z Q et al. Recognizing facial expressions using a shallow convolutional neural network[J]. IEEE Access, 7, 78000-78011(2019). http://ieeexplore.ieee.org/document/8731927

[19] Kang J, Li S Y. Facial expression recognition based on attention mechanism of convolutional neural network[J]. Journal of Shaanxi University of Science & Technology, 38, 159-165, 171(2020).

[20] Siqueira H, Magg S, Wermter S. Efficient facial feature learning with wide ensemble-based convolutional neural networks[J]. Proceedings of the AAAI Conference on Artificial Intelligence, 34, 5800-5809(2020). http://arxiv.org/abs/2001.06338v1

[21] Li M, Xu H, Huang X C et al. Facial expression recognition with identity and emotion joint learning[J]. IEEE Transactions on Affective Computing, 14, 1-9(2018). http://ieeexplore.ieee.org/document/8528894/