Dual-modality Emotion Recognition Model Based on Temporal-spatial LBP Moment and Dempster-Shafer Evidence Fusion

WANG Xiaohua; HOU Dengyong; HU Min; REN Fuji; WANG Jiayong

doi:10.3969/j.issn.1003-501x.2016.12.024

[1] ZHANG Wei，ZHANG Youmei，MA Lin，et al. Multimodal learning for facial expression recognition [J]. Pattern Recognition(S0031-3203)，2015，48(10)：3191-3202.

[2] Valstar Michel，JIANG Bihan，Mehu Marc，et al. The first facial expression recognition and analysis challenge [C]// 2011 IEEE International Conference on Automatic Face & Gesture Recognition and Workshops，Santa Barbara，CA，Mar 21-25，2011，31：921-926.

[3] Ou Jun，BAI Xiaobo，PEI Yun，et al. Automatic Facial Expression Recognition Using Gabor Filter and Expression Analysis [C]// ICCMS '10. Second International Conference on Computer Modeling and Simulation，Sanya，Hainan，Jan 22-24， 2010，2：215-218.

[4] CHEN Shizhi，TIAN Yingli，LIU Qingshan，et al. Recognizing expressions from face and body gesture by temporal normalized motion and appearance features [J]. Image & Vision Computing(S0262-8856)，2013，31(2)：175-185.

[5] Ayadi M E，Kamel M S，Karray F. Survey on speech emotion recognition：Features，classification schemes，and databases [J]. Pattern Recognition(S0031-3203)，2011，44(3)：572-587.

[6] Pardas M，Bonafonte A. Facial animation parameters extraction and expression recognition using Hidden Markov Models [J]. Signal Processing Image Communication(S0923-5965)，2002，17(9)：675-688.

[7] Camurri A，Lagerl f I，Volpe G. Recognizing emotion from dance movement：comparison of spectator recognition and automated techniques [J]. International Journal of Human-Computer Studies(S1071-5819)，2003，59(1/2)：213-225.

[8] YAN Jingjie，ZHENG Wenming，XIN Minghai，et al. Bimodal emotion recognition based on body gesture and facial expression [J]. Journal of Image & Graphics(S1793-6756)，2013，18(9)：1101-1106.

[9] Gunes H，Piccardi M. A bimodal Face and Body Gesture Database for Automatic Analysis of Human Nonverbal Affective Behavior [C]// International Conference on Pattern Recognition，Hong Kong，China，Aug 20-24，2006，1：1148-1153.

[10] Gunes H，Piccardi M. Bi-modal emotion recognition from expressive face and body gestures [J]. Journal of Network & Computer Applications(S1084-8045)，2007，30(4)：1334–1345.

[11] Gunes H，Piccardi M. Fusing face and body gesture for machine recognition of emotions [C]// IEEE International Workshop on Robot and Human Interactive Communication，Roman，Aug 13-15，2005：306-311.

[12] Hatice G，Massimo P. Automatic temporal segment detection and affect recognition from face and body display [J]. IEEE Transactions on Systems Man & Cybernetics Part B Cybernetics A Publication of the IEEE Systems Man & Cybernetics Society(S2168-2216)，2009，39(1)：64-84.

[13] HU Min，XU Yanxia，WANG Xiaohua，et al. Facial expression recognition based on AWCLBP [J]. Journal of Image and Graphics，2013，18(10)：1279-1284.

[14] ZHAO Guoying，Pietikainen Matti. Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions [J]. IEEE Transactions on Pattern Analysis & Machine Intelligence(S1939-3539)，2007，29(6)：915-928.

[15] SANG Qinbing，LI Zhaofeng，WU Xiaojun. No-Reference Blurred Image Quality Assessment Based on Gray Level Co-occurrence Matrix [J]. Pattern Recognition and Artificial Intelligence，2013，25(05)：492-497.

[16] LI Xianfeng，ZHU Weixing，KONG Lindong，et al. Method of Multi-feature Fusion Based on SVM and D- S Evidence Theory in Weed Recognition [J]. Transactions of the Chinese Society for Agricultural Machinery，2012，42(11)：164-168.

[17] WANG Xiaohua，JIN Chao，REN Fuji，et al. Research on facial expression recognition based on pyramid Weber local descriptor and the Dempster-Shafer theory of evidence [J]. Journal of Image and Graphics，2014，19(9)：1297-1305.