Facial Expression Recognition Based on Fusion of Local Features and Deep Belief Network

Wang Linlin; Liu Jinghao; Fu Xiaomei

doi:10.3788/LOP55.011002

[1] Chen J, Takiguchi T, Ariki Y. Facial expression recognition with multithreaded cascade of rotation-invariant HOG[C]. International Conference on Affective Computing and Intelligent Interaction, IEEE, 636-642(2015).

[2] Negri P, Acevedo D, Mejail M et al. Facial expression recognition: A comparison between static and dynamic approaches[C]. International Conference on Pattern Recognition Systems, 1-6(2016).

[3] Liu S S, Tian Y T, Wan C et al. Facial expression recognition method based on Gabor multi-orientation features fusion and block histogram[J]. Acta Automatica Sinica, 37, 1455-1463(2011).

[4] Ye Z, Bai L, Nian Y J. Hyperspectral image classification algorithm based on Gabor feature and locality-preserving dimensionality reduction[J]. Acta Optica Sinica, 36, 1028003(2016).

[5] Liu Y, Wu X J. Image recognition algorithm based on Log-Gabor wavelet and Riemannian manifold learning[J]. Pattern Recognition and Artificial Intelligence, 28, 946-952(2015).

[6] Yuan W Q, Fan Y G, Ke L. Palmprints recognition method based on the phase consistency combined with Log-Gabor filter[J]. Acta Optica Sinica, 30, 147-152(2010).

[7] Liu B, Zhang X, Hu C H et al. Gesture recognition method of hand over face occlusion in color and depth images[J]. Laser & Optoelectronic Progress, 53, 061001(2016).

[8] Cao H, Yamaguchi K. Naito, et al. Pedestrian recognition using second-order HOG feature[C]. 9th Asian Conference on Computer Vision (ACCV 2009), 628-634(2009).

[9] Zhang S H, He H, Kong L F. Fusing multi-feature for video occlusion region detection based on graph cut[J]. Acta Optica Sinica, 35, 0415001(2015).

[10] Liu Y, Li Y, Ma X et al. Facial expression recognition with fusion features extracted from salient facial areas[J]. Sensors, 17, 712(2017). http://europepmc.org/articles/PMC5421672/

[11] Zhao L, Wang Z, Zhang G. Facial expression recognition from video sequences based on spatial-temporal motion local binary pattern and Gabor multiorientation fusion histogram[J]. Mathematical Problems in Engineering, 2017, 1-12(2017). http://www.researchgate.net/publication/313849862_Facial_Expression_Recognition_from_Video_Sequences_Based_on_Spatial-Temporal_Motion_Local_Binary_Pattern_and_Gabor_Multiorientation_Fusion_Histogram

[12] Jia Q, Gao X, Guo H. et al. Multi-layer sparse representation for weighted LBP-patches based facial expression recognition[J]. Sensors, 15, 6719-6739(2015). http://europepmc.org/abstract/med/25808772

[13] Hu M, Jiang H, Wang X H et al. Precise local feature description for facial expression recognition[J]. Journal of Image and Graphics, 19, 1613-1622(2014).

[14] Li Y, Mavadati S M, Mahoor M H. et al. A unified probabilistic framework for measuring the intensity of spontaneous facial action units[C]. IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, 1-7(2013).

[15] Wang Q, Jia K, Liu P. Design and implementation of remote facial expression recognition surveillance system based on PCA and KNN algorithms[C]. International Conference on Intelligent Information Hiding and Multimedia Signal Processing., 314-317(2016).

[16] Siddiqi M H, Ali R, Idris M. et al. Human facial expression recognition using curvelet feature extraction and normalized mutual information feature selection[J]. Multimedia Tools and Applications, 75, 935-959(2016). http://link.springer.com/article/10.1007/s11042-014-2333-3

[17] Liu D W, Han L, Han X Y. High spatial resolution remote sensing image classification based on deep learning[J]. Acta Optica Sinica, 36, 0428001(2016).

[18] Hinton G E, Osindero S, Teh Y W. A fast learning algorithm for deep belief nets[J]. Neural Computation, 18, 1527-1554(2006). http://database.oxfordjournals.org/external-ref?access_num=10.1162/neco.2006.18.7.1527&link_type=DOI

[19] Lv Y, Feng Z, Xu C. Facial expression recognition via deep learning[C]. International Conference on Smart Computing, IEEE, 303-308(2015).

[20] Liu P, Han S, Meng Z et al. Facial expression recognition via a boosted deep belief network[C]. IEEE Conference on Computer Vision and Pattern Recognition, 1805-1812(2014).

[21] Xia J, Pei D, Wang Q Z et al. Face recognition based on local adaptive ternary derivative pattern coupled with Gabor feature[J]. Laser & Optoelectronics Progress, 53, 111004(2016).

[22] Zhang Y, Liao Q Z, Luo Y. Head pose estimation fusing the second order HOG and CS-LBP[J]. CAAI Transactions on Intelligent Systems, 10, 741-746(2015).

[23] Hinton G E. Training products of experts by minimizing contrastive divergence[J]. Neural Computation, 14, 1771-1800(2002). http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=6789337

[24] Happy S L, Routray A. Robust facial expression classification using shape and appearance features[C]. Eighth International Conference on Advances in Pattern Recognition, 1-5(2015).

[25] Gu W, Xiang C, Venkatesh Y V et al. Facial expression recognition using radial encoding of local Gabor features and classifier synthesis[J]. Pattern Recognition, 45, 80-91(2012). http://dl.acm.org/citation.cfm?id=2031205

[26] Rivera A R, Castillo J R, Chae O. Local directional number pattern for face analysis: face and expression recognition[J]. IEEE Transactions on Image Processing, 22, 1740-1752(2013). http://ieeexplore.ieee.org/document/6392271

[27] Ghimire D, Lee J. Extremelearning machine ensemble using bagging for facial expression recognition[J]. Journal of Information Processing Systems, 10, 443-458(2014). http://www.researchgate.net/publication/267569963_Extreme_Learning_Machine_Ensemble_Using_Bagging_for_Facial_Expression_Recognition

[28] Zhong L, Liu Q, Yang P et al. Learning multiscale active facial patches for expression analysis[J]. IEEE Transactions on Cybernetics, 45, 1499-1510(2015). http://dl.acm.org/citation.cfm?id=2354918

[29] Ahmed F, Bari H, Hossain E. Person-independent facial expression recognition based on compound local binary pattern (CLBP)[J]. International Arab Journal of Information Technology, 11, 195-203(2014). http://www.researchgate.net/publication/287561356_Person-Independent_Facial_Expression_Recognition_Based_on_Compound_Local_Binary_Pattern_CLBP

[30] Li Y Q, Li Y J, Li H B et al. Fusion of global and local various feature for facial expression recognition[J]. Atca Optica Sinica, 34, 0515001(2014).

[31] Ghimire D, Jeong S, Yoon S et al. Facial expression recognition based on region specific appearance and geometric features[C]. Tenth International Conference on Digital Information Management, IEEE, 142-147(2016).