New Method for Face Landmark Detection Based on Stacked-Hourglass Network

Weichi Zhao; Qijie Zhao; Junye Jiang; Jianxia Lu

doi:10.3788/AOS201939.1115003

[1] Cootes T F, Edwards G J, Taylor C J. Active appearance models[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 23, 681-685(2001).

[2] Cootes T F, Taylor C J, Cooper D H et al. Active shape models-their training and application[J]. Computer Vision and Image Understanding, 61, 38-59(1995).

[3] Dollár P, Welinder P, Perona P. Cascaded pose regression. [C]∥2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, June 13-18, 2010, San Francisco, CA, USA. New York: IEEE, 1078-1085(2010).

[4] Xiong X H, de la Torre F. Supervised descent method and its applications to face alignment. [C]∥2013 IEEE Conference on Computer Vision and Pattern Recognition, June 23-28, 2013, Portland, OR, USA. New York: IEEE, 532-539(2013).

[5] Sun Y, Wang X G, Tang X O. Deep convolutional network cascade for facial point detection. [C]∥2013 IEEE Conference on Computer Vision and Pattern Recognition, June 23-28, 2013, Portland, OR, USA. New York: IEEE, 3476-3483(2013).

[6] Trigeorgis G, Snape P, Nicolaou M A et al. Mnemonic descent method: a recurrent process applied for end-to-end face alignment. [C]∥2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA. New York: IEEE, 4177-4187(2016).

[7] Lü J J, Shao X H, Xing J L et al. A deep regression architecture with two-stage re-initialization for high performance facial landmark detection. [C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 21-26, 2017, Honolulu, HI, USA. New York: IEEE, 3691-3700(2017).

[8] Newell A, Yang K Y, Deng J. Stacked hourglass networks for human pose estimation[M]. ∥Leibe B, Matas J, Sebe N, et al. Computer vision-ECCV 2016. Lecture notes in computer science. Cham: Springer, 9912, 483-499(2016).

[9] Yang J, Liu Q S, Zhang K H. Stacked hourglass network for robust facial landmark localisation. [C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), July 21-26, 2017, Honolulu, HI, USA. New York: IEEE, 2025-2033(2017).

[10] Wu W Y, Qian C, Yang S et al. Look at boundary: a boundary-aware face alignment algorithm. [C]∥2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 18-23, 2018, Salt Lake City, UT, USA. New York: IEEE, 2129-2138(2018).

[11] Shen J, Zafeiriou S, Chrysos G G et al. The first facial landmark tracking in-the-wild challenge: benchmark and results. [C]∥Proceedings of the IEEE International Conference on Computer Vision Workshops, December 11-18, 2015, Santiago, Chile. New York: IEEE, 50-58(2015).

[12] Sagonas C, Tzimiropoulos G, Zafeiriou S et al. 300 faces in-the-wild challenge: the first facial landmark localization challenge. [C]∥2013 IEEE International Conference on Computer Vision Workshops, December 2-8, 2013, Sydney, NSW, Australia. New York: IEEE, 397-403(2013).

[13] Belhumeur P N, Jacobs D W, Kriegman D J et al. Localizing parts of faces using a consensus of exemplars[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 2930-2940(2013). http://ieeexplore.ieee.org/document/6412675/

[14] Le V, Brandt J, Lin Z et al. Interactive facial feature localization[M]. ∥Fitzgibbon A, Lazebnik S, Perona P, et al. Computer vision-ECCV 2012. Lecture notes in computer science. Berlin, Heidelberg: Springer, 7574, 679-692(2012).

[15] Zhu X X, Ramanan D. Face detection, pose estimation, and landmark localization in the wild. [C]∥2012 IEEE Conference on Computer Vision and Pattern Recognition, June 16-21, 2012, Providence, RI, USA. New York: IEEE, 2879-2886(2012).

[16] Jain V. Learned-Miller E G. Fddb: a benchmark for face detection in unconstrained settings[R]. Amherst: UMass Amherst Technical Report(2010).

[17] Köstinger M, Wohlhart P, Roth P M et al. Annotated Facial Landmarks in the Wild: a large-scale, real-world database for facial landmark localization. [C]∥2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), November 6-13, 2011, Barcelona, Spain. New York: IEEE, 2144-2151(2011).

[18] Asthana A, Zafeiriou S, Cheng S Y et al. Robust discriminative response map fitting with constrained local models. [C]∥2013 IEEE Conference on Computer Vision and Pattern Recognition, June 23-28, 2013, Portland, OR, USA. New York: IEEE, 3444-3451(2013).

[19] Zhang J, Shan S G, Kan M N et al. Coarse-to-fine auto-encoder networks (CFAN) for real-time face alignment[M]. ∥Fleet D, Pajdla T, Schiele B, et al. Computer vision-ECCV 2014. Lecture notes in computer science. Cham: Springer, 8690, 1-16(2014).

[20] Cao X D, Wei Y C, Wen F et al. Face alignment by explicit shape regression[J]. International Journal of Computer Vision, 107, 177-190(2014).

[21] Kazemi V, Sullivan J. One millisecond face alignment with an ensemble of regression trees. [C]∥2014 IEEE Conference on Computer Vision and Pattern Recognition, June 23-28, 2014, Columbus, OH, USA. New York: IEEE, 1867-1874(2014).

[22] Ren S Q, Cao X D, Wei Y C et al. Face alignment at 3000 fps via regressing local binary features. [C]∥2014 IEEE Conference on Computer Vision and Pattern Recognition, June 23-28, 2014, Columbus, OH, USA. New York: IEEE, 1685-1692(2014).

[23] Shi B G, Bai X, Liu W Y et al. -09-18)[2019-05-06]. https: ∥arxiv., org/abs/1409, 5230(2014).

[24] Zhu S Z, Li C, Loy C C et al. Face alignment by coarse-to-fine shape searching. [C]∥2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA. New York: IEEE, 4998-5006(2015).

[25] Zhang Z P, Luo P, Loy C C et al. Learning deep representation for face alignment with auxiliary attributes[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 38, 918-930(2016). http://dl.acm.org/citation.cfm?id=2925401

[26] Xiao S T, Feng J S, Xing J L et al. Robust facial landmark detection via recurrent attentive-refinement networks[M]. ∥Leibe B, Matas J, Sebe N, et al. Computer vision-ECCV 2016. Lecture notes in computer science. Cham: Springer, 9905, 57-72(2016).

[27] Kumar A, Chellappa R. Disentangling 3D pose in a dendritic CNN for unconstrained 2D face alignment. [C]∥2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 18-23, 2018, Salt Lake City, UT, USA. New York: IEEE, 430-439(2018).

[28] Dong X Y, Yan Y, Ouyang W L et al. Style aggregated network for facial landmark detection. [C]∥2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 18-23, 2018, Salt Lake City, UT, USA. New York: IEEE, 379-388(2018).

[29] Kowalski M, Naruniec J. Face alignment using K-cluster regression forests with weighted splitting[J]. IEEE Signal Processing Letters, 23, 1567-1571(2016). http://ieeexplore.ieee.org/document/7563868/

[30] Baltrusaitis T, Robinson P, Morency L P. Constrained local neural fields for robust facial landmark detection in the wild. [C]∥2013 IEEE International Conference on Computer Vision Workshops, December 2-8, 2013, Sydney, NSW, Australia. New York: IEEE, 354-361(2013).

[31] Zhou E J, Fan H Q, Cao Z M et al. Extensive facial landmark localization with coarse-to-fine convolutional network cascade. [C]∥2013 IEEE International Conference on Computer Vision Workshops, December 2-8, 2013, Sydney, NSW, Australia. New York: IEEE, 386-391(2013).

[32] Yan J J, Lei Z, Yi D et al. Learn to combine multiple hypotheses for accurate face alignment. [C]∥2013 IEEE International Conference on Computer Vision Workshops, December 2-8, 2013, Sydney, NSW, Australia. New York: IEEE, 392-396(2013).

[33] Zadeh A, Baltrusaitis T, Morency L P. Convolutional experts constrained local model for facial landmark detection. [C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), July 21-26, 2017, Honolulu, HI, USA. New York: IEEE, 2051-2059(2017).

[34] Feng Z H, Kittler J, Awais M et al. Face detection, bounding box aggregation and pose estimation for robust facial landmark localisation in the wild. [C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), July 21-26, 2017, Honolulu, HI, USA. New York: IEEE, 2106-2111(2017).

[35] Shao X H, Xing J L, Lü J et al. Unconstrained face alignment without face detection. [C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), July 21-26, 2017, Honolulu, HI, USA. New York: IEEE, 2069-2077(2017).

[36] Xiao S T, Li J S, Chen Y P et al. 3D-assisted coarse-to-fine extreme-pose facial landmark detection. [C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), July 21-26, 2017, Honolulu, HI, USA. New York: IEEE, 2060-2068(2017).

[37] Chen X, Zhou E J, Mo Y C et al. Delving deep into coarse-to-fine framework for facial landmark localization. [C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), July 21-26, 2017, Honolulu, HI, USA. New York: IEEE, 2088-2095(2017).

[38] Wu W Y, Yang S. Leveraging intra and inter-dataset variations for robust face alignment. [C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), July 21-26, 2017, Honolulu, HI, USA. New York: IEEE, 2096-2105(2017).

[39] He Z L, Zhang J, Kan M N et al. Robust FEC-CNN: a high accuracy facial landmark detection system. [C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), July 21-26, 2017, Honolulu, HI, USA. New York: IEEE, 2044-2050(2017).