• Acta Optica Sinica
  • Vol. 40, Issue 4, 0410001 (2020)
Shuo Huang1、2、3, Yong Hu1、2、*, Cailan Gong1、2, Hongyi Bo1、4, Geng Gu4, Qi Xu4, and Wei Wang4
Author Affiliations
  • 1Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, China
  • 2Key Laboratory of Infrared System Detection and Imaging Technology, Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, China
  • 3University of Chinese Academy of Sciences, Beijing 100049, China
  • 4Jiaxing Opto-Electronic Engineering Center, Chinese Academy of Sciences, Jiaxing, Zhejiang 314022, China
  • show less
    DOI: 10.3788/AOS202040.0410001 Cite this Article Set citation alerts
    Shuo Huang, Yong Hu, Cailan Gong, Hongyi Bo, Geng Gu, Qi Xu, Wei Wang. High Precision Three-Dimensional Face Reconstruction Algorithm Based on Gradient Light Image[J]. Acta Optica Sinica, 2020, 40(4): 0410001 Copy Citation Text show less
    Flowchart of 3D face reconstruction
    Fig. 1. Flowchart of 3D face reconstruction
    Results of reflected light separation. (a) Vertically polarized image; (b) parallel polarized image; (c) specular reflection image
    Fig. 2. Results of reflected light separation. (a) Vertically polarized image; (b) parallel polarized image; (c) specular reflection image
    Gradient light images in different directions. (a) Along the X direction; (b) along the -X direction; (c) along the Y direction; (d) along the -Y direction; (e) along the Z direction; (f) all light
    Fig. 3. Gradient light images in different directions. (a) Along the X direction; (b) along the -X direction; (c) along the Y direction; (d) along the -Y direction; (e) along the Z direction; (f) all light
    Normal mapping principle
    Fig. 4. Normal mapping principle
    Image acquisition device. (a) Shooting device; (b) relative position of the cameras
    Fig. 5. Image acquisition device. (a) Shooting device; (b) relative position of the cameras
    Experiment of specular reflection and diffuse reflection separation
    Fig. 6. Experiment of specular reflection and diffuse reflection separation
    Results of normal map fusion. (a) Diffuse reflection normal map; (b) specular reflection normal map; (c) fusion normal map
    Fig. 7. Results of normal map fusion. (a) Diffuse reflection normal map; (b) specular reflection normal map; (c) fusion normal map
    Comparison of normal map reconstruction with different fusion modes. (a) Low precision model; (b) reconstruction with 2∶1 fusion ratio; (c) reconstruction with 5×5 high-pass filtering and 1∶1 fusion ratio; (d) reconstruction with 5×5 high-pass filtering and 2∶1 fusion ratio; (e) reconstruction with 7×7 high-pass filtering and 1∶1 fusion ratio; (f) reconstruction with 7×7 high-pass filtering and 2∶1 fusion ratio
    Fig. 8. Comparison of normal map reconstruction with different fusion modes. (a) Low precision model; (b) reconstruction with 2∶1 fusion ratio; (c) reconstruction with 5×5 high-pass filtering and 1∶1 fusion ratio; (d) reconstruction with 5×5 high-pass filtering and 2∶1 fusion ratio; (e) reconstruction with 7×7 high-pass filtering and 1∶1 fusion ratio; (f) reconstruction with 7×7 high-pass filtering and 2∶1 fusion ratio
    Multi-view images. (a) Multi-view images; (b) multi-view normal maps
    Fig. 9. Multi-view images. (a) Multi-view images; (b) multi-view normal maps
    Results of fine 3D face reconstruction
    Fig. 10. Results of fine 3D face reconstruction
    Comparison of the render of highprecision model and normal map model. (a) Model1; (b) model2; (c) model3; (d) rendering of model1; (e) rendering of model2; (f) rendering of model3
    Fig. 11. Comparison of the render of highprecision model and normal map model. (a) Model1; (b) model2; (c) model3; (d) rendering of model1; (e) rendering of model2; (f) rendering of model3
    ParameterModel1Model2Model3
    Poly3000101010272102
    Point150660507481075
    Table 1. Parameters of simplified model
    Shuo Huang, Yong Hu, Cailan Gong, Hongyi Bo, Geng Gu, Qi Xu, Wei Wang. High Precision Three-Dimensional Face Reconstruction Algorithm Based on Gradient Light Image[J]. Acta Optica Sinica, 2020, 40(4): 0410001
    Download Citation