• Laser & Optoelectronics Progress
  • Vol. 59, Issue 4, 0415006 (2022)
Fuhong Zhu1, Cailin Li1、2、*, Baoyun Guo1, Zhiyong Wang1, and Xiangcan Liao1
Author Affiliations
  • 1School of Civil and Architectural Engineering, Shandong University of Technology, Zibo , Shandong 255049, China
  • 2Key Laboratory of Geospatial Technology for the Middle and Lower Yellow River Regions, Ministry of Education, Henan University, Kaifeng , Henan 475001, China
  • show less
    DOI: 10.3788/LOP202259.0415006 Cite this Article Set citation alerts
    Fuhong Zhu, Cailin Li, Baoyun Guo, Zhiyong Wang, Xiangcan Liao. Digital Restoration Method of Sculpture Face Based on Deep Learning[J]. Laser & Optoelectronics Progress, 2022, 59(4): 0415006 Copy Citation Text show less
    Recovery process
    Fig. 1. Recovery process
    Relationship between voxel discretization degree and error
    Fig. 2. Relationship between voxel discretization degree and error
    Network structure that outputs 3D voxel models after 2D images are input into the deep learning network
    Fig. 3. Network structure that outputs 3D voxel models after 2D images are input into the deep learning network
    Registration fusion process between image point cloud and laser point cloud
    Fig. 4. Registration fusion process between image point cloud and laser point cloud
    Facial missing laser point cloud. (a) Newton statue; (b) Madame Curie statue
    Fig. 5. Facial missing laser point cloud. (a) Newton statue; (b) Madame Curie statue
    Facial image point cloud generated by the pre-training network compared with the facial image point cloud generated by 3DDFA-V2 network and facial laser point cloud.(a) (f) Point cloud images; (b) (g) point cloud front; (c) (h) point cloud right; (d) (i) 3DDFA-V2 point cloud right; (e) (j) laser point cloud
    Fig. 6. Facial image point cloud generated by the pre-training network compared with the facial image point cloud generated by 3DDFA-V2 network and facial laser point cloud.(a) (f) Point cloud images; (b) (g) point cloud front; (c) (h) point cloud right; (d) (i) 3DDFA-V2 point cloud right; (e) (j) laser point cloud
    Effect comparison of the recovery model obtained by proposed method.(a) (d) Simulation of facial damage model; (b) (e) facial restoration model; (c) (f) three-dimensional model before facial damage
    Fig. 7. Effect comparison of the recovery model obtained by proposed method.(a) (d) Simulation of facial damage model; (b) (e) facial restoration model; (c) (f) three-dimensional model before facial damage
    Effect comparison between the proposed method and the symmetry restoration model.(a) (d) Restoration model of the proposed method; (b) (e) restoration model front based on symmetry; (c) (f) restoration model side based on symmetry
    Fig. 8. Effect comparison between the proposed method and the symmetry restoration model.(a) (d) Restoration model of the proposed method; (b) (e) restoration model front based on symmetry; (c) (f) restoration model side based on symmetry
    Visualization results of distance between points with the same name.(a) (c) Visualization results of homonymous point distance between 3D point cloud and laser point cloud generated from single statue face image; (b) (d) visualization results of homonymous point distance between statue face point cloud and laser point cloud after symmetry repair
    Fig. 9. Visualization results of distance between points with the same name.(a) (c) Visualization results of homonymous point distance between 3D point cloud and laser point cloud generated from single statue face image; (b) (d) visualization results of homonymous point distance between statue face point cloud and laser point cloud after symmetry repair
    ConditionStatue of NewtonStatue of Madame Curie
    Image generation point cloud0.8100.903
    Point cloud restored by symmetry method1.2031.259
    Table 1. Average distance of homonymous point
    Fuhong Zhu, Cailin Li, Baoyun Guo, Zhiyong Wang, Xiangcan Liao. Digital Restoration Method of Sculpture Face Based on Deep Learning[J]. Laser & Optoelectronics Progress, 2022, 59(4): 0415006
    Download Citation