• Acta Optica Sinica
  • Vol. 41, Issue 17, 1712001 (2021)
Haihua Cui1、*, Tao Jiang1, Kunpeng Du2, Ronghui Guo1, and An′an Zhao2
Author Affiliations
  • 1College of Mechanical and Electrical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu 210016, China
  • 2AVIC Xi′an Aircraft Industry Group Co., Ltd., Xi′an, Shaanxi 710089, China
  • show less
    DOI: 10.3788/AOS202141.1712001 Cite this Article Set citation alerts
    Haihua Cui, Tao Jiang, Kunpeng Du, Ronghui Guo, An′an Zhao. 3D Imaging Method for Multi-View Structured Light Measurement Via Deep Learning Pose Estimation[J]. Acta Optica Sinica, 2021, 41(17): 1712001 Copy Citation Text show less
    Proposed data alignment strategy for multi-view structured light measurement
    Fig. 1. Proposed data alignment strategy for multi-view structured light measurement
    Pose estimation based on YOLO network
    Fig. 2. Pose estimation based on YOLO network
    Experimental results. (a) Setup; (b) training loss and testing accuracy; (c) translation and rotation error; (d) true pose determination; (e) pose estimation visualization
    Fig. 3. Experimental results. (a) Setup; (b) training loss and testing accuracy; (c) translation and rotation error; (d) true pose determination; (e) pose estimation visualization
    More cases presentation of object pose estimation. (a) Sphere; (b) pyramid; (c) pillars; (d) elbow
    Fig. 4. More cases presentation of object pose estimation. (a) Sphere; (b) pyramid; (c) pillars; (d) elbow
    Single-view structured light reconstruction based on the proposed system. (a) Projection image; (b) wrapping phase; (c) absolute phase; (d) 3D point cloud
    Fig. 5. Single-view structured light reconstruction based on the proposed system. (a) Projection image; (b) wrapping phase; (c) absolute phase; (d) 3D point cloud
    Point cloud splicing using estimated pose. (a)(d) Projection images in two views; (b)(e) pose estimation results; (c)(f) point clouds in two views; (g) data splicing result; (h) zoom-in view of box in Fig. (g)
    Fig. 6. Point cloud splicing using estimated pose. (a)(d) Projection images in two views; (b)(e) pose estimation results; (c)(f) point clouds in two views; (g) data splicing result; (h) zoom-in view of box in Fig. (g)
    Data registration with estimated pose. (a)(d)Two-view registration of pillars and recess, with deep learning-based pose estimation; (b)(e) global refinement using ICP algorithm based on rough rigid transformation; (c)(f) error distributions of the final registration of fused data in Figs. (b), (e) and CAD model, where the error is determined by the point-to-model distance
    Fig. 7. Data registration with estimated pose. (a)(d)Two-view registration of pillars and recess, with deep learning-based pose estimation; (b)(e) global refinement using ICP algorithm based on rough rigid transformation; (c)(f) error distributions of the final registration of fused data in Figs. (b), (e) and CAD model, where the error is determined by the point-to-model distance
    ObjectSpherePyramidPillarsElbow
    Mean re-projectingerror /pixel2.5260.8461.7533.216
    Translationerror /mm3.5411.8973.0195.187
    Angle error /(°)0.850.420.551.05
    Table 1. Error computation of pose estimation
    ObjectSpherePyramidPillars
    Pose estimation /mm0.0650.0580.067
    Coded marker /mm0.0440.0380.046
    Error /mm0.0210.0200.023
    Table 2. Error comparison of data fusion using markers and deep learning
    Haihua Cui, Tao Jiang, Kunpeng Du, Ronghui Guo, An′an Zhao. 3D Imaging Method for Multi-View Structured Light Measurement Via Deep Learning Pose Estimation[J]. Acta Optica Sinica, 2021, 41(17): 1712001
    Download Citation