• Laser & Optoelectronics Progress
  • Vol. 59, Issue 18, 1815010 (2022)
Hui Chen1、*, Yong Tong1, Li Zhu1, and Weibin Liang2
Author Affiliations
  • 1School of Automation Engineering, Shanghai University of Electric Power, Shanghai 200090, China
  • 2Open AI Lab (Shanghai) Co., Ltd., Shanghai 200233, China
  • show less
    DOI: 10.3788/LOP202259.1815010 Cite this Article Set citation alerts
    Hui Chen, Yong Tong, Li Zhu, Weibin Liang. 3D Reconstruction and Semantic Segmentation Method Combining PointNet and 3D-LMNet from Single Image[J]. Laser & Optoelectronics Progress, 2022, 59(18): 1815010 Copy Citation Text show less
    Flow diagram of network structure
    Fig. 1. Flow diagram of network structure
    Schematic diagram of segmentation loss. (a) Forward loss; (b) backward loss
    Fig. 2. Schematic diagram of segmentation loss. (a) Forward loss; (b) backward loss
    Effect of different a value on CD, EMD and mIoU. (a) CD; (b) EMD; (c) mIoU
    Fig. 3. Effect of different a value on CD, EMD and mIoU. (a) CD; (b) EMD; (c) mIoU
    Qualitative results on airplanes from ShapeNet. (a) Input image; (b) ground truth; (c) 3D-LMNet; (d) 3D-LMNet+PointNet; (e) our model
    Fig. 4. Qualitative results on airplanes from ShapeNet. (a) Input image; (b) ground truth; (c) 3D-LMNet; (d) 3D-LMNet+PointNet; (e) our model
    Qualitative results on cars from ShapeNet. (a) Input image; (b) ground truth; (c) 3D-LMNet; (d) 3D-LMNet+PointNet; (e) our model
    Fig. 5. Qualitative results on cars from ShapeNet. (a) Input image; (b) ground truth; (c) 3D-LMNet; (d) 3D-LMNet+PointNet; (e) our model
    Qualitative results on chairs from ShapeNet. (a) Input image; (b) ground truth; (c) 3D-LMNet; (d) 3D-LMNet+PointNet; (e) our model
    Fig. 6. Qualitative results on chairs from ShapeNet. (a) Input image; (b) ground truth; (c) 3D-LMNet; (d) 3D-LMNet+PointNet; (e) our model
    CategoryMetric3D-LMNet+PointNetOur model
    AirplaneCD3.343.01
    EMD4.774.18
    mIoU62.9871.12
    CarCD4.554.26
    EMD4.103.85
    mIoU60.0161.68
    ChairCD6.415.91
    EMD8.027.83
    mIoU79.1582.03
    MeanCD4.774.39
    EMD5.635.29
    mIoU67.3871.61
    Table 1. Experimental results on ShapeNet
    Hui Chen, Yong Tong, Li Zhu, Weibin Liang. 3D Reconstruction and Semantic Segmentation Method Combining PointNet and 3D-LMNet from Single Image[J]. Laser & Optoelectronics Progress, 2022, 59(18): 1815010
    Download Citation