3D Reconstruction and Semantic Segmentation Method Combining PointNet and 3D-LMNet from Single Image

Hui Chen; Yong Tong; Li Zhu; Weibin Liang

doi:10.3788/LOP202259.1815010

[1] Tong S, Xu X G, Yi C T et al. Overview on vision-based 3D reconstruction[J]. Application Research of Computers, 28, 2411-2417(2011).

[2] Zheng Y P, Li G Y, Li Y. Survey of application of deep learning in image recognition[J]. Computer Engineering and Applications, 55, 20-36(2019).

[3] Yang B, Zhong J Y. Review of convolution neural network[J]. Journal of University of South China (Science and Technology), 30, 66-72(2016).

[4] Chen J, Zhang Y Q, Song P et al. Application of deep learning to 3D object reconstruction from a single image[J]. Acta Automatica Sinica, 45, 657-668(2019).

[5] Dong P H, Ke L J. Overview of 3D reconstruction techniques based on images[J]. Radio Communications Technology, 45, 115-119(2019).

[6] Choy C B, Xu D F, Gwak J et al. 3D-R2N2: a unified approach for single and multi-view 3D object reconstruction[M]. Leibe B, Matas J, Sebe N, et al. Computer vision-ECCV 2016. Lecture notes in computer science, 9912, 628-644(2016).

[7] Wu J J, Wang Y F, Xue T F et al. Marrnet: 3D shape reconstruction via 2.5 D sketches[EB/OL]. https://arxiv.org/abs/1711.03129

[8] Girdhar R, Fouhey D F, Rodriguez M et al. Learning a predictable and generative vector representation for objects[M]. Leibe B, Matas J, Sebe N, et al. Computer vision-ECCV 2016. Lecture notes in computer science, 9910, 484-499(2016).

[9] Fan H Q, Su H, Guibas L. A point set generation network for 3D object reconstruction from a single image[C], 2463-2471(2017).

[10] Mandikal P, Navaneet K L, Agarwal M et al. 3D-LMNet: latent embedding matching for accurate and diverse 3D point cloud reconstruction from a single image[EB/OL]. https://arxiv.org/abs/1807.07796

[11] Charles R Q, Hao S, Mo K C et al. PointNet: deep learning on point sets for 3D classification and segmentation[C], 77-85(2017).

[12] Charles R Q, Yi L, Su H et al. PointNet++: deep hierarchical feature learning on point sets in a metric space[EB/OL]. https://arxiv.org/abs/1706.02413

[13] Zhu Y Z, Zhang Y P, Feng Q S. Colorful 3D reconstruction from single image based on deep learning[J]. Laser & Optoelectronics Progress, 58, 1410010(2021).

[14] Zhang A W, Liu L L, Zhang X Z. Multi-feature 3D road point cloud semantic segmentation method based on convolutional neural network[J]. Chinese Journal of Lasers, 47, 0410001(2020).

[15] Hu T, Li W H, Qin X X. Semantic segmentation of polarimetric synthetic aperture radar images based on multi-layer deep feature fusion[J]. Chinese Journal of Lasers, 46, 0210001(2019).

[16] Xu C, Wang L. Image semantic segmentation method based on improved DeepLabv3+ network[J]. Laser & Optoelectronics Progress, 1610008(2021).

[17] Bao H L, Wan M, Liu Z X et al. Real-time semantic segmentation network based on regional self-attention[J]. Laser & Optoelectronics Progress, 58, 0810018(2021).

[18] Song S R, Yu F, Zeng A et al. Semantic scene completion from a single depth image[C], 190-198(2017).

[19] Rubner Y, Tomasi C, Guibas L J. A metric for distributions with applications to image databases[C], 59-66(1998).

[20] Chang A X, Funkhouser T, Guibas L et al. ShapeNet: an information-rich 3D model repository[EB/OL]. https://arxiv.org/abs/1512.03012