Colorful 3D Reconstruction from Single Image Based on Deep Learning

Yuzheng Zhu; Yaping Zhang; Qiaosheng Feng

doi:10.3788/LOP202158.1410010

[1] Pang Z Y, Zhou Z F, Wang L D et al. Improved three-dimensional reconstruction algorithm for point cloud data[J]. Laser & Optoelectronics Progress, 57, 021102(2020).

[2] Zhang Z J, Cheng X J, Cao Y J et al. Application of 3D reconstruction of relic sites combined with laser and vision point cloud[J]. Chinese Journal of Lasers, 47, 1110001(2020).

[3] Natsume R, Saito S, Huang Z et al. SiCloPe: silhouette-based clothed people[C]. //2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 15-20, 2019, Long Beach, CA, USA, 4475-4485(2019).

[4] Loper M, Mahmood N, Romero J et al. SMPL: a skinned multi-person linear model[J]. ACM transactions on graphics, 34, 248(2015).

[5] Chen J, Zhang Y Q, Song P et al. Application of deep learning to 3D object reconstruction from a single image[J]. Acta Automatica Sinica, 45, 657-668(2019).

[6] Wu Z R, Song S R, Khosla A et al. 3D ShapeNets: a deep representation for volumetric shapes[C]. //2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA, 1912-1920(2015).

[7] Hinton G E, Salakhutdinov R R. Reducing the dimensionality of data with neural networks[J]. Science, 313, 504-507(2006). http://dx.doi.org/10.1126/science.1127647

[8] Choy C B, Xu D F, Gwak J et al. 3D-R2N2: a unified approach for single and multi-view 3D object reconstruction[M]. //Leibe B, Matas J, Sebe N, et al. Computer vision-ECCV 2016. Lecture notes in computer science, 9912, 628-644(2016).

[9] Wu J, Wang Y, Xue T et al. Marrnet: 3D shape reconstruction via 2.5 D sketches[C]. //Advances in Neural Information Processing Systems, December 4-9, 2017, Long Beach, CA, USA, 540-550(2017).

[10] Kato H, Ushiku Y, Harada T. Neural 3D mesh renderer[EB/OL]. (2017-11-20)[2020-10-09]. https://arxiv.org/abs/1711.07566v1

[11] Sun Y, Liu Z, Wang Y et al. Im2avatar: colorful 3d reconstruction from a single image[EB/OL]. (2018-04-17)[2020-10-09]. https://arxiv.org/abs/1804.06375

[12] Kanazawa A, Tulsiani S, Efros A A et al. Learning category-specific mesh reconstruction from image collections[M]. //Ferrari V, Hebert M, Sminchisescu C, et al. Computer vision - ECCV 2018. Lecture notes in computer science, 11219, 371-386(2018).

[13] Zhou T H, Tulsiani S, Sun W L et al. View synthesis by appearance flow[M]. //Leibe B, Matas J, Sebe N, et al. Computer vision-ECCV 2016. Lecture notes in computer science, 9908, 286-301(2016).

[14] Liu S C, Chen W K, Li T Y et al. Soft rasterizer: a differentiable renderer for image-based 3D reasoning[C]. //2019 IEEE/CVF International Conference on Computer Vision (ICCV), October 27-November 2, 2019, Seoul, Korea, 7707-7716(2019).

[15] Wang N Y, Zhang Y D, Li Z W et al. Pixel2Mesh: generating 3D mesh models from single RGB images[C]. //Ferrari V, Hebert M, Sminchisescu C, et al. Computer vision-ECCV 2018. Lecture notes in computer science, 11211, 3-19(2018).

[16] Kato H, Harada T. Learning view priors for single-view 3D reconstruction[C]. //2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 15-20, 2019, Long Beach, CA, USA., 9770-9779(2019).

[17] Woo S, Park J, Lee J Y et al. CBAM: convolutional block attention module[M]. // Leibe B, Matas J, Sebe N, et al. Computer vision-ECCV 2016. Lecture notes in computer science, 9908, 3-19(2016).

[18] Hu J, Shen L, Sun G. Squeeze-and-excitation networks[C]. //2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 18-23, 2018, Salt Lake City, UT, USA., 7132-7141(2018).

[19] Mescheder L, Oechsle M, Niemeyer M et al. Occupancy networks: learning 3D reconstruction in function space[C]. //2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 15-20, 2019, Long Beach, CA, USA, 4455-4465(2019).

[20] Fan H Q, Su H, Guibas L. A point set generation network for 3D object reconstruction from a single image[C]. //2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 21-26, 2017, Honolulu, HI, USA., 2463-2471(2017).