Depth Estimation from Single-Frame Fringe Projection Patterns Based on R2U-Net

Mengkai Yuan; Xinjun Zhu; Linpeng Hou

doi:10.3788/LOP202259.1610001

[1] Lu R S, Shi Y Q, Hu H B. Review of three-dimensional imaging techniques for robotic vision[J]. Laser & Optoelectronics Progress, 57, 040001(2020).

[2] Zhang Q C, Su X Y. Research progress of dynamic three-dimensional shape measurement[J]. Laser & Optoelectronics Progress, 50, 010001(2013).

[3] Yang F, Ding X J, Cao J. 3D reconstruction of free-form surface based on color structured light[J]. Acta Optica Sinica, 41, 0212001(2021).

[4] Zuo C, Zhang X L, Hu Y et al. Has 3D finally come of age?: an introduction to 3D structured-light sensor[J]. Infrared and Laser Engineering, 49, 0303001(2020).

[5] Guo W B, Zhang Q C, Wu Z J. Real-time three-dimensional imaging technique based on phase-shift fringe analysis: a review[J]. Laser & Optoelectronics Progress, 58, 0800001(2021).

[6] Su X Y, Zhang Q C, Chen W J. Three-dimensional imaging based on structured illumination[J]. Chinese Journal of Lasers, 41, 0209001(2014).

[7] Feng J Y, Chen H Y, Shi C et al. Three-dimensional measurement of highly-reflective surface using structured light technique[J]. Laser & Optoelectronics Progress, 56, 221202(2019).

[8] Feng S J, Zuo C, Yin W et al. Application of deep learning technology to fringe projection 3D imaging[J]. Infrared and Laser Engineering, 49, 0303018(2020).

[9] Zhu X J, Deng Y H, Tang C et al. Variational mode decomposition for phase retrieval in fringe projection 3D shape measurement[J]. Optics and Precision Engineering, 24, 2318-2324(2016).

[10] Wang L, Han X, Fu Y J et al. Fast phase unwrapping algorithm for 3D measurement[J]. Journal of Applied Optics, 40, 271-277(2019).

[11] Liu D, Lei Z K, Jiang H et al. Anti-noise phase-shift coding unwrapping method in fringe projection profilometry[J]. Acta Optica Sinica, 40, 2312002(2020).

[12] Zuo C, Feng S J, Huang L et al. Phase shifting algorithms for fringe projection profilometry: a review[J]. Optics and Lasers in Engineering, 109, 23-59(2018).

[13] Zhang S. Absolute phase retrieval methods for digital fringe projection profilometry: a review[J]. Optics and Lasers in Engineering, 107, 28-37(2018).

[14] Peng G Z, Chen W J. Fringe pattern inpainting based on convolutional neural network denoising regularization[J]. Acta Optica Sinica, 40, 1810002(2020).

[15] Zheng Y, Wang S D, Li Q et al. Fringe projection profilometry by conducting deep learning from its digital twin[J]. Optics Express, 28, 36568-36583(2020).

[16] Shi J S, Zhu X J, Wang H Y et al. Label enhanced and patch based deep learning for phase retrieval from single frame fringe pattern in fringe projection 3D measurement[J]. Optics Express, 27, 28929-28943(2019).

[17] Qian J M, Feng S J, Tao T Y et al. Deep-learning-enabled geometric constraints and phase unwrapping for single-shot absolute 3D shape measurement[J]. APL Photonics, 5, 046105(2020).

[18] Zhang J C, Tian X B, Shao J B et al. Phase unwrapping in optical metrology via denoised and convolutional segmentation networks[J]. Optics Express, 27, 14903-14912(2019).

[19] Feng S J, Chen Q, Gu G H et al. Fringe pattern analysis using deep learning[J]. Advanced Photonics, 1, 025001(2019).

[20] Spoorthi G E, Gorthi R K S S, Gorthi S. PhaseNet 2.0: phase unwrapping of noisy data based on deep learning approach[J]. IEEE Transactions on Image Processing, 29, 4862-4872(2020).

[21] Spoorthi G E, Gorthi S, Gorthi R K S S. PhaseNet: a deep convolutional neural network for two-dimensional phase unwrapping[J]. IEEE Signal Processing Letters, 26, 54-58(2019).

[22] Zhang Z, Han B W, Yu H T et al. Multi-stage deep learning based single-frame fringe projection 3D measurement method[J]. Infrared and Laser Engineering, 49, 20200023(2020).

[23] Nguyen H, Wang Y Z, Wang Z Y. Single-shot 3D shape reconstruction using structured light and deep convolutional neural networks[J]. Sensors, 20, 3718(2020).

[24] Machineni R C, Spoorthi G E, Vengala K S et al. End-to-end deep learning-based fringe projection framework for 3D profiling of objects[J]. Computer Vision and Image Understanding, 199, 103023(2020).

[25] Alom M Z, Yakopcic C, Taha T M et al. Nuclei segmentation with recurrent residual convolutional neural networks based U-net (R2U-net)[C], 228-233(2018).

[26] Yin Y K, Zhang Z H, Liu X L et al. Review of the system model and calibration for fringe projection profilometry[J]. Infrared and Laser Engineering, 49, 0303008(2020).

[27] Zhao W J, Chen W J, Su X Y. The comparison of several time phase unwrapping methods[J]. Journal of Sichuan University (Natural Science Edition), 53, 110-117(2016).

[28] Liang M, Hu X L. Recurrent convolutional neural network for object recognition[C], 3367-3375(2015).

[29] Song X B, Li W, Zhou D F et al. MLDA-net: multi-level dual attention-based network for self-supervised monocular depth estimation[J]. IEEE Transactions on Image Processing, 30, 4691-4705(2021).