Wavelet based deep learning for depth estimation from single fringe pattern of fringe projection profilometry

Xinjun ZHU; Zhiqiang HAN; Limei SONG; Hongyi WANG; Zhichao WU

doi:10.1007/s11801-022-2082-x

[1] GORTHI S S, RASTOGI P. Fringe projection techniques :whether we are?[J]. Optics and lasers in engineering, 2009, 48(2):133-140.

[2] SONG L M, LI X Y, YANG Y G, et al. Structured-light based 3D reconstruction system for cultural relic packaging[J]. Sensors (Basel), 2018, 18(9):2981.

[3] LI B, AN Y, CAPPELLERI D, et al. High-accuracy, high-speed 3D structured light imaging techniques and potential applications to intelligent robotics[J]. International journal of intelligent robotics and applications, 2017, 1(1):86-103.

[4] ZHANG S. Absolute phase retrieval methods for digital fringe projection profilometry:a review[J]. Optics and lasers in engineering, 2018, 107:28-37.

[5] ZUO C, FENG S J, HUANG L, et al. Phase shifting algorithms for fringe projection profilometry:a review[J]. Optics and lasers in engineering, 2018, 109: 23-59.

[6] ZHANG S. High-speed 3D shape measurement with structured light methods:a review [J]. Optics and lasers in engineering, 2019, 106:119-131.

[7] SONG L M, GAO Y, ZHU X J, et al. A 3D measurement method based on multi-view fringe projection by using a turntable[J]. Optoelectronics letters, 2016, 12(6): 389-394.

[8] JI Y, CHEN Y, SONG L M, et al. 3D defect detection of connectors based on structured light[J]. Optoelectronics letters, 2021, 17(2):107-111.

[9] YU H T, HAN B W, BAI L F, et al. Untrained deep learning-based fringe projection profilometry[J]. APL photonics, 2022, 7:016102.

[10] SPOORTHI G E, GORTHI R K S S, GORTHI S. PhaseNet 2.0:phase unwrapping of noisy data based on deep learning approach[J]. IEEE transactions on image processing, 2020, 29:4862-4872.

[11] SAM V D J, JORIS J J D. Deep neural networks for single shot structured light profilometry[J]. Optics express, 2019, 27:17091-17101.

[12] NGUYEN H, WANG Y Z, WANG Z Y. Single-shot 3D shape reconstruction using structured light and deep convolutional neural networks[J]. Sensors, 2020, 20(13):3718.

[13] NGUYEN H, LY K L, TRAN T, et al. hNet:single-shot 3D shape reconstruction using structured light and h-shaped global guidance network[J]. Results in optics, 2021, 4:100104.

[14] YUAN M, ZHU X, HOU L. Depth estimation from single frame fringe projection pattern based on R2U-Net[J]. Laser and optoelectronics progress, 2021: 1-19. (in Chinese)

[15] JIA T, et al. Depth measurement based on a convolutional neural network and structured light[J]. Measurement science and technology, 2022, 33:025202.

[16] WANG L, LU D Q, QIU R W, et al. 3D reconstruction from structured-light profilometry with dual-path hybrid network[J]. Eurasip journal on advances in signal processing, 2022, 2022:14.

[17] HUANG H B, HE R, SUN Z N, et al. Wave-let-SRNet: a wavelet-based CNN for multi-scale face super resolution[C]//Proceedings of 2017 IEEE International Conference on Computer Vision, October 22-29, 2017, Venice, Italy. New York:IEEE, 2017:1698-1706.

[18] XUE S K, QIU W Y, LIU F, et al. Wavelet-based residual attention network for image super-resolution[J]. Neurocomputing, 2020, 382:116-126.

[19] LIU W, YAN Q, ZHAO Y Z. Densely self-guided wavelet network for image denoising[C]//Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, June 14-19, 2020, Seattle, WA, USA. New York:IEEE, 2020:1742-1750.

[20] LIU L, LIU J Z, YUAN S X, et al. Wavelet-based dual-branch network for image demoiréing[C]//Proceedings of 2020 European Conference on Computer Vision, November 28, 2020, Glasgow, UK. Springer:Cham, 2020: 86-102.

[21] ZUO C, QIAN J M, FENG S J, et al. Deep learning in optical metrology:a review[J]. Light:science and applications, 2022, 11(1):39.