Review of dynamic three-dimensional surface imaging based on fringe projection

Yong Li; Guanghui Zhang; Lihong Ma; Xiaolin Ying; Jianyun Yao

doi:10.3788/IRLA202049.0303005

[1] F Chen, G M Brown, M Song. Overview of three-dimensional shape measurement using optical methods. Optics Engineering, 39, 10-22(2000).

[2] F Blais. Review of 20 years of range sensor development. Journal of Electronic Imaging, 13, 231-240(2004).

[3] J Salvi, S Fernandez, T Pribanic. A state of the art in structured light patterns for surface profilometry. Pattern Recognition, 43, 2666-2680(2010).

[4] J Geng. Structured-light 3D surface imaging: A tutorial. Advances in Optics and Photonics, 3, 128-160(2011).

[5] H Takasaki. Moiré Topography. Applied Optics, 9, 1467-1472(1970).

[6] M Takeda, K Motoh. Fourier transform profilometry for the automatic measurement of 3-D object shapes. Applied Optics, 22, 3977-3982(1983).

[7] V Srinivasan, HC Liu, H Halioua. Automated phase-measuring profilometry of 3-D diffuse objects. Applied Optics, 23, 3105-3108(1984).

[8] S Toyooka, M Tominaga. Spatial fringe scanning for optical phase measurement. Optics Communications, 51, 68-70(1984).

[9] Su XY, Su LK. New 3D profilometry based on modulation measurement[C]. Proc SPIE, 1998, 3558: 17.

[10] L K Su, X Y Su, W S Li. Application of modulation measurement profilometry to objects with surface holes. Applied Optics, 38, 1153-1158(1999).

[11] M T Lu, X Y Su, Y P Cao. Modulation measuring profilometry with cross grating projection and single shot for dynamic 3D shape measurement. Optics and Lasers in Engineering, 87, 103-110(2016).

[12] X Y Su, Q C Zhang. Dynamic 3-D shape measurement method: A review. Optics and Lasers in Engineering, 48, 191-204(2010).

[13] V D J Sam, J J J Dirckx. Real-time structured light profilometry: a review. Optics and Lasers in Engineering, S0143816616000166(2016).

[14] S Zhang. High-speed 3D shape measurement with structured light methods: A review. Optics and Lasers in Engineering, 106, 119-131(2018).

[15] X Liu, J Kofman. High-frequency background modulation fringe patterns based on a fringe-wavelength geometry-constraint model for 3D surface-shape measurement. Optics Express, 25, 16618(2017).

[16] Q Zhang, X Su. High-speed optical measurement for the drumhead vibration. Optics Express, 13, 3110-3116(2005).

[17] C Guan, L G Hassebrook, D L Lau. Composite structured light pattern for three-dimensional video. Optics Express, 11, 406-417(2003).

[18] Wenjing Cheng, Xianyu Su, Yiping Cao. Improved FTP based on bi-color fringe projection. Acta Optics Sinica, 23, 1153-1157(2003).

[19] Q Kemao. Two-dimensional windowed Fourier transform for fringe pattern analysis: Principles, applications and implementations. Optics and Lasers in Engineering, 45, 304-317(2007).

[20] J Zhong, J Weng. Spatial carrier-fringe pattern analysis by means of wavelet transform: Wavelet transform profilometry. Applied Optics, 43, 4993-4998(2004).

[21] Mohua Jiang, Wenjing Chen, Zhiping Zheng. Research of demodulation technique based on S-Transform. Acta Optics Sinica, 31, 0412001(2011).

[22] Shijie Feng, Qian Chen, Guohua Gu. Fringe pattern analysis using deep learning. Advanced Photonics, 1, 025001(2019).

[23] Jiashuo Shi, Xinjun Zhu, Hongyi Wang. Label enhanced and patch based deep learning for phase retrieval from single frame fringe pattern in fringe projection 3D measurement. Optics Express, 27, 28929-28943(2019).

[24] J Li, X Y Su, L Guo. Improved Fourier-transform profilometry for automatic measurement of three-dimensional object shapes. Optical Engineering, 29, 1439-1444(1990).

[25] Wenjing Chen, Xianyu Su, Likun Su. Improvement for measurement accuracy of Fourier transform profilometry with gray image. Opto-electronic Engineering, 27, 55-59(2000).

[26] C Zuo, T Tao, S Feng. Micro Fourier Transform Profilometry (μFTP): 3D shape measurement at 10,000 frames per second. Optics and Lasers in Engineering, 102, 70-91(2018).

[27] Zhoujie Wu, Wenbo Guo, Qican Zhang. High-speed three-dimensional shape measurement based on shifting Gray-code light. Optics Express, 27, 22631-22644(2019).

[28] Zhoujie Wu, Chao Zuo, Wenbo Guo. High-speed three-dimensional shape measurement based on cyclic complementary Gray-code light. Optics Express, 27, 1283-1297(2019).

[29] Yuwei Wang, Lu Liu, Jun Wu. Enhanced phase-coding method for three-dimensional shape measurement with half-period codeword. Applied Optics, 58, 7359-7366(2019).

[30] Yong Li, Xianyu Su, Qingyang Wu. Accurate phase–height mapping algorithm for PMP. Journal of Modern Optics, 53, 1955-1964(2006).

[31] Guanming Lai, Toyohiko Yatagai. Generalized phase-shifting interferometry. Journal of the Optical Society of America A, 8, 822-827(1991).

[32] Y Guan, Y Yin, A Li. Dynamic 3D imaging based on acousto-optic heterodyne fringe interferometry. Optics Letters, 39, 3678(2014).

[33] J S Hyun, T G Chiu, S Zhang. High-speed and high-accuracy 3D surface measurement using a mechanical projector. Optics Express, 26, 1474-1487(2018).

[34] S Heist, A Mann, Kühmstedt, Peter. Array projection of aperiodic sinusoidal fringes for high-speed three-dimensional shape measurement. Optical Engineering, 53, 112208(2014).

[35] S Heist, P Lutzke, I Schmidt. High-speed three-dimensional shape measurement using GOBO projection. Optics and Lasers in Engineering, S0143816616000555(2016).

[36] Haihua Zhang, Qican Zhang, Yong Li. High speed 3D shape measurement with temporal Fourier transform profilometry. Applied Sciences, 9, 4123(2019).

[37] S Feng, Q Chen, C Zuo. Motion-oriented high speed 3-D measurements by binocular fringe projection using binary aperiodic patterns. Optics Express, 25, 540-559(2017).

[38] X Y Su, W S Zhou, G V Bally. Automated phase-measuring profilometry using defocused projection of a Ronchi grating. Optics Communications, 94, 561-573(1992).

[39] Yong Li, Cuifang Zhao, Yixian Qian. High-speed and dense three-dimensional surface acquisition using defocused binary patterns for spatially isolated objects. Optics Express, 18, 21628-21635(2010).

[40] Peng Gao, Yong Li, Yanshuai Tu. Binarization methods of sinusoidal grating in 3D measurement base on defocused fringe projection. Acta Photonica Sinica, 43, 0512006(2014).

[41] Y J Wang, S Zhang. Optimal pulse width modulation for sinusoidal fringe generation with projector defocusing. Optics Letters, 35, 4121-4123(2010).

[42] G A Ajubi, J A Ayubi, J M D Martino. Pulse-width modulation in defocused three-dimensional fringe projection. Optics Letters, 35, 3682-3684(2010).

[43] T Xiao, X Su. Area modulation grating for sinusoidal structure illumination on phase-measuring profilometry. Applied Optics, 40, 1201-1206(2001).

[44] Ju Cheng, Xianyu Su. Study on error diffusion algorithm of binary encode grating. Laser Technology, 31, 322-325(2007).

[45] Liwei Zhao, Feipeng Da, Dongliang Zheng. Method for binary grating generation using defocused projection for three-dimensional measurement. Acta Optica Sinica, 36, 0812005(2016).

[46] William Lohry, Song Zhang. Genetic method to optimize binary dithering technique for high-quality fringe generation. Optics Letter, 38, 540-542(2013).

[47] Li Y, Chen J, Tu Y, et al. On bitdepth of pattern in threedimensional measurement system based on digital fringe projection[C] Fourth International Conference on Optical Photonics Engineering, 2017.

[48] Tu Y, Li Y, Jin H, et al. Highspeed threedimensional shape measurement using spatial frequency encoding DLP project[C]Proceedings of SPIE The International Society f Optical Engineering, 2014, 9276: 92761K.

[49] Qican Zhang, Xianyu Su, Yiping Cao. An optical 3-D shape and deformation measurement for rotating blade using stroboscopic structured illumination. Optical Engineering, 44, 113601(2005).

[50] Wang J, Li Y, Zhang Z, et al. Costeffective fullfield method f measuring vibration of loudspeaker membrane using fringe projection[C] Proceedings of SPIE The International Society f Optical Engineering, 2014, 9276: 92761M.

[51] Song Zhang. Absolute phase retrieval methods for digital fringe projection profilometry: A review. Optics and Lasers in Engineering, 107, 28-37(2018).

[52] J Salvi, J Pages, J Batlle. Pattern codification strategies in structured light systems. Pattern Recognition, 37, 827-849(2004).

[53] Yatong An, Song Zhang. Three-dimensional absolute shape measurement by combining binary statistical pattern matching with phase-shifting methods. Applied Optics, 56, 5418-26(2017).

[54] William Lohry, Vincent Chen, Song Zhang. Absolute three-dimensional shape measurement using coded fringe patterns without phase unwrapping or projector calibration. Optics Express, 22, 1287-1301(2014).

[55] Z Li, K Zhong, Y Li. Multiview phase shifting: a full-resolution and high-speed 3D measurement framework for arbitrary shape dynamic objects. Optics Letters, 38, 1389-91(2013).

[56] Y An, J-S Hyun, S Zhang. Pixel-wise absolute phase unwrapping using geometric constraints of structured light system. Optics Express, 24, 18445(2016).

[57] X Chen, Y Wang, Y Wang. Quantized phase coding and connected region labeling for absolute phase retrieval. Optics Express, 24, 28613(2016).

[58] B Li, T Bell, S Zhang. Computer-aided-design (CAD) model-assisted absolute three- dimensional shape measurement. Applied Optics, 56, 6770(2017).

[59] Y Hao, Y Zhao, D Li. Multifrequency grating projection profilometry based on the nonlinear excess fraction method. Applied Optics, 38, 4106-4110(1999).

[60] E B Li, X Peng, J Xi. Multi-frequency and multiple phaseshift sinusoidal fringe projection for 3D profilometry. Optics Express, 13, 1561-1569(2005).

[61] J M Huntley, H O Saldner. Temporal phase unwrapping algorithm for automated interferogram analysis. Applied Optics, 32, 3047-3052(1993).

[62] H O Saldner, J M Huntley. Temporal phase-unwrapping: application to surface profiling of discontinuous objects. Applied Optics, 36, 2770-2775(1997).

[63] V Gushov, Y N Solodkin. Automatic processing of fringe patterns in integer interfer ometers. Optics and Lasers in Engineering, 14, 311-24(1991).

[64] Y Ding, J Xi, Y Yu. Recovering the absolute phase maps of two fringe patterns with selected frequencies. Optics Letters, 36, 2518-20(2011).

[65] J Zhong, Y Zhang. Absolute phase-measurement technique based on number theory in multifrequency grating projection profilometry. Applied Optics, 40, 492-500(2001).

[66] T Pribanic, S Mrvos, J Salvi. Efficient multiple phase shift patterns for dense 3d acquisition in structured light scanning. Image and Vision Computing, 28, 1255-66(2010).

[67] W Yin, C Zuo, S Feng. High-speed three-dimensional shape measurement using geometry-constraint-based number-theoretical phase unwrapping. Optics and Lasers in Engineering, 115, 21-31(2019).

[68] Haiyan Li, Yong Li, Hui Wang. Method for fast acquiring three-dimensional shape and color texture. Acta Photonica Sinica, 45, 0112003(2016).

[69] Y Li, H Jin, H Wang. Three-dimensional shape measurement using binary spatio-temporal encoded illumination. Journal of Optics A Pure and Applied Optics, 11, 075502(2009).

[70] Weise T, Leibe B, Van Gool L. Fast 3D Scanning with Automatic Motion Compensation[C] Computer Vision Pattern Recognition, 2007. CVPR ''07. IEEE Conference on. IEEE, 2007: 1−8.

[71] B Li, Z Liu, S Zhang. Motion-induced error reduction by combining Fourier transform profilometry with phase-shifting profilometry. Optics Express, 24, 23289-23303(2016).

[72] Ziping Liu, P C Zibley, Song Zhang. Motion-induced error compensation for phase shifting profilometry. Optics Express, 26, 12632-12637(2018).

[73] Lei Lu, Jiangtao Xi, Yanguang Yu. Improving the accuracy performance of phase-shifting profilometry for the measurement of objects in motion. Optics Letters, 39, 6715-6718(2014).

[74] S Feng, C Zuo, T Tao. Robust dynamic 3-D measurements with motion-compensated phase-shifting profilometry. Optics and Lasers in Engineering, 103, 127-138(2018).

[75] Lei Lu, Yongkai Yin, Zhilong Su. General model for phase shifting profilometry with an object in motion. Applied Optics, 57, 10364-10369(2018).

[76] PY Cong, Z W Xiong, Y Y Zhang. Accurate dynamic 3D sensing with Fourier-Assisted phase shifting. IEEE Journal of Selected Topics in Signal Processing, 9, 396-408(2015).

[77] Qianhong Yan, Yong Li, Yiteng Jiang. High precision phase estimation of projected fringes in dynamic 3-D measurement. Laser Technology, 43, 619-623(2019).

[78] Zhou Xingcan, Li Yong, Huang Kai, et al. Phase crection method f dynamic 3D measurement based on fringe projection[C] Proc SPIE, Optical Metrology Inspection f Industrial Applications VI, 2019, 11189: 111891I.

[79] Jiaming Qian, Tianyang Tao, Shijie Feng. Motion-artifact-free dynamic 3D shape measurement with hybrid Fourier-transform phase-shifting profilometry. Optics Express, 27, 2713-2731(2019).

CLP Journals