Review of the system model and calibration for fringe projection profilometry

Yongkai Yin; Zonghua Zhang; Xiaoli Liu; Xiang Peng

doi:10.3788/IRLA202049.0303008

[1] F Chen, G M Brown, M Song. Overview of three-dimensional shape measurement using optical methods. Optical Engineering, 39, 10-22(2000).

[2] R Tutsch, M Petz, M Fischer. Optical three-dimensional metrology with structured illumination. Optical Engineering, 50, 101507(2011).

[3] G Sansoni, M Trebeschi, F Docchio. State-of-the-art and applications of 3D imaging sensors in industry, cultural heritage, medicine, and criminal investigation. Sensors, 9, 568-601(2009).

[4] J Geng. Structured-light 3D surface imaging: A tutorial. Advances in Optics and Photonics, 3, 128-160(2011).

[5] X Peng, J Tian, P Zhang. Three-dimensional vision with dual acousto-optic deflection encoding. Optics Letters, 30, 1965-1967(2005).

[6] Y Guan, Y Yin, A Li. Dynamic 3D imaging based on acousto-optic heterodyne fringe interferometry. Optics Letters, 39, 3678-3681(2014).

[7] J Zhang, C Zhou, X Wang. Three-dimensional profilometry using a dammann grating. Applied Optics, 48, 3709-3715(2009).

[8] Y Miao, Y Zhao, H Ma. Design of diffractive optical element projector for a pseudorandom dot array by an improved encoding method. Applied Optics, 58, G169-G176(2019).

[9] K Iwata, Y Sando, K Satoh. Application of generalized grating imaging to pattern projection in three-dimensional profilometry. Applied Optics, 50, 5115-5121(2011).

[10] M Fujigaki, Y Oura, D Asai. High-speed height measurement by a light-source-stepping method using a linear led array. Optics Express, 21, 23169-23180(2013).

[11] S Heist, P Dietrich, M Landmann. GOBO projection for 3D measurements at highest frame rates: A performance analysis. Light: Science & Applications, 7, 71(2018).

[12] J-S Hyun, G T C Chiu, S Zhang. High-speed and high-accuracy 3D surface measurement using a mechanical projector. Optics Express, 26, 1474-1487(2018).

[13] R Sitnik, M Kujawinska, J Woznicki. Digital fringe projection system for large-volume 360-deg shape measurement. Optical Engineering, 41, 443-449(2002).

[14] S Zhang, S-T Yau. Three-dimensional shape measurement using a structured light system with dual cameras. Optical Engineering, 47, 013604(2008).

[15] W Guo, Z Wu, R Xu. A fast reconstruction method for three-dimensional shape measurement using dual-frequency grating projection and phase-to-height lookup table. Optics & Laser Technology, 112, 269-277(2019).

[16] J Salvi, S Fernandez, T Pribanic. A state of the art in structured light patterns for surface profilometry. Pattern Recognition, 43, 2666-2680(2010).

[17] S S Gorthi, P Rastogi. Fringe projection techniques: Whither we are?. Optics and Lasers in Engineering, 48, 133-140(2010).

[18] X Su, W Chen. Fourier transform profilometry: A review. Optics and Lasers in Engineering, 35, 263-284(2001).

[19] Z H Zhang. Review of single-shot 3D shape measurement by phase calculation-based fringe projection techniques. Optics and Lasers in Engineering, 50, 1097-1106(2012).

[20] M Takeda, K Mutoh. Fourier transform profilometry for the automatic measurement of 3-D object shapes. Applied Optics, 22, 3977-3982(1983).

[21] V Srinivasan, H C Liu, M Halioua. Automated phase-measuring profilometry of 3-D diffuse objects. Applied Optics, 23, 3105-3108(1984).

[22] C Zuo, S Feng, L Huang. Phase shifting algorithms for fringe projection profilometry: A review. Optics and Lasers in Engineering, 109, 23-59(2018).

[23] X Su, W Chen. Reliability-guided phase unwrapping algorithm: A review. Optics and Lasers in Engineering, 42, 245-261(2004).

[24] C Zuo, L Huang, M Zhang. Temporal phase unwrapping algorithms for fringe projection profilometry: A comparative review. Optics and Lasers in Engineering, 85, 84-103(2016).

[25] C Quan, C J Tay, Y H Huang. 3-D deformation measurement using fringe projection and digital image correlation. Optik, 115, 164-168(2004).

[26] X Mao, W Chen, X Su. Improved fourier-transform profilometry. Applied Optics, 46, 664-668(2007).

[27] P J Tavares, M A Vaz. Linear calibration procedure for the phase-to-height relationship in phase measurement profilometry. Optics Communications, 274, 307-314(2007).

[28] Z Zhang, C E Towers, D P Towers. Uneven fringe projection for efficient calibration in high-resolution 3D shape metrology. Applied Optics, 46, 6113-6119(2007).

[29] Z Zhang, H Ma, S Zhang. Simple calibration of a phase-based 3D imaging system based on uneven fringe projection. Optics Letters, 36, 627-629(2011).

[30] C Yu, Q Peng. A unified-calibration method in ftp-based 3D data acquisition for reverse engineering. Optics and Lasers in Engineering, 45, 396-404(2007).

[31] L Chen, C Quan. Fringe projection profilometry with nonparallel illumination: A least-squares approach. Optics Letters, 30, 2101-2103(2005).

[32] Z Wang, H Du, H Bi. Out-of-plane shape determination in generalized fringe projection profilometry. Optics Express, 14, 12122-12133(2006).

[33] A Gonzalez, J Meneses. Accurate calibration method for a fringe projection system by projecting an adaptive fringe pattern. Applied Optics, 58, 4610-4615(2019).

[34] P Lu, C Sun, B Liu. Accurate and robust calibration method based on pattern geometric constraints for fringe projection profilometry. Applied Optics, 56, 784-794(2017).

[35] H Du, Z Wang. Three-dimensional shape measurement with an arbitrarily arranged fringe projection profilometry system. Optics Letters, 32, 2438-2440(2007).

[36] L Huang, PS Chua, A Asundi. Least-squares calibration method for fringe projection profilometry considering camera lens distortion. Applied Optics, 49, 1539-1548(2010).

[37] Y Xiao, Y Cao, Y Wu. Improved algorithm for phase-to-height mapping in phase measuring profilometry. Applied Optics, 51, 1149-1155(2012).

[38] Y Fu, Y Wang, W Wang. Least-squares calibration method for fringe projection profilometry with some practical considerations. Optik, 124, 4041-4045(2013).

[39] J Lu, R Mo, H Sun. Flexible calibration of phase-to-height conversion in fringe projection profilometry. Applied Optics, 55, 6381-6388(2016).

[40] Y Hu, Q Chen, T Tao. Absolute three-dimensional micro surface profile measurement based on a greenough-type stereomicroscope. Measurement Science and Technology, 28, 045004(2017).

[41] A Asundi, Z Wensen. Unified calibration technique and its applications in optical triangular profilometry. Applied Optics, 38, 3556-3561(1999).

[42] H Liu, W-H Su, K Reichard. Calibration-based phase-shifting projected fringe profilometry for accurate absolute 3D surface profile measurement. Optics Communications, 216, 65-80(2003).

[43] H Guo, H He, Y Yu. Least-squares calibration method for fringe projection profilometry. Optical Engineering, 44, 033603(2005).

[44] W-H Su, H Liu. Calibration-based two-frequency projected fringe profilometry: A robust, accurate, and single-shot measurement for objects with large depth discontinuities. Optics Express, 14, 9178-9187(2006).

[45] Y Wen, S Li, H Cheng. Universal calculation formula and calibration method in fourier transform profilometry. Applied Optics, 49, 6563-6569(2010).

[46] K Liu, Y Wang, DL Lau. Dual-frequency pattern scheme for high-speed 3-D shape measurement. Optics Express, 18, 5229-5244(2010).

[47] I Léandry, C Brèque, V Valle. Calibration of a structured-light projection system: Development to large dimension objects. Optics and Lasers in Engineering, 50, 373-379(2012).

[48] L Merner, Y Wang, S Zhang. Accurate calibration for 3D shape measurement system using a binary defocusing technique. Optics and Lasers in Engineering, 51, 514-519(2013).

[49] Z Cai, X Liu, A Li. Phase-3D mapping method developed from back-projection stereovision model for fringe projection profilometry. Optics Express, 25, 1262-1277(2017).

[50] R Anchini, G D Leo, C Liguori. A new calibration procedure for 3-D shape measurement system based on phase-shifting projected fringe profilometry. IEEE Transactions on Instrumentation and Measurement, 58, 1291-1298(2009).

[51] M Vo, Z Wang, T Hoang. Flexible calibration technique for fringe-projection-based three-dimensional imaging. Optics Letters, 35, 3192-3194(2010).

[52] Z Wang, D A Nguyen, J C Barnes. Some practical considerations in fringe projection profilometry. Optics and Lasers in Engineering, 48, 218-225(2010).

[53] E Zappa, G Busca, P Sala. Innovative calibration technique for fringe projection based 3D scanner. Optics and Lasers in Engineering, 49, 331-340(2011).

[54] Z Zhang, H Ma, T Guo. Simple, flexible calibration of phase calculation-based three-dimensional imaging system. Optics Letters, 36, 1257-1259(2011).

[55] J Villa, M Araiza, D Alaniz. Transformation of phase to (x, y, z)-coordinates for the calibration of a fringe projection profilometer. Optics and Lasers in Engineering, 50, 256-261(2012).

[56] M Vo, Z Wang, B Pan. Hyper-accurate flexible calibration technique for fringe-projection-based three-dimensional imaging. Optics Express, 20, 16926-16941(2012).

[57] J Xu, J Douet, J Zhao. A simple calibration method for structured light-based 3D profile measurement. Optics & Laser Technology, 48, 187-193(2013).

[58] Z Zhang, S Huang, S Meng. A simple, flexible and automatic 3D calibration method for a phase calculation-based fringe projection imaging system. Optics Express, 21, 12218-12227(2013).

[59] C Zuo, T Tao, S Feng. Micro fourier transform profilometry (μFTP): 3D shape measurement at 10, 000 frames per second. Optics and Lasers in Engineering, 102, 70-91(2018).

[60] C Chen, J Yu, N Gao. High accuracy 3D calibration method of phase calculation-based fringe projection system by using lcd screen considering refraction error. Optics and Lasers in Engineering, 126, 105870(2020).

[61] S Zhang, P Huang. Novel method for structured light system calibration. Optical Engineering, 45, 083601(2006).

[62] Y Yin, X Peng, A Li. Calibration of fringe projection profilometry with bundle adjustment strategy. Optics Letters, 37, 542-544(2012).

[63] Hartley R, Zisserman A. Multiple View Geometry In Computer Vision[M]. Cambridge: Cambridge University Press, 2003: 655.

[64] Szeliski R. Computer Vision: Algithms Applications[M]. Berlin: Springer, 2010: 812.

[65] S Zhang. High-speed 3D shape measurement with structured light methods: A review. Optics and Lasers in Engineering, 106, 119-131(2018).

[66] J Tian, Y Ding, X Peng. Self-calibration of a fringe projection system using epipolar constraint. Optics & Laser Technology, 40, 538-544(2008).

[67] R Zhang, H Guo, A K Asundi. Geometric analysis of influence of fringe directions on phase sensitivities in fringe projection profilometry. Applied Optics, 55, 7675-7687(2016).

[68] S Feng, C Zuo, W Yin. Micro deep learning profilometry for high-speed 3D surface imaging. Optics and Lasers in Engineering, 121, 416-427(2019).

[69] W Schreiber, G Notni. Theory and arrangements of self-calibrating whole-body three-dimensional measurement systems using fringe projection technique. Optical Engineering, 39, 159-169(2000).

[70] C Jiang, B Lim, S Zhang. Three-dimensional shape measurement using a structured light system with dual projectors. Applied Optics, 57, 3983-3990(2018).

[71] C Reich, R Ritter, J Thesing. 3-D shape measurement of complex objects by combining photogrammetry and fringe projection. Optical Engineering, 39, 224-231(2000).

[72] Y Yin, X Peng, X Liu. Calibration strategy of optical measurement network for large-scale and shell-like objects. Optics Communications, 285, 2048-2056(2012).

[73] H Zhao, X Liang, X Diao. Rapid in-situ 3D measurement of shiny object based on fast and high dynamic range digital fringe projector. Optics and Lasers in Engineering, 54, 170-174(2014).

[74] J Qian, S Feng, T Tao. High-resolution real-time 360o 3D model reconstruction of a handheld object with fringe projection profilometry. Optics Letters, 44, 5751-5754(2019).

[75] S Gai, F Da, M Tang. A flexible multi-view calibration and 3D measurement method based on digital fringe projection. Measurement Science and Technology, 30, 025203(2019).

[76] D Li, C Liu, J Tian. Telecentric 3D profilometry based on phase-shifting fringe projection. Optics Express, 22, 31826-31835(2014).

[77] B Li, S Zhang. Flexible calibration method for microscopic structured light system using telecentric lens. Optics Express, 23, 25795-25803(2015).

[78] J Peng, M Wang, D Deng. Distortion correction for microscopic fringe projection system with scheimpflug telecentric lens. Applied Optics, 54, 10055-10062(2015).

[79] L Rao, F Da, W Kong. Flexible calibration method for telecentric fringe projection profilometry systems. Optics Express, 24, 1222-1237(2016).

[80] H Liu, H Lin, L Yao. Calibration method for projector-camera-based telecentric fringe projection profilometry system. Optics Express, 25, 31492-31508(2017).

[81] F Gu, H Zhao, Y Ma. Camera calibration based on the back projection process. Measurement Science and Technology, 26, 125004(2015).

[82] L C Chen, C C Liao. Calibration of 3D surface profilometry using digital fringe projection. Measurement Science and Technology, 16, 1554-1566(2005).

[83] X Zhang, Y Lin, M Zhao. Calibration of a fringe projection profilometry system using virtual phase calibrating model planes. Journal of Optics A: Pure and Applied Optics, 7, 192-197(2005).

[84] Z Zhang. A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22, 1330-1334(2000).

[85] R Legarda-Sáenz, T Bothe, W Jüptner. Accurate procedure for the calibration of a structured light system. Optical Engineering, 43, 464-471(2004).

[86] W Gao, L Wang, Z Hu. Flexible method for structured light system calibration. Optical Engineering, 47, 083602(2008).

[87] Z Li, Y Shi, C Wang. Accurate calibration method for a structured light system. Optical Engineering, 47, 053604(2008).

[88] X Chen, J Xi, Y Jin. Accurate calibration for a camera–projector measurement system based on structured light projection. Optics and Lasers in Engineering, 47, 310-319(2009).

[89] Z Huang, J Xi, Y Yu. Accurate projector calibration based on a new point-to-point mapping relationship between the camera and projector images. Applied Optics, 54, 347-356(2015).

[90] R Chen, J Xu, H Chen. Accurate calibration method for camera and projector in fringe patterns measurement system. Applied Optics, 55, 4293-4300(2016).

[91] X Liu, Z Cai, Y Yin. Calibration of fringe projection profilometry using an inaccurate 2d reference target. Optics and Lasers in Engineering, 89, 131-137(2017).

[92] S Huang, L Xie, Z Wang. Accurate projector calibration method by using an optical coaxial camera. Applied Optics, 54, 789-795(2015).

[93] W Zhang, W Li, L Yu. Sub-pixel projector calibration method for fringe projection profilometry. Optics Express, 25, 19158-19169(2017).

[94] H Zhao, Z Wang, H Jiang. Calibration for stereo vision system based on phase matching and bundle adjustment algorithm. Optics and Lasers in Engineering, 68, 203-213(2015).

[95] Triggs B, McLauchlan P F, Hartley R I, et al. Bundle adjustment: A modern synthesis[M]. Bill Triggs, rew Zisserman, Rid Szeliski, eds. Vision Algithms: They Practice. Springer, 2000: 298372.

[96] Y L Xiao, J Xue, X Su. Robust self-calibration three-dimensional shape measurement in fringe-projection photogrammetry. Optics Letters, 38, 694-696(2013).

[97] R Chen, J Xu, S Zhang. A self-recalibration method based on scale-invariant registration for structured light measurement systems. Optics and Lasers in Engineering, 88, 75-81(2017).

[98] C Bräuer-Burchardt, M Heinze, I Schmidt. Underwater 3D surface measurement using fringe projection based scanning devices. Sensors, 16, 13(2016).

[99] K Zhong, Z Li, R Li. Pre-calibration-free 3D shape measurement method based on fringe projection. Optics Express, 24, 14196-14207(2016).

[100] J A Beraldin, D Mackinnon, L Cournoyer. Metrological characterization of 3D imaging systems: Progress report on standards developments. International Congress of Metrology, 13003(2015).

[101] VDIVDE Society of Measuring Automation Techniques. VDIVDE 2634 part 2: Optical 3D measuring systems optical systems based on area scanning[S]. Düsseldf, 2002.

CLP Journals