Research advances on non-line-of-sight three-dimensional imaging lidar

Chenfei Jin; Xiaorui Tian; Meng Tang; Feng Wang; Jie Yang; Kai Qiao; Xiaojie Shi; Siqi Zhang

doi:10.3788/IRLA20210471

[1] A Velten, T Willwacher, O Gupta, et al. Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging. Nature Communications, 3, 1-8(2012).

[2] O Gupta, T Willwacher, A Velten, et al. Reconstruction of hidden 3D shapes using diffuse reflections. Optics Express, 20, 19096-19108(2012).

[3] O Katz, P Heidmann, M Fink, et al. Non-invasive single-shot imaging through scattering layers and around corners via speckle correlations. Nature Photonics, 8, 784-790(2014).

[4] C Saunders, J Murray-Bruce, V K Goyal. Computational periscopy with an ordinary digital camera. Nature, 565, 472-475(2019).

[5] Maeda T, Wang Y, Raskar R, et al. Thermal nonlineofsight imaging[C]2019 IEEE International Conference on Computational Photography (ICCP). IEEE, 2019: 111.

[6] M Kaga, T Kushida, T Takatani, et al. Thermal non-line-of-sight imaging from specular and diffuse reflections. IPSJ Transactions on Computer Vision and Applications, 11, 1-6(2019).

[7] Lindell D B, Wetzstein G, Koltun V. Acoustic nonlineofsight imaging[C]Proceedings of the IEEECVF Conference on Computer Vision Pattern Recognition. 2019: 67806789.

[8] Scheiner N, Kraus F, Wei F, et al. Seeing around street cners: Nonlineofsight detection tracking inthewild using doppler radar[C]Proceedings of the IEEECVF Conference on Computer Vision Pattern Recognition, 2020: 20682077.

[9] Chen W, Daneau S, Mannan F, et al. Steadystate nonlineofsight imaging[C]Proceedings of the IEEECVF Conference on Computer Vision Pattern Recognition, 2019: 67906799.

[10] E Repasi, P Lutzmann, O Steinvall, et al. Advanced short-wavelength infrared range-gated imaging for ground applications in monostatic and bistatic configurations. Applied Optics, 48, 5956-5969(2009).

[11] Steinvall O, Elmqvist M, Larsson H. See around the cner using active imaging[C]ElectroOptical Remote Sensing, Photonic Technologies, Applications V, 2011, 8186: 818605.

[12] Kaida Xu, Weiqi Jin, Jing Liu, et al. Non-line-of-sight imaging based on laser range-gated imaging technology. Infrared and Laser Engineering, 41, 2073-2078(2012).

[13] Kaida Xu, Weiqi Jin, Jing Liu, et al. Analysis of non-line-of-sight imaging characteristics based on laser range-gated imaging. Acta ArmamentarII, 35, 2003-2009(2014).

[14] K Xu, W Jin, S Zhao, et al. Image contrast model of non-line-of-sight imaging based on laser range-gated imaging. Optical Engineering, 53, 1-9(2013).

[15] Hongwei Han, Wei Zhong. Experimental study of non-line-of-sight imaging technology. Optical Instruments, 37, 220-225(2015).

[16] Laurenzis M, Velten A. Nonlineofsight active imaging of scattered photons[C]ElectroOptical Remote Sensing, Photonic Technologies, Applications VII; Military Applications in Hyperspectral Imaging High Spatial Resolution Sensing, 2013, 8897: 889706.

[17] M Laurenzis, A Velten. Nonline-of-sight laser gated viewing of scattered photons. Optical Engineering, 53, 1-6(2014).

[18] Heide F, Xiao L, Heidrich W, et al. Diffuse mirrs: 3D reconstruction from diffuse indirect illumination using inexpensive timeofflight senss[C]Proceedings of the IEEE Conference on Computer Vision Pattern Recognition, 2014: 32223229.

[19] Hullin M B. Computational imaging of light in flight[C]Optoelectronic Imaging Multimedia Technology III, 2014, 9273: 927314.

[20] F Heide, M B Hullin, J Gregson, et al. Low-budget transient imaging using photonic mixer devices. ACM Transactions on Graphics (ToG), 32, 1-10(2013).

[21] M Buttafava, J Zeman, A Tosi, et al. Non-line-of-sight imaging using a time-gated single photon avalanche diode. Optics Express, 23, 20997-21011(2015).

[22] M Laurenzis, J Klein, E Bacher, et al. Multiple-return single-photon counting of light in flight and sensing of non-line-of-sight objects at shortwave infrared wavelengths. Optics Letters, 40, 4815-4818(2015).

[23] G Gariepy, F Tonolini, R Henderson, et al. Detection and tracking of moving objects hidden from view. Nature Photonics, 10, 23-26(2016).

[24] S Chan, R E Warburton, G Gariepy, et al. Non-line-of-sight tracking of people at long range. Optics Express, 25, 10109-10117(2017).

[25] Tianming Shen, Xiaoming You. Preliminary study of non-line-of-sight imaging system. Infrared, 39, 20-23(2018).

[26] Jingyao Wu, Xiuqin Su, Jingjing Tan, et al. Study of theory for transient imaging of hidden object using single-photon array detector. Infrared and Laser Engineering, 47, S122001(2018).

[27] F Xu, G Shulkind, C Thrampoulidis, et al. Revealing hidden scenes by photon-efficient occlusion-based opportunistic active imaging. Optics Express, 26, 9945-9962(2018).

[28] M O’Toole, D B Lindell, G Wetzstein. Confocal non-line-of-sight imaging based on the light-cone transform. Nature, 555, 338-341(2018).

[29] D B Lindell, G Wetzstein, M O'Toole. Wave-based non-line-of-sight imaging using fast f-k migration. ACM Transactions on Graphics (TOG), 38, 1-13(2019).

[30] X Liu, I Guillén, Manna M La, et al. Non-line-of-sight imaging using phasor-field virtual wave optics. Nature, 572, 620-623(2019).

[31] Manna M La, J H Nam, S A Reza, et al. Non-line-of-sight-imaging using dynamic relay surfaces. Optics Express, 28, 5331-5339(2020).

[32] M Renna, J H Nam, M Buttafava, et al. Fast-gated 16×1 SPAD array for non-line-of-sight imaging applications. Instruments, 4, 1-18(2020).

[33] C Wu, J Liu, X Huang, et al. Non–line-of-sight imaging over 1.43 km. Proceedings of the National Academy of Sciences, 118, 1-7(2021).

[34] M Laurenzis, A Velten. Feature selection and back-projection algorithms for nonline-of-sight laser–gated viewing. Journal of Electronic Imaging, 23, 1-6(2014).

[35] Laurenzis M, Velten A. Investigation of frametoframe back projection feature ion algithms f nonlineofsight laser gated viewing[C]ElectroOptical Remote Sensing, Photonic Technologies, Applications VIII; Military Applications in Hyperspectral Imaging High Spatial Resolution Sensing IIs, 2014, 9250: 92500J.

[36] V Arellano, D Gutierrez, A Jarabo. Fast back-projection for non-line of sight reconstruction. Optics Express, 25, 11574-11583(2017).

[37] Manna M La, F Kine, E Breitbach, et al. Error backprojection algorithms for non-line-of-sight imaging. IEEE Transactions on Pattern Analysis and Machine Intelligence, 41, 1615-1626(2018).

[38] Hairui Li, Xin Wu, Jianqi Zhang. Reconstruction of the hidden 3D shape for transient imaging simulation. Journal of Xidian University, 45, 66-70(2018).

[39] C Jin, J Xie, S Zhang, et al. Richardson–Lucy deconvolution of time histograms for high-resolution non-line-of-sight imaging based on a back-projection method. Optics Letters, 43, 5885-5888(2018).

[40] C Jin, J Xie, S Zhang, et al. Reconstruction of multiple non-line-of-sight objects using back projection based on ellipsoid mode decomposition. Optics Express, 26, 20089-20101(2018).

[41] F Heide, M O’Toole, K Zang, et al. Non-line-of-sight imaging with partial occluders and surface normals. ACM Transactions on Graphics (ToG), 38, 1-10(2019).

[42] A Kadambi, H Zhao, B Shi, et al. Occluded imaging with time-of-flight sensors. ACM Transactions on Graphics (ToG), 35, 1-12(2016).

[43] Pediredla A K, Buttafava M, Tosi A, et al. Reconstructing rooms using photon echoes: A plane based model reconstruction algithm f looking around the cner[C]2017 IEEE International Conference on Computational Photography (ICCP). IEEE, 2017: 112.

[44] L Huang, X Wang, Y Yuan, et al. Improved algorithm of non-line-of-sight imaging based on the Bayesian statistics. JOSA A, 36, 834-838(2019).

[45] J T Ye, X Huang, Z P Li, et al. Compressed sensing for active non-line-of-sight imaging. Optics Express, 29, 1749-1763(2021).

[46] Young S I, Lindell D B, Girod B, et al. Nonlineofsight surface reconstruction using the directional lightcone transfm[C]Proceedings of the IEEECVF Conference on Computer Vision Pattern Recognition, 2020: 14071416.

[47] Xin S, Nousias S, Kutulakos K N, et al. A they of Fermat paths f nonlineofsight shape reconstruction[C]Proceedings of the IEEECVF Conference on Computer Vision Pattern Recognition, 2019: 68006809.

[48] P Caramazza, A Boccolini, D Buschek, et al. Neural network identification of people hidden from view with a single-pixel, single-photon detector. Scientific Reports, 8, 1-6(2018).

[49] Tancik M, Swedish T, Satat G, et al. Datadriven nonlineofsight imaging with a traditional camera[C]Imaging Systems Applications(Optical Society of America), 2018: IW2B.6.

CLP Journals