Single-pixel 3D imaging based on fusion temporal data of single-photon detector and millimeter-wave radar

Tingqin Lai; Xiaolin Liang; Yi Zhu; Xinyi Wu; Lianye Liao; Xuelin Yuan; Ping Su; Shihai Sun

doi:10.3788/COL202422.022701

[1] J. Geng. Structured-light 3D surface imaging: a tutorial. Adv. Opt. Photonics, 3, 128(2011).

[2] G. Kim, Y. Kim, J. Yun et al. Metasurface-driven full-space structured light for three-dimensional imaging. Nat. Commun., 13, 5920(2022).

[3] J. A. Jalkio, R. C. Kim, S. K. Case. Three dimensional inspection using multistripe structured light. Opt. Eng., 24, 966(1985).

[4] D. Marr, T. Poggio. A computational theory of human stereo vision. Proc. Royal Soc. London. Ser. B. Biol. Sci., 204, 301(1979).

[5] S. T. Barnard, M. A. Fischler. Computational stereo. ACM Comput. Surv., 14, 553(1982).

[6] N. Lazaros, G. C. Sirakoulis, A. Gasteratos. Review of stereo vision algorithms: from software to hardware. Int. J. Optomechatronics, 2, 435(2008).

[7] S. Jin, J. Cho, X. Dai Pham et al. FPGA design and implementation of a real-time stereo vision system. IEEE Trans. Circuits Syst. Video Technol., 20, 15(2009).

[8] M. Hansard, S. Lee, O. Choi et al. Time-of-Flight Cameras: Principles, Methods and Applications(2012).

[9] Y. Cui, S. Schuon, D. Chan et al. 3D shape scanning with a time-of-flight camera. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1173(2010).

[10] R. Lange, P. Seitz. Solid-state time-of-flight range camera. IEEE J. Quantum Electron., 37, 390(2001).

[11] K. Morimoto, A. Ardelean, M.-L. Wu et al. Megapixel time-gated SPAD image sensor for 2d and 3d imaging applications. Optica, 7, 346(2020).

[12] T. Al Abbas, N. Dutton, O. Almer et al. Backside illuminated SPAD image sensor with 7.83 µm pitch in 3D-stacked CMOS technology. IEEE International Electron Devices Meeting (IEDM), 1(2016).

[13] I. Gyongy, N. Calder, A. Davies et al. A 100-kfps, 61% fill-factor SPAD image sensor for time-resolved microscopy applications. IEEE Trans. Electron Devices, 65, 547(2018).

[14] S. W. Hutchings, N. Johnston, I. Gyongy et al. A reconfigurable 3-D-stacked SPAD imager with in-pixel histogramming for flash lidar or high-speed time-of-flight imaging. IEEE J. Solid-State Circuits, 54, 2947(2019).

[15] J. H. Shapiro. Computational ghost imaging. Phys. Rev. A, 78, 061802(2008).

[16] Y. Bromberg, O. Katz, Y. Silberberg. Ghost imaging with a single detector. Phys. Rev. A, 79, 053840(2009).

[17] F. Ferri, D. Magatti, L. Lugiato et al. Differential ghost imaging. Phys. Rev. Lett., 104, 253603(2010).

[18] M.-J. Sun, M. P. Edgar, G. M. Gibson et al. Single-pixel three-dimensional imaging with time-based depth resolution. Nat. Commun., 7, 12010(2016).

[19] M. Chen, E. Li, W. Gong et al. Ghost imaging lidar via sparsity constraints in real atmosphere. Opt. Photon. J., 3, 83(2013).

[20] G. A. Howland, D. J. Lum, M. R. Ware et al. Photon counting compressive depth mapping. Opt. Express, 21, 23822(2013).

[21] A. M. Pawlikowska, A. Halimi, R. A. Lamb et al. Single-photon three-dimensional imaging at up to 10 kilometers range. Opt. Express, 25, 11919(2017).

[22] A. McCarthy, R. J. Collins, N. J. Krichel et al. Long-range time-of-flight scanning sensor based on high-speed time-correlated single-photon counting. Appl. Opt., 48, 6241(2009).

[23] H. Zhou, Y. He, L. You et al. Few-photon imaging at 1550 nm using a low-timing-jitter superconducting nanowire single-photon detector. Opt. Express, 23, 14603(2015).

[24] A. McCarthy, N. J. Krichel, N. R. Gemmell et al. Kilometer-range, high resolution depth imaging via 1560 nm wavelength single-photon detection. Opt. Express, 21, 8904(2013).

[25] Z.-P. Li, J.-T. Ye, X. Huang et al. Single-photon imaging over 200 km. Optica, 8, 344(2021).

[26] Z.-P. Li, X. Huang, Y. Cao et al. Single-photon computational 3D imaging at 45 km. Photonics Res., 8, 1532(2020).

[27] Z.-P. Li, X. Huang, P.-Y. Jiang et al. Super-resolution single-photon imaging at 8.2 kilometers. Opt. Express, 28, 4076(2020).

[28] E. Salvador-Balaguer, P. Latorre-Carmona, C. Chabert et al. Low-cost single-pixel 3D imaging by using an LED array. Opt. Express, 26, 15623(2018).

[29] J. H. Shapiro, R. W. Boyd. The physics of ghost imaging. Quantum Inf. Process., 11, 949(2012).

[30] A. Turpin, G. Musarra, V. Kapitany et al. Spatial images from temporal data. Optica, 7, 900(2020).

[31] C. Liang, C. Luo, B. Deng et al. Non-scanning siso terahertz 3D imaging based on 430 data-driven. Opt. Express, 30, 29329(2022).

[32] A. Turpin, V. Kapitany, J. Radford et al. 3D imaging from multipath temporal echoes. Phys. Rev. Lett., 126, 174301(2021).

[33] J. J. Hopfield. Artificial neural networks. IEEE Circuits Devices Mag., 4, 3(1988).

[34] B. Yegnanarayana. Artificial Neural Networks(2009).

[35] A. Krogh. What are artificial neural networks?. Nat. Biotechnol., 26, 195(2008).

[36] A. K. Jain, J. Mao, K. M. Mohiuddin. Artificial neural networks: a tutorial. Computer, 29, 31(1996).

[37] M. E. Russell, A. Crain, A. Curran et al. Millimeter-wave radar sensor for automotive intelligent cruise control (ICC). IEEE Trans. Microw. Theory Tech., 45, 2444(1997).

[38] J. Guan, S. Madani, S. Jog et al. Through fog high-resolution imaging using millimeter wave radar. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 11464(2020).

[39] P. Zhao, C. X. Lu, J. Wang et al. Mid: Tracking and identifying people with millimeter wave radar. 15th International Conference on Distributed Computing in Sensor Systems (DCOSS), 33(2019).

[40] Z. Wang, A. C. Bovik, H. R. Sheikh et al. Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process., 13, 600(2004).