Near-infrared 3D imaging with upconversion detection

He Zhang; Santosh Kumar; Yong Meng Sua; Shenyu Zhu; Yu-Ping Huang

doi:10.1364/PRJ.458813

[1] K. H. Kim, J. A. Burns, J. J. Bernstein, G. N. Maguluri, B. H. Park, J. F. de Boer. In vivo 3D human vocal fold imaging with polarization sensitive optical coherence tomography and a MEMS scanning catheter. Opt. Express, 18, 14644-14653(2010).

[2] G. Satat, B. Heshmat, D. Raviv, R. Raskar. All photons imaging through volumetric scattering. Sci. Rep., 6, 33946(2016).

[3] J. Shi, T. T. W. Wong, Y. He, L. Li, R. Zhang, C. S. Yung, J. Hwang, K. Maslov, L. V. Wang. High-resolution, high-contrast mid-infrared imaging of fresh biological samples with ultraviolet-localized photoacoustic microscopy. Nat. Photonics, 13, 609-615(2019).

[4] K. N. Liou, S.-C. Ou, Y. Takano, J. Cetola. Remote sensing of three-dimensional cirrus clouds from satellites: application to continuous-wave laser atmospheric transmission and backscattering. Appl. Opt., 45, 6849-6859(2006).

[5] A. McCarthy, N. J. Krichel, N. R. Gemmell, X. Ren, M. G. Tanner, S. N. Dorenbos, V. Zwiller, R. H. Hadfield, G. S. Buller. Kilometer-range, high resolution depth imaging via 1560 nm wavelength single-photon detection. Opt. Express, 21, 8904-8915(2013).

[6] A. Kirmani, D. Venkatraman, D. Shin, A. Colaço, F. N. C. Wong, J. H. Shapiro, V. K. Goyal. First-photon imaging. Science, 343, 58-61(2014).

[7] P. Rehain, Y. M. Sua, S. Zhu, I. Dickson, B. Muthuswamy, J. Ramanathan, A. Shahverdi, Y.-P. Huang. Noise-tolerant single photon sensitive three-dimensional imager. Nat. Commun., 11, 921(2020).

[8] J. Xue, Q. Zhang, C. Li, W. Lang, M. Wang, Y. Hu. 3D face profilometry based on galvanometer scanner with infrared fringe projection in high speed. Appl. Sci., 9, 1458(2019).

[9] P. Mariani, I. Quincoces, K. H. Haugholt, Y. Chardard, A. W. Visser, C. Yates, G. Piccinno, G. Reali, P. Risholm, J. T. Thielemann. Range-gated imaging system for underwater monitoring in ocean environment. Sustainability, 11, 162(2019).

[10] C. Ren, G. Cong, L. Lei, H. Jianwen, D. Lei. A 3D space-ground atmospheric observation system. Optical Sensors and Sensing Congress (ES, FTS, HISE, Sensors), FTu2B.3(2019).

[11] Y. Ko, S. Yi. Development of color 3D scanner using laser structured-light imaging method. Curr. Opt. Photon., 2, 554-562(2018).

[12] M. Imaki, T. Kobayashi. Infrared frequency upconverter for high-sensitivity imaging of gas plumes. Opt. Lett., 32, 1923-1925(2007).

[13] Y.-P. Tseng, P. Bouzy, C. Pedersen, N. Stone, P. Tidemand-Lichtenberg. Upconversion raster scanning microscope for long-wavelength infrared imaging of breast cancer microcalcifications. Biomed. Opt. Express, 9, 4979-4987(2018).

[14] C. L. Heike, K. Upson, E. Stuhaug, S. M. Weinberg. 3D digital stereophotogrammetry: a practical guide to facial image acquisition. Head Face Med., 6, 18(2010).

[15] J. S. Massa, G. S. Buller, A. C. Walker, S. Cova, M. Umasuthan, A. M. Wallace. Time-of-flight optical ranging system based on time-correlated single-photon counting. Appl. Opt., 37, 7298-7304(1998).

[16] R. Tobin, A. Halimi, A. McCarthy, P. J. Soan, G. S. Buller. Robust real-time 3D imaging of moving scenes through atmospheric obscurant using single-photon LiDAR. Sci. Rep., 11, 11236(2021).

[17] J. Tachella, Y. Altmann, N. Mellado, A. McCarthy, R. Tobin, G. S. Buller, J.-Y. Tourneret, S. McLaughlin. Real-time 3D reconstruction from single-photon lidar data using plug-and-play point cloud denoisers. Nat. Commun., 10, 4984(2019).

[18] H. Amrania, G. Antonacci, C.-H. Chan, L. Drummond, W. R. Otto, N. A. Wright, C. Phillips. Digistain: a digital staining instrument for histopathology. Opt. Express, 20, 7290-7299(2012).

[19] J. Nallala, O. Piot, M.-D. Diebold, C. Gobinet, O. Bouché, M. Manfait, G. D. Sockalingum. Infrared and Raman imaging for characterizing complex biological materials: a comparative morpho-spectroscopic study of colon tissue. Appl. Spectrosc., 68, 57-68(2014).

[20] J. S. Dam, P. Tidemand-Lichtenberg, C. Pedersen. Room-temperature mid-infrared single-photon spectral imaging. Nat. Photonics, 6, 788-793(2012).

[21] S.-K. Liu, C. Yang, S.-L. Liu, Z.-Y. Zhou, Y. Li, Y.-H. Li, Z.-H. Xu, G.-C. Guo, B.-S. Shi. Up-conversion imaging processing with field-of-view and edge enhancement. Phys. Rev. Appl., 11, 044013(2019).

[22] A. Rogalski. Infrared detectors: an overview. Infrared Phys. Technol., 43, 187-210(2002).

[23] G. W. Faris, M. Banks. Upconverting time gate for imaging through highly scattering media. Opt. Lett., 19, 1813-1815(1994).

[24] A. Barh, P. J. Rodrigo, L. Meng, C. Pedersen, P. Tidemand-Lichtenberg. Parametric upconversion imaging and its applications. Adv. Opt. Photon., 11, 952-1019(2019).

[25] Q. Zhou, K. Huang, H. Pan, E. Wu, H. Zeng. Ultrasensitive mid-infrared up-conversion imaging at few-photon level. Appl. Phys. Lett., 102, 241110(2013).

[26] R. Demur, R. Garioud, A. Grisard, E. Lallier, L. Leviandier, L. Morvan, N. Treps, C. Fabre. Near-infrared to visible upconversion imaging using a broadband pump laser. Opt. Express, 26, 13252-13263(2018).

[27] S. Junaid, S. C. Kumar, M. Mathez, M. Hermes, N. Stone, N. Shepherd, M. Ebrahim-Zadeh, P. Tidemand-Lichtenberg, C. Pedersen. Video-rate, mid-infrared hyperspectral upconversion imaging. Optica, 6, 702-708(2019).

[28] Y. Wang, J. Fang, T. Zheng, Y. Liang, Q. Hao, E. Wu, M. Yan, K. Huang, H. Zeng. Mid-infrared single-photon edge enhanced imaging based on nonlinear vortex filtering. Laser Photon. Rev., 15, 2100189(2021).

[29] K. Huang, Y. Wang, J. Fang, W. Kang, Y. Sun, Y. Liang, Q. Hao, M. Yan, H. Zeng. Mid-infrared photon counting and resolving via efficient frequency upconversion. Photon. Res., 9, 259-265(2021).

[30] S.-K. Choi, M. Vasilyev, P. Kumar. Noiseless optical amplification of images. Phys. Rev. Lett., 83, 1938-1941(1999).

[31] G. Frascella, R. V. Zakharov, O. V. Tikhonova, M. V. Chekhova. Multimode optical parametric amplification in the phase-sensitive regime. Opt. Lett., 46, 2364-2367(2021).

[32] D. Knez, A. M. Hanninen, R. C. Prince, E. O. Potma, D. A. Fishman. Infrared chemical imaging through non-degenerate two-photon absorption in silicon-based cameras. Light Sci. Appl., 9, 125(2020).

[33] W. Liu, Z. Zhou, L. Chen, X. Luo, Y. Liu, X. Chen, W. Wan. Imaging through dynamical scattering media by two-photon absorption detectors. Opt. Express, 29, 29972-29981(2021).

[34] E. O. Potma, D. Knez, Y. Chen, Y. Davydova, A. Durkin, A. Fast, M. Balu, B. Norton-Baker, R. W. Martin, T. Baldacchini, D. A. Fishman. Rapid chemically selective 3D imaging in the mid-infrared. Optica, 8, 995-1002(2021).

[35] A. V. Paterova, S. M. Maniam, H. Yang, G. Grenci, L. A. Krivitsky. Hyperspectral infrared microscopy with visible light. Sci. Adv., 6, eabd0460(2020).

[36] M. Gilaberte Basset, F. Setzpfandt, F. Steinlechner, E. Beckert, T. Pertsch, M. Gräfe. Perspectives for applications of quantum imaging. Laser Photon. Rev., 13, 1900097(2019).

[37] J. Huang, P. Kumar. Observation of quantum frequency conversion. Phys. Rev. Lett., 68, 2153-2156(1992).

[38] Y. Tanaka, T. Kato, M. Uchida, A. Asahara, K. Minoshima. High-resolution no-scanning 3D image detection using sum-frequency generation of chirped optical frequency combs. CLEO Pacific Rim Conference, Th1C.5(2018).

[39] C. Dunsby, P. M. W. French. Techniques for depth-resolved imaging through turbid media including coherence-gated imaging. J. Phys. D, 36, R207-R227(2003).

[40] T. Wu, J. Dong, X. Shao, S. Gigan. Imaging through a thin scattering layer and jointly retrieving the point-spread-function using phase-diversity. Opt. Express, 25, 27182-27194(2017).

[41] Y. Shi, Y. Liu, W. Sheng, J. Wang, T. Wu. Speckle rotation decorrelation based single-shot video through scattering media. Opt. Express, 27, 14567-14576(2019).

[42] Y. Shin, S.-W. Nam, C.-K. An, E. Powers. Design of a time-frequency domain matched filter for detection of non-stationary signals. IEEE International Conference on Acoustics, Speech, and Signal Processing, 6, 3585-3588(2001).

[43] A. Shahverdi, Y. M. Sua, L. Tumeh, Y.-P. Huang. Quantum parametric mode sorting: beating the time-frequency filtering. Sci. Rep., 7, 6495(2017).

[44] A. Shahverdi, Y. M. Sua, I. Dickson, M. Garikapati, Y.-P. Huang. Mode selective up-conversion detection for lidar applications. Opt. Express, 26, 15914-15923(2018).

[45] H. Zhang, S. Kumar, Y.-P. Huang. Mode selective up-conversion detection with turbulence. Sci. Rep., 9, 17481(2019).

[46] J. Cho, S. Kang, B. Lee, J. Moon, Y.-S. Lim, M. Jang, W. Choi. Time-resolved detection of early-arriving ballistic waves in a quasi-diffusive regime. Opt. Express, 29, 35640-35650(2021).

[47] H. Yılmaz, M. Kühmayer, C. W. Hsu, S. Rotter, H. Cao. Customizing the angular memory effect for scattering media. Phys. Rev. X, 11, 031010(2021).

[48] J. Radford, A. Lyons, F. Tonolini, D. Faccio. Role of late photons in diffuse optical imaging. Opt. Express, 28, 29486-29495(2020).

[49] O. Katz, P. Heidmann, M. Fink, S. Gigan. Non-invasive single-shot imaging through scattering layers and around corners via speckle correlations. Nat. Photonics, 8, 784-790(2014).

[50] S. Maruca, P. Rehain, Y. M. Sua, S. Zhu, Y. Huang. Non-invasive single photon imaging through strongly scattering media. Opt. Express, 29, 9981-9990(2021).

[51] Z.-P. Li, X. Huang, P.-Y. Jiang, Y. Hong, C. Yu, Y. Cao, J. Zhang, F. Xu, J.-W. Pan. Super-resolution single-photon imaging at 8.2 kilometers. Opt. Express, 28, 4076-4087(2020).

[52] G. Brida, M. Genovese, I. Ruo Berchera. Experimental realization of sub-shot-noise quantum imaging. Nat. Photonics, 4, 227-230(2010).

[53] E. D. Lopaeva, I. Ruo Berchera, I. P. Degiovanni, S. Olivares, G. Brida, M. Genovese. Experimental realization of quantum illumination. Phys. Rev. Lett., 110, 153603(2013).

[54] X. Qiu, F. Li, W. Zhang, Z. Zhu, L. Chen. Spiral phase contrast imaging in nonlinear optics: seeing phase objects using invisible illumination. Optica, 5, 208-212(2018).

[55] Z. Li, Z. Yu, H. Hui, H. Li, T. Zhong, H. Liu, P. Lai. Edge enhancement through scattering media enabled by optical wavefront shaping. Photon. Res., 8, 954-962(2020).