• Acta Photonica Sinica
  • Vol. 51, Issue 8, 0851510 (2022)
Mingjie SUN1、1 and Zhiguan WANG1、1、1、1
Author Affiliations
  • 11School of Instrumentation Science and Opto-electronic Engineering,Beihang University,Beijing 100191,China
  • 12Shenyuan Honors College,Beihang University,Beijing 100191,China
  • show less
    DOI: 10.3788/gzxb20225108.0851510 Cite this Article
    Mingjie SUN, Zhiguan WANG. Research Progress of Imaging Technology Based on Single Photon Avalanche Diode Arrays(Invited)[J]. Acta Photonica Sinica, 2022, 51(8): 0851510 Copy Citation Text show less
    References

    [1] R FOORD, R JONES, C J OLIVER et al. The use of photomultiplier tubes for photon counting. Applied Optics, 8, 1975-1989(1969).

    [2] M GHIONI, A GULINATTI, I RECH et al. Progress in silicon single-photon avalanche diodes. IEEE Journal of Selected Topics in Quantum Electronics, 13, 852-862(2007).

    [3] C M NATARAJAN, M G TANNER, R H HADFIELD. Superconducting nanowire single-photon detectors: physics and applications. Superconductor Science and Technology, 25, 063001(2012).

    [4] C BRUSCHINI, H HOMULLE, I M ANTOLOVIC et al. Single-photon avalanche diode imagers in biophotonics: review and outlook. Light: Science & Applications, 8, 1-28(2019).

    [5] R H HADFIELD. Single-photon detectors for optical quantum information applications. Nature Photonics, 3, 696-705(2009).

    [6] J ZHANG, M A ITZLER, H ZBINDEN et al. Advances in InGaAs/InP single-photon detector systems for quantum communication. Light: Science & Applications, 4, e286-e286(2015).

    [7] J RAPP, J TACHELLA, Y ALTMANN et al. Advances in single-photon lidar for autonomous vehicles: working principles, challenges, and recent advances. IEEE Signal Processing Magazine, 37, 62-71(2020).

    [8] T G ETOH, T OKINAKA, Y TAKANO et al. Light-in-flight imaging by a silicon image sensor: toward the theoretical highest frame rate. Sensors, 19, 2247(2019).

    [9] S COVA, A LONGONI, A ANDREONI. Towards picosecond resolution with single‐photon avalanche diodes. Review of Scientific Instruments, 52, 408-412(1981).

    [10] R V KRISHNAN, H SAITOH, H TERADA et al. Development of a multiphoton fluorescence lifetime imaging microscopy system using a streak camera. Review of Scientific Instruments, 74, 2714-2721(2003).

    [11] L CESTER, A LYONS, M C BRAIDOTTI et al. Time-of-flight imaging at 10 ps resolution with an ICCD camera. Sensors, 19, 180(2019).

    [12] E E WOLLMAN, V B VERMA, A E LITA et al. Kilopixel array of superconducting nanowire single-photon detectors. Optics Express, 27, 35279-35289(2019).

    [13] A GALLIVANONI, I RECH, M GHIONI. Progress in quenching circuits for single photon avalanche diodes. IEEE Transactions on Nuclear Science, 57, 3815-3826(2010).

    [14] D BRONZI, F VILLA, S TISA et al. SPAD Figures of merit for photon-counting, photon-timing, and imaging applications: a review. IEEE Sensors Journal, 16, 3-12(2016).

    [15] D BRONZI, F VILLA, S TISA et al. 100 000 frames/s 64×32 single-photon detector array for 2-D imaging and 3-D ranging. IEEE Journal of Selected Topics in Quantum Electronics, 20, 355-364(2014).

    [16] M BANDALI, X REN, F TALA et al. An 80 MHz frame-rate17.4% fill-factor 16×16 SPAD image array with event-based multiplexing for super-resolution microscopy, 12089, 1208902(2022).

    [17] L M HIRVONEN, K SUHLING. Wide-field TCSPC: methods and applications. Measurement Science and Technology, 28, 012003(2016).

    [18] S BURRI, Y MARUYAMA, X MICHALET et al. Architecture and applications of a high resolution gated SPAD image sensor. Optics Express, 22, 17573-17589(2014).

    [19] A GULINATTI, F CECCARELLI, M GHIONI et al. Custom silicon technology for SPAD-arrays with red-enhanced sensitivity and low timing jitter. Optics Express, 29, 4559-4581(2021).

    [20] A ROCHAS, M GOSCH, A SEROV et al. First fully integrated 2-D array of single-photon detectors in standard CMOS technology. IEEE Photonics Technology Letters, 15, 963-965(2003).

    [21] D E SCHWARTZ, E CHARBON, K L SHEPARD. A single-photon avalanche diode array for fluorescence lifetime imaging microscopy. IEEE Journal of Solid-State Circuits, 43, 2546-2557(2008).

    [22] C NICLASS, C FAVI, T KLUTER et al. A 128×128 single-photon image sensor with column-level 10-bit time-to-digital converter array. IEEE Journal of Solid-State Circuits, 43, 2977-2989(2008).

    [23] F GUERRIERI, S TISA, A TOSI et al. Two-dimensional SPAD imaging camera for photon counting. IEEE Photonics Journal, 2, 759-774(2010).

    [24] Y ZOU, D BRONZI, F VILLA et al. Backside illuminated wafer-to-wafer bonding single photon avalanche diode array(2014).

    [25] R M FIELD, S REALOV, K L SHEPARD. A 100 fps, time-correlated single-photon-counting-based fluorescence-lifetime imager in 130 nm CMOS. IEEE Journal of Solid-State Circuits, 49, 867-880(2014).

    [26] TAL ABBAS, N A W DUTTON, O ALMER et al. Backside illuminated SPAD image sensor with7.83 μm pitch in 3D-stacked CMOS technology(2016).

    [27] A T ERDOGAN, R WALKER, N FINLAYSON et al. A 16.5 giga events/s 1024×8 SPAD line sensor with per-pixel zoomable 50 ps-6.4 ns/bin histogramming TDC, C292-C293(2017).

    [28] A C ULKU, C BRUSCHINI, I M ANTOLOVIĆ et al. A 512×512 SPAD image sensor with integrated gating for widefield FLIM. IEEE Journal of Selected Topics in Quantum Electronics, 25, 1-12(2019).

    [29] K MORIMOTO, A ARDELEAN, M L WU et al. Megapixel time-gated SPAD image sensor for 2D and 3D imaging applications. Optica, 7, 346-354(2020).

    [30] K MORIMOTO, J IWATA, M SHINOHARA et al. 3.2 megapixel 3D-stacked charge focusing SPAD for low-light imaging and depth sensing, 20.2.1-20.2.4(2021).

    [32] F GRAMUGLIA, P KESHAVARZIAN, E KIZILKAN et al. Engineering breakdown probability profile for pdp and dcr optimization in a SPAD fabricated in a standard 55 nm bcd process. IEEE Journal of Selected Topics in Quantum Electronics, 28, 1-10(2021).

    [33] M SANZARO, P GATTARI, F VILLA et al. 0.16-µm BCD single-photon avalanche diode with 30-ps timing jitter, high detection efficiency, and low noise, 10659, 64-70(2018).

    [34] F SEVERINI, I CUSINI, D BERRETTA et al. SPAD pixel with sub-NS dead-time for high-count rate applications. IEEE Journal of Selected Topics in Quantum Electronics, 28, 1-8(2021).

    [35] L ZHENG, K HU, J WU et al. Active quenching circuit with adjustable reverse bias voltage for single photon avalanche diodes arrays, 12166, 830-835(2022).

    [36] F ARVANI, T C CARUSONE. A reconfigurable 5-channel ring-oscillator-based TDC for direct time-of-flight 3D imaging. IEEE Transactions on Circuits and Systems II: Express Briefs, 69, 2408-2412(2022).

    [37] S RICCARDO, E CONCA, V SESTA et al. Fast-gated 16×16 SPAD array with on-chip 6 ps TDCs for non-line-of-sight imaging, 1-2(2021).

    [38] P W R CONNOLLY, X REN, A MCCARTHY et al. High concentration factor diffractive microlenses integrated with CMOS single-photon avalanche diode detector arrays for fill-factor improvement. Applied Optics, 59, 4488-4498(2020).

    [39] I GYONGY, A DAVIES, B GALLINET et al. Cylindrical microlensing for enhanced collection efficiency of small pixel SPAD arrays in single-molecule localisation microscopy. Optics Express, 26, 2280-2291(2018).

    [40] E CHARBON, C BRUSCHINI, M J LEE. 3D-stacked CMOS SPAD image sensors: technology and applications, 1-4(2018).

    [41] R HELLEBOID, D RIDEAU, I NICHOLSON et al. Comprehensive modeling and characterization of photon detection efficiency and jitter in advanced SPAD devices, 271-274(2021).

    [42] S BURRI, C BRUSCHINI, E CHARBON. LinoSPAD: a compact linear SPAD camera system with 64 FPGA-based TDC modules for versatile 50 ps resolution time-resolved imaging. Instruments, 1, 6(2017).

    [43] F GRAMUGLIA, M L WU, C BRUSCHINI et al. A low-noise CMOS SPAD pixel with 12.1 ps SPTR and 3 ns dead time. IEEE Journal of Selected Topics in Quantum Electronics, 28, 1-9(2021).

    [44] J FÖLLING, M BOSSI, H BOCK et al. Fluorescence nanoscopy by ground-state depletion and single-molecule return. Nature Methods, 5, 943-945(2008).

    [45] V KRISHNASWAMI, C J F VAN NOORDEN, E M M MANDERS et al. Towards digital photon counting cameras for single-molecule optical nanoscopy. Optical Nanoscopy, 3, 1-11(2014).

    [46] F HUANG, T M P HARTWICH, F E RIVERA-MOLINA et al. Video-rate nanoscopy using sCMOS camera-specific single-molecule localization algorithms. Nature Methods, 10, 653-658(2013).

    [47] I M ANTOLOVIC, S BURRI, C BRUSCHINI et al. Analyzing blinking effects in super resolution localization microscopy with single-photon SPAD imagers, 9714, 35-41(2016).

    [48] I GYONGY, A DAVIES, N A W DUTTON et al. Smart-aggregation imaging for single molecule localisation with SPAD cameras. Scientific Reports, 6, 37349(2016).

    [49] I M ANTOLOVIC, S BURRI, C BRUSCHINI et al. SPAD imagers for super resolution localization microscopy enable analysis of fast fluorophore blinking. Scientific Reports, 7, 1-11(2017).

    [50] D A BOAS, L E CAMPBELL, A G YODH. Scattering and Imaging with Diffusing Temporal Field Correlations. Physical Review Letters, 75, 1855-1858(1995).

    [51] F JAILLON, J LI, G DIETSCHE et al. Activity of the human visual cortex measured non-invasively by diffusing-wave spectroscopy. Optics Express, 15, 6643-6650(2007).

    [52] J D JOHANSSON, D PORTALUPPI, M BUTTAFAVA et al. A multipixel diffuse correlation spectroscopy system based on a single photon avalanche diode array. Journal of Biophotonics, 12, e201900091(2019).

    [53] E J SIE, H CHEN, E F SAUNG et al. High-sensitivity multispeckle diffuse correlation spectroscopy. Neurophotonics, 7, 035010(2020).

    [54] W LIU, R QIAN, S XU et al. Fast sensitive diffuse correlation spectroscopy with a SPAD array, SM3D. 3(2020).

    [55] R WEISSLEDER. A clearer vision for in vivo imaging. Nature Biotechnology, 19, 316-317(2001).

    [56] Wei WANG, Ting CHEN, Junfeng LI等. The research of high photon detection efficiency CMOS single photon avalanche diode. Acta Photonica Sinica, 46, 0823001(2017).

    [57] S PELLEGRINI, R E WARBURTON, L J J TAN et al. Design and performance of an InGaAs-InP single-photon avalanche diode detector. IEEE Journal of Quantum Electronics, 42, 397-403(2006).

    [58] J BUCHHOLZ, J W KRIEGER, G MOCSÁR et al. FPGA implementation of a 32x32 autocorrelator array for analysis of fast image series. Optics Express, 20, 17767-17782(2012).

    [59] A El GAMAL, H ELTOUKHY. CMOS image sensors. IEEE Circuits and Devices Magazine, 21, 6-20(2005).

    [60] I ATUL, V ANDREAS, G MOHIT. High flux passive imaging with single-photon sensors, 6760-6769(2019).

    [61] M ZARGHAMI, L GASPARINI, M PERENZONI et al. High dynamic range imaging with TDC-based CMOS SPAD arrays. Instruments, 3, 38(2019).

    [62] Y LIU, F GUTIERREZ-BARRAGAN, A INGLE et al. Single-photon camera guided extreme dynamic range imaging, 1575-1585(2022).

    [63] J W LICHTMAN, J A CONCHELLO. Fluorescence microscopy. Nature Methods, 2, 910-919(2005).

    [64] F J MEYER-ALMES. Fluorescence lifetime based bioassays. Methods and Applications in Fluorescence, 5, 042002(2017).

    [65] Xiongbo LIU, Danying LIN, Qianqian WU等. Recent progress of fluorescence lifetime imaging microscopy technology and its application. Acta Physica Sinica, 67, 178701(2018).

    [66] R DATTA, T M HEASTER, J T SHARICK et al. Fluorescence lifetime imaging microscopy: fundamentals and advances in instrumentation, analysis, and applications. Journal of Biomedical Optics, 25, 071203(2020).

    [67] B J GLASGOW. Fluorescence lifetime imaging microscopy reveals quenching of fluorescein within corneal epithelium. Experimental Eye Research, 147, 12-19(2016).

    [68] A J BOWER, J LI, E J CHANEY et al. High-speed imaging of transient metabolic dynamics using two-photon fluorescence lifetime imaging microscopy. Optica, 5, 1290-1296(2018).

    [69] J JONKMAN, C M BROWN. Any way you slice it-a comparison of confocal microscopy techniques. Journal of Biomolecular Techniques, 26, 54-65(2015).

    [70] K SUHLING, L M HIRVONEN, W BECKER et al. Wide-field time-correlated single photon counting-based fluorescence lifetime imaging microscopy. Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, 942, 162365(2019).

    [71] S P POLAND, N KRSTAJIĆ, J MONYPENNY et al. A high speed multifocal multiphoton fluorescence lifetime imaging microscope for live-cell FRET imaging. Biomedical Optics Express, 6, 277-296(2015).

    [72] V ZICKUS, M L WU, K MORIMOTO et al. Fluorescence lifetime imaging with a megapixel SPAD camera and neural network lifetime estimation. Scientific Reports, 10, 20986(2020).

    [73] C NICLASS, M SOGA, H MATSUBARA et al. A 100-m range 10-frame/s 340×96-pixel time-of-flight depth sensor in 0.18-nm CMOS. IEEE Journal of Solid-State Circuits, 48, 559-572(2013).

    [74] M PERENZONI, D PERENZONI, D STOPPA. A 64×64-pixels digital silicon photomultiplier direct tof sensor with 100-mphotons/s/pixel background rejection and imaging/altimeter mode with 0.14% precision up to 6 km for spacecraft navigation and landing. IEEE Journal of Solid-State Circuits, 52, 151-160(2017).

    [75] C ZHANG, S LINDNER, I M ANTOLOVIĆ et al. A 30-frames/s, 252×144 SPAD flash LiDAR with 1 728 dual-clock 48.8-ps TDCs, and pixel-wise integrated histogramming. IEEE Journal of Solid-State Circuits, 54, 1137-1151(2019).

    [76] S W HUTCHINGS, N JOHNSTON, I GYONGY et al. A reconfigurable 3-D-stacked SPAD imager with in-pixel histogramming for flash LIDAR or high-speed time-of-flight imaging. IEEE Journal of Solid-State Circuits, 54, 2947-2956(2019).

    [77] Jing CAO, Zhao ZHANG, Nan QI等. A 16×1 pixels 180 nm CMOS SPAD-based TOF image sensor for LiDAR applications. Acta Photonica Sinica, 48, 0704001(2019).

    [78] R XUE, Y KANG, T ZHANG et al. Sub-pixel scanning high-resolution panoramic 3D imaging based on a SPAD array. IEEE Photonics Journal, 13, 1-6(2021).

    [79] A KIRMANI, D VENKATRAMAN, D SHIN et al. First-photon imaging. Science, 343, 58-61(2014).

    [80] A Y CHENG, X Y ZHAO, L LI et al. First-photon imaging with independent depth reconstruction. APL Photonics, 7, 036103(2022).

    [81] D FACCIO, A VELTEN. A trillion frames per second: the techniques and applications of light-in-flight photography. Reports on Progress in Physics, 81, 105901(2018).

    [82] N ABRAMSON. Light-in-flight recording by holography. Optics Letters, 3, 121-123(1978).

    [83] L GAO, J LIANG, C LI et al. Single-shot compressed ultrafast photography at one hundred billion frames per second. Nature, 516, 74-77(2014).

    [84] F HEIDE, M B HULLIN, J GREGSON et al. Low-budget transient imaging using photonic mixer devices. ACM Transactions on Graphics (ToG), 32, 1-10(2013).

    [85] G GARIEPY, N KRSTAJIĆ, R HENDERSON et al. Single-photon sensitive light-in-fight imaging. Nature Communications, 6, 6021(2015).

    [86] J M HILL, B J COX. Einstein's special relativity beyond the speed of light. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 468, 4174-4192(2012).

    [87] A VELTEN, D WU, A JARABO et al. Relativistic ultrafast rendering using time-of-flight imaging, 1-1(2012).

    [88] M CLERICI, G C SPALDING, R WARBURTON et al. Observation of image pair creation and annihilation from superluminal scattering sources. Science Advances, 2, e1501691(2016).

    [89] M LAURENZIS, J KLEIN, E BACHER. Relativistic effects in imaging of light in flight with arbitrary paths. Optics Letters, 41, 2001-2004(2016).

    [90] Y ZHENG, M J SUN, Z G WANG et al. Computational 4D imaging of light-in-flight with relativistic effects. Photonics Research, 8, 1072-1078(2020).

    [91] K MORIMOTO, M L WU, A ARDELEAN et al. Superluminal motion-assisted four-dimensional light-in-flight imaging. Physical Review X, 11, 011005(2021).

    [92] I MORLAND, F ZHU, G M MARTÍN et al. Intensity-corrected 4D light-in-flight imaging. Optics Express, 29, 22504-22516(2021).

    [93] S V BULANOV, N M NAUMOVA, F PEGORARO. Interaction of an ultrashort, relativistically strong laser pulse with an overdense plasma. Physics of Plasmas, 1, 745-757(1994).

    [94] D FACCIO, A VELTEN, G WETZSTEIN. Non-line-of-sight imaging. Nature Reviews Physics, 2, 318-327(2020).

    [95] M BUTTAFAVA, J ZEMAN, A TOSI et al. Non-line-of-sight imaging using a time-gated single photon avalanche diode. Optics Express, 23, 20997-21011(2015).

    [96] S CHAN, R E WARBURTON, G GARIEPY et al. Non-line-of-sight tracking of people at long range. Optics Express, 25, 10109-10117(2017).

    [97] F XU, G SHULKIND, C THRAMPOULIDIS et al. Revealing hidden scenes by photon-efficient occlusion-based opportunistic active imaging. Optics Express, 26, 9945-9962(2018).

    [98] C WU, J LIU, X HUANG et al. Non-line-of-sight imaging over 1.43 km. Proceedings of the National Academy of Sciences, 118, e2024468118(2021).

    [99] M LAURENZIS, J KLEIN, E BACHER et al. Multiple-return single-photon counting of light in flight and sensing of non-line-of-sight objects at shortwave infrared wavelengths. Optics Letters, 40, 4815-4818(2015).

    [100] G GARIEPY, F TONOLINI, R HENDERSON et al. Detection and tracking of moving objects hidden from view. Nature Photonics, 10, 23-26(2016).

    [101] Jingyao WU, Xiuqin SU, Jingjing TAN等. Study of theory for transient imaging of hidden object using single-photon array detector. Infrared and Laser Engineering, 47, 105-111(2018).

    [102] V ARELLANO, D GUTIERREZ, A JARABO. Fast back-projection for non-line of sight reconstruction. Optics Express, 25, 11574-11583(2017).

    [103] S I YOUNG, D B LINDELL, B GIROD et al. Non-line-of-sight surface reconstruction using the directional light-cone transform, 1407-1416(2020).

    [104] D B LINDELL, G WETZSTEIN, M O'TOOLE. Wave-based non-line-of-sight imaging using fast f-k migration. ACM Transactions on Graphics, 38, 1-13(2019).

    [105] X LIU, I GUILLÉN, M LA MANNA et al. Non-line-of-sight imaging using phasor-field virtual wave optics. Nature, 572, 620-623(2019).

    [106] D B LINDELL, G WETZSTEIN, V KOLTUN. Acoustic non-line-of-sight imaging, 6780-6789(2019).

    [107] K M YOO, R R ALFANO. Time-resolved coherent and incoherent components of forward light scattering in random media. Optics Letters, 15, 320-322(1990).

    [108] M G TANNER, T R CHOUDHARY, T H CRAVEN et al. Ballistic and snake photon imaging for locating optical endomicroscopy fibres. Biomedical Optics Express, 8, 4077-4095(2017).

    [109] G SATAT, B HESHMAT, D RAVIV et al. All photons imaging through volumetric scattering. Scientific Reports, 6, 1-8(2016).

    [110] G SATAT, M TANCIK, O GUPTA et al. Object classification through scattering media with deep learning on time resolved measurement. Optics Express, 25, 17466-17479(2017).

    [111] A LYONS, F TONOLINI, A BOCCOLINI et al. Computational time-of-flight diffuse optical tomography. Nature Photonics, 13, 575-579(2019).

    [112] D B LINDELL, G WETZSTEIN. Three-dimensional imaging through scattering media based on confocal diffuse tomography. Nature Communications, 11, 1-8(2020).

    Mingjie SUN, Zhiguan WANG. Research Progress of Imaging Technology Based on Single Photon Avalanche Diode Arrays(Invited)[J]. Acta Photonica Sinica, 2022, 51(8): 0851510
    Download Citation