• Chinese Optics Letters
  • Vol. 21, Issue 6, 061103 (2023)
Conghe Wang1, Yutong He2, Xia Wang1、*, Honghao Huang2, Changda Yan1, Xin Zhang1, and Hongwei Chen2、**
Author Affiliations
  • 1Key Laboratory of Photoelectronic Imaging Technology and System of Ministry of Education of China, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
  • 2Beijing National Research Center for Information Science and Technology (BNRist), Department of Electronic Engineering, Tsinghua University, Beijing 100084, China
  • show less
    DOI: 10.3788/COL202321.061103 Cite this Article Set citation alerts
    Conghe Wang, Yutong He, Xia Wang, Honghao Huang, Changda Yan, Xin Zhang, Hongwei Chen. Passive non-line-of-sight imaging for moving targets with an event camera[J]. Chinese Optics Letters, 2023, 21(6): 061103 Copy Citation Text show less
    Schematic of events excitation with changes in brightness at pixel level. The red arrow stands for a fired positive event, while the green arrow stands for the negative one.
    Fig. 1. Schematic of events excitation with changes in brightness at pixel level. The red arrow stands for a fired positive event, while the green arrow stands for the negative one.
    Representations of event-based data.
    Fig. 2. Representations of event-based data.
    Discrimination function of fired event.
    Fig. 3. Discrimination function of fired event.
    Flow chart of event-embedded passive NLOS imaging.
    Fig. 4. Flow chart of event-embedded passive NLOS imaging.
    Experimental setup. (a) Basic principle of our NLOS scene; (b) experimental settings; the self-luminous target is a video with moving digits.
    Fig. 5. Experimental setup. (a) Basic principle of our NLOS scene; (b) experimental settings; the self-luminous target is a video with moving digits.
    (a) Part of the reconstruction results for the PRINT test set in both EM-NLOS and FM-NLOS; (b) part of the reconstruction results for the MNIST test set in both EM-NLOS and FM-NLOS.
    Fig. 6. (a) Part of the reconstruction results for the PRINT test set in both EM-NLOS and FM-NLOS; (b) part of the reconstruction results for the MNIST test set in both EM-NLOS and FM-NLOS.
    Reconstructions of NLOS moving target at different positions through the E method and the F method. Six different positions of digit 7 (MNIST test set) and digit 3 (PRINT test set) are displayed as examples. The Cd value (pixel) is labeled at the corner of each frame.
    Fig. 7. Reconstructions of NLOS moving target at different positions through the E method and the F method. Six different positions of digit 7 (MNIST test set) and digit 3 (PRINT test set) are displayed as examples. The Cd value (pixel) is labeled at the corner of each frame.
    Cd value of NLOS reconstructions at different positions. (a), (b) are the Cd values of reconstructions shown in Fig. 7 (digit 7 and digit 3, respectively).
    Fig. 8. Cd value of NLOS reconstructions at different positions. (a), (b) are the Cd values of reconstructions shown in Fig. 7 (digit 7 and digit 3, respectively).
    Evaluation metrics LPIPS and PSNR for reconstructions of digit 7 (MNIST test) and digit 3 (PRINT test) at 10 different positions, respectively. The full line denotes the E method, while the dotted line denotes frame-based ones.
    Fig. 9. Evaluation metrics LPIPS and PSNR for reconstructions of digit 7 (MNIST test) and digit 3 (PRINT test) at 10 different positions, respectively. The full line denotes the E method, while the dotted line denotes frame-based ones.
    DigitPSNR/dB (↑)LPIPS (↓)
    MNIST testPRINT testMNIST testPRINT test
    E (ours)FE (ours)FE (ours)FE (ours)F
    017.9817.0218.2516.670.0630.0880.0680.084
    129.2426.5721.9718.660.0140.0360.0710.083
    219.0919.0417.2915.960.0650.0920.0850.087
    319.0116.4819.8316.420.0630.1290.0750.099
    419.3318.1317.5815.360.0670.0760.1010.114
    520.8419.5617.4215.960.0560.0750.0820.090
    620.4819.6416.4114.630.0490.0700.1010.106
    720.5017.2217.7817.260.0420.1060.0810.086
    819.6618.4717.2315.040.0470.0860.0880.095
    919.5316.8617.3517.170.0570.0850.0840.086
    Avg.20.5718.9018.1116.320.0520.0840.0830.093
    Table 1. Evaluation Metrics of Results with E Method and F Methoda
    Conghe Wang, Yutong He, Xia Wang, Honghao Huang, Changda Yan, Xin Zhang, Hongwei Chen. Passive non-line-of-sight imaging for moving targets with an event camera[J]. Chinese Optics Letters, 2023, 21(6): 061103
    Download Citation