• Chinese Optics Letters
  • Vol. 21, Issue 6, 061103 (2023)
Conghe Wang1, Yutong He2, Xia Wang1、*, Honghao Huang2, Changda Yan1, Xin Zhang1, and Hongwei Chen2、**
Author Affiliations
  • 1Key Laboratory of Photoelectronic Imaging Technology and System of Ministry of Education of China, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
  • 2Beijing National Research Center for Information Science and Technology (BNRist), Department of Electronic Engineering, Tsinghua University, Beijing 100084, China
  • show less
    DOI: 10.3788/COL202321.061103 Cite this Article Set citation alerts
    Conghe Wang, Yutong He, Xia Wang, Honghao Huang, Changda Yan, Xin Zhang, Hongwei Chen. Passive non-line-of-sight imaging for moving targets with an event camera[J]. Chinese Optics Letters, 2023, 21(6): 061103 Copy Citation Text show less

    Abstract

    Non-line-of-sight (NLOS) imaging is an emerging technique for detecting objects behind obstacles or around corners. Recent studies on passive NLOS mainly focus on steady-state measurement and reconstruction methods, which show limitations in recognition of moving targets. To the best of our knowledge, we propose a novel event-based passive NLOS imaging method. We acquire asynchronous event-based data of the diffusion spot on the relay surface, which contains detailed dynamic information of the NLOS target, and efficiently ease the degradation caused by target movement. In addition, we demonstrate the event-based cues based on the derivation of an event-NLOS forward model. Furthermore, we propose the first event-based NLOS imaging data set, EM-NLOS, and the movement feature is extracted by time-surface representation. We compare the reconstructions through event-based data with frame-based data. The event-based method performs well on peak signal-to-noise ratio and learned perceptual image patch similarity, which is 20% and 10% better than the frame-based method.
    evi=[ti,xi,yi,pi]T,iN.

    View in Article

    I(py)=pfFA(pf,py)·I(pf)dpf+N,

    View in Article

    A(pf,py)=cos[(pypf,npf)]·cos[(pfpy,npy)]pypf22·μ(pf,py),

    View in Article

    I(py)=pfFcos[(pypf,npf)]·cos[(pfpy,npy)]pypf22·μ·I(pf)dpf+N,

    View in Article

    y=Af+N.

    View in Article

    [Iy,1Iy,h×w]=[A1,1A1,H×WAh×w,1Ah×w,H×W][If,1If,H×W]+N,

    View in Article

    [Iy,1Iy,1Iy,2Iy,2Iy,h×wIy,h×w]=A[If,1If,1If,2If,2If,H×WIf,H×W]+NN,

    View in Article

    Iy,iIy,i=[Ai,1Ai,2Ai,H×W]limΔtt0·Δf+Nr=[Ai,1Ai,2Ai,H×W][If,1mIf,2mIf,H×Wm]+Nr,

    View in Article

    Si(ρ,p)=e[tiTi(ρ,p)]/τ,

    View in Article

    Ti(ρ,p)=maxji{tj|rj=ri+ρ,pi=p}.

    View in Article

    Emap=S[yFoV,Δtt0Fire(IyIy)]=B·f,

    View in Article

    f=B1·Emap.

    View in Article

    f=argminfBfEmap22+J,

    View in Article

    Conghe Wang, Yutong He, Xia Wang, Honghao Huang, Changda Yan, Xin Zhang, Hongwei Chen. Passive non-line-of-sight imaging for moving targets with an event camera[J]. Chinese Optics Letters, 2023, 21(6): 061103
    Download Citation