• Photonics Research
  • Vol. 9, Issue 3, 03000B57 (2021)
Kangning Zhang, Junjie Hu, and Weijian Yang*
Author Affiliations
  • Department of Electrical and Computer Engineering, University of California, Davis, California 95616, USA
  • show less

    Abstract

    The need for high-speed imaging in applications such as biomedicine, surveillance, and consumer electronics has called for new developments of imaging systems. While the industrial effort continuously pushes the advance of silicon focal plane array image sensors, imaging through a single-pixel detector has gained significant interest thanks to the development of computational algorithms. Here, we present a new imaging modality, deep compressed imaging via optimized-pattern scanning, which can significantly increase the acquisition speed for a single-detector-based imaging system. We project and scan an illumination pattern across the object and collect the sampling signal with a single-pixel detector. We develop an innovative end-to-end optimized auto-encoder, using a deep neural network and compressed sensing algorithm, to optimize the illumination pattern, which allows us to reconstruct faithfully the image from a small number of measurements, with a high frame rate. Compared with the conventional switching-mask-based single-pixel camera and point-scanning imaging systems, our method achieves a much higher imaging speed, while retaining a similar imaging quality. We experimentally validated this imaging modality in the settings of both continuous-wave illumination and pulsed light illumination and showed high-quality image reconstructions with a high compressed sampling rate. This new compressed sensing modality could be widely applied in different imaging systems, enabling new applications that require high imaging speeds.

    b=fn×n(x*g),

    View in Article

    b+=fn×n(x*g)+ϵ=F(x)+ϵ=Φx+ϵ,

    View in Article

    argminx12Φxb+22+λΨ(x)1,

    View in Article

    r(k)=x(k1)ρΦT(Φx(k1)b+),

    View in Article

    x(k)=argminx12xr(k)22+λΨ(x)1,

    View in Article

    argminx12Φxb+22+λF(x)1.

    View in Article

    F(x(k))=soft(F(r(k)),θ),

    View in Article

    x(k)=F1(soft(F(r(k)),θ)),

    View in Article

    Ltotal=Lerror+γLconstraint=x(N)x22γ(k=1NF1(k)(F(k)(x))x22),

    View in Article

    W(1)=D((M(1)M0)×a+M(0)),(A1)

    View in Article

    W(k)=D((M(k)M0)×a+D1(W(k1))).(A2)

    View in Article

    Copy Citation Text
    Kangning Zhang, Junjie Hu, Weijian Yang. Deep compressed imaging via optimized pattern scanning[J]. Photonics Research, 2021, 9(3): 03000B57
    Download Citation
    Special Issue: DEEP LEARNING IN PHOTONICS
    Received: Oct. 7, 2020
    Accepted: Jan. 13, 2021
    Posted: Jan. 15, 2021
    Published Online: Mar. 2, 2021
    The Author Email: Weijian Yang (wejyang@ucdavis.edu)