• Chinese Optics Letters
  • Vol. 21, Issue 8, 082701 (2023)
Miao Cai1, Zhi-Xiang Li1, Hao-Dong Wu1, Ya-Ping Ruan1, Lei Tang1, Jiang-Shan Tang1, Ming-Yuan Chen1, Han Zhang1、2, Ke-Yu Xia1、4、5、*, Min Xiao1、2、3, and Yan-Qing Lu1
Author Affiliations
  • 1College of Engineering and Applied Sciences, National Laboratory of Solid State Microstructures, Nanjing University, Nanjing 210023, China
  • 2School of Physics, Nanjing University, Nanjing 210023, China
  • 3Department of Physics, University of Arkansas, Fayetteville, Arkansas 72701, USA
  • 4Hefei National Laboratory, Hefei 230088, China
  • 5Jiangsu Key Laboratory of Artificial Functional Materials, Nanjing University, Nanjing 210023, China
  • show less
    DOI: 10.3788/COL202321.082701 Cite this Article Set citation alerts
    Miao Cai, Zhi-Xiang Li, Hao-Dong Wu, Ya-Ping Ruan, Lei Tang, Jiang-Shan Tang, Ming-Yuan Chen, Han Zhang, Ke-Yu Xia, Min Xiao, Yan-Qing Lu. Surpassing the standard quantum limit of optical imaging via deep learning[J]. Chinese Optics Letters, 2023, 21(8): 082701 Copy Citation Text show less
    (a) Schematic of the noise2noise protocol. Both the inputs and targets during training are noisy data, and the loss function is L2 loss. With this protocol, the well-trained DL neural network can denoise the input noisy signal. (b) Diagram model for U-net. The structure includes two parts: the contracting part (left yellow area) and the expansive part (right pink area). Each slab represents a layer in the neural network. Colors indicate different types of layers, as shown by legends. (c) Schematic of data set preparation process. First, we randomly choose m frames from the original image data set {D(o)}. These frames generate a new image through accumulation and min-max normalization. This procedure is repeated N(r) times to obtain the regrouped image data set, including N(r) frames. Then, the new data set is used for training.
    Fig. 1. (a) Schematic of the noise2noise protocol. Both the inputs and targets during training are noisy data, and the loss function is L2 loss. With this protocol, the well-trained DL neural network can denoise the input noisy signal. (b) Diagram model for U-net. The structure includes two parts: the contracting part (left yellow area) and the expansive part (right pink area). Each slab represents a layer in the neural network. Colors indicate different types of layers, as shown by legends. (c) Schematic of data set preparation process. First, we randomly choose m frames from the original image data set {D(o)}. These frames generate a new image through accumulation and min-max normalization. This procedure is repeated N(r) times to obtain the regrouped image data set, including N(r) frames. Then, the new data set is used for training.
    Single-photon coincidence imaging of an Airy pattern. (a) Experimental setup. QWP, quarter-wave plate; HWP, half-wave plate; PBS, polarizing beam splitter; M, mirror; SPCM, single-photon counting module; PM, phase modulation; SLM, spatial light modulator; DM, dichroic mirror; DPBS, dual-wavelength PBS; DHWP, dual-wavelength HWP. An SLM is used as a scattering object to generate the Airy pattern. (b) Images accumulated over 1, 50, 500, and 5000 frames, respectively. The exposure time are Δte = 0.2 s. (c) Positions of the pixels (red points) that are chosen to calculate the variance in (d); (d) variance of the photon-number distribution versus the mean photon number n¯photon. A linear function (red line), σ2=59.19n¯photon−19.15, fits the variance well.
    Fig. 2. Single-photon coincidence imaging of an Airy pattern. (a) Experimental setup. QWP, quarter-wave plate; HWP, half-wave plate; PBS, polarizing beam splitter; M, mirror; SPCM, single-photon counting module; PM, phase modulation; SLM, spatial light modulator; DM, dichroic mirror; DPBS, dual-wavelength PBS; DHWP, dual-wavelength HWP. An SLM is used as a scattering object to generate the Airy pattern. (b) Images accumulated over 1, 50, 500, and 5000 frames, respectively. The exposure time are Δte = 0.2 s. (c) Positions of the pixels (red points) that are chosen to calculate the variance in (d); (d) variance of the photon-number distribution versus the mean photon number n¯photon. A linear function (red line), σ2=59.19n¯photon19.15, fits the variance well.
    Original and DL-enhanced Airy patterns for exposure time (a) Δte = 0.1 s and (b) 0.5 s, respectively; left column, top view of the original and DL-enhanced Airy patterns; middle column, projecting the Airy pattern to the y direction (side view); right column, brightness profiles along the red lines in the Airy pattern in left column. Red arrows are guides to the eye for the peaks appearing in the DL-enhanced images but indistinguishable in the original ones. Red curves in (b) represent the envelope of a theoretical Airy pattern.
    Fig. 3. Original and DL-enhanced Airy patterns for exposure time (a) Δte = 0.1 s and (b) 0.5 s, respectively; left column, top view of the original and DL-enhanced Airy patterns; middle column, projecting the Airy pattern to the y direction (side view); right column, brightness profiles along the red lines in the Airy pattern in left column. Red arrows are guides to the eye for the peaks appearing in the DL-enhanced images but indistinguishable in the original ones. Red curves in (b) represent the envelope of a theoretical Airy pattern.
    SNRs for the direct accumulation and the DL-based scheme. (a) Original image showing the areas for calculating SNR. The red dot indicates the center of the main peak of the Airy pattern. The red box surrounds a pure noise area. (b) SNR(1) versus the exposure time Δte; (c) SNR(2) versus the regroup size m.
    Fig. 4. SNRs for the direct accumulation and the DL-based scheme. (a) Original image showing the areas for calculating SNR. The red dot indicates the center of the main peak of the Airy pattern. The red box surrounds a pure noise area. (b) SNR(1) versus the exposure time Δte; (c) SNR(2) versus the regroup size m.
    Miao Cai, Zhi-Xiang Li, Hao-Dong Wu, Ya-Ping Ruan, Lei Tang, Jiang-Shan Tang, Ming-Yuan Chen, Han Zhang, Ke-Yu Xia, Min Xiao, Yan-Qing Lu. Surpassing the standard quantum limit of optical imaging via deep learning[J]. Chinese Optics Letters, 2023, 21(8): 082701
    Download Citation