• Photonics Research
  • Vol. 9, Issue 10, 1958 (2021)
Xi Yang1、*, Pavan Chandra Konda1, Shiqi Xu1, Liheng Bian2, and Roarke Horstmeyer1、3、4
Author Affiliations
  • 1Department of Biomedical Engineering, Duke University, Durham, North Carolina 27708, USA
  • 2School of Information and Electronics, Beijing Institute of Technology, Beijing 100081, China
  • 3Department of Physics, Duke University, Durham, North Carolina 27708, USA
  • 4Department of Electrical and Computer Engineering, Duke University, Durham, North Carolina 27708, USA
  • show less
    DOI: 10.1364/PRJ.427699 Cite this Article Set citation alerts
    Xi Yang, Pavan Chandra Konda, Shiqi Xu, Liheng Bian, Roarke Horstmeyer. Quantized Fourier ptychography with binary images from SPAD cameras[J]. Photonics Research, 2021, 9(10): 1958 Copy Citation Text show less
    (a) Schematic of an FP imaging system. Time-sequential illumination from different angles is provided by an illumination array. Each LED shifts a unique part of the sample’s Fourier spectrum [shown by circles in (b)] into the imaging lens, producing corresponding bandpass-filtered sample images [example images in (d)]. The three LEDs are chosen as examples in (a), (b), (d), and (e) with a common color scheme. (c) Both operating modes of SPAD array cameras can generate binary images. (d) Experimental FP data and reconstructions using 12-bit image data. (e) Quantized FP performed with binary image measurements provides reconstruction image quality closely matching 12-bit data in (d).
    Fig. 1. (a) Schematic of an FP imaging system. Time-sequential illumination from different angles is provided by an illumination array. Each LED shifts a unique part of the sample’s Fourier spectrum [shown by circles in (b)] into the imaging lens, producing corresponding bandpass-filtered sample images [example images in (d)]. The three LEDs are chosen as examples in (a), (b), (d), and (e) with a common color scheme. (c) Both operating modes of SPAD array cameras can generate binary images. (d) Experimental FP data and reconstructions using 12-bit image data. (e) Quantized FP performed with binary image measurements provides reconstruction image quality closely matching 12-bit data in (d).
    Example images from a simulation dataset demonstrating four exposure strategies considered in this work based on 32 by 32 LED array. LED positions for selected images (a), (b), (c) are shown in (e). The full high-dynamic-range nature of the dataset can be observed in (1). In (2), uniform exposure method results in most of the image pixel values rounding to zero due to quantization. In (3) and (4), max and informed methods use exposures that are dependent on the sample’s frequency spectrum distribution, leading to low quantization error. (5) Max or informed methods are not sufficient when the extreme case of binary is considered, in which case (6) the median method is chosen.
    Fig. 2. Example images from a simulation dataset demonstrating four exposure strategies considered in this work based on 32 by 32 LED array. LED positions for selected images (a), (b), (c) are shown in (e). The full high-dynamic-range nature of the dataset can be observed in (1). In (2), uniform exposure method results in most of the image pixel values rounding to zero due to quantization. In (3) and (4), max and informed methods use exposures that are dependent on the sample’s frequency spectrum distribution, leading to low quantization error. (5) Max or informed methods are not sufficient when the extreme case of binary is considered, in which case (6) the median method is chosen.
    Flowchart of the proposed quantized FP reconstruction algorithm. Each step is detailed in Section 2.C.
    Fig. 3. Flowchart of the proposed quantized FP reconstruction algorithm. Each step is detailed in Section 2.C.
    Simulation results with quantized FP reconstruction algorithm. (a) Test targets used to assess reconstruction performance with 8-bit imaging (left) and binary 1-bit imaging (right). (b) Example natural scene with unique amplitude and phase. For all cases, reconstruction of high-resolution amplitude and phase from binary image measurements closely matches that from 8-bit image measurement, despite significant decrease in detected information.
    Fig. 4. Simulation results with quantized FP reconstruction algorithm. (a) Test targets used to assess reconstruction performance with 8-bit imaging (left) and binary 1-bit imaging (right). (b) Example natural scene with unique amplitude and phase. For all cases, reconstruction of high-resolution amplitude and phase from binary image measurements closely matches that from 8-bit image measurement, despite significant decrease in detected information.
    NMSE performance of quantized FP algorithm as a function of raw image bit depth, evaluated using a pathology dataset consisting of 30 unique samples. Each point in plots (a) and (b) is average NMSE across all 30 samples. An example low-resolution image and reconstruction pair is shown for 1-, 2-, 3-, and 8-bit raw image datasets captured with the max illumination strategy.
    Fig. 5. NMSE performance of quantized FP algorithm as a function of raw image bit depth, evaluated using a pathology dataset consisting of 30 unique samples. Each point in plots (a) and (b) is average NMSE across all 30 samples. An example low-resolution image and reconstruction pair is shown for 1-, 2-, 3-, and 8-bit raw image datasets captured with the max illumination strategy.
    Simulation results comparing the influence of FP overlap ratio on reconstruction quality using the max exposure strategy. Each point in the plot is the average NMSE of 12 different samples. (a)–(d) on right refer to sampling rate in Fourier space. Brightness of each pixel in k-space refers to the number of measured images it is associated with. Gaps in the sampled frequency coverage exist below approximately 38% overlap.
    Fig. 6. Simulation results comparing the influence of FP overlap ratio on reconstruction quality using the max exposure strategy. Each point in the plot is the average NMSE of 12 different samples. (a)–(d) on right refer to sampling rate in Fourier space. Brightness of each pixel in k-space refers to the number of measured images it is associated with. Gaps in the sampled frequency coverage exist below approximately 38% overlap.
    Experimental results from an FP setup using a 12-bit CMOS image sensor, whose image data was binarized post-capture before reconstruction. Quantized FP algorithm reconstructions using binarized image data (median exposure model) closely match standard FP reconstructions from 12-bit images.
    Fig. 7. Experimental results from an FP setup using a 12-bit CMOS image sensor, whose image data was binarized post-capture before reconstruction. Quantized FP algorithm reconstructions using binarized image data (median exposure model) closely match standard FP reconstructions from 12-bit images.
    Experimental results from the SPAD array camera. Comparison between the standard FP on the HDR dataset and the quantized FP on the binarized dataset with the median exposure strategy is shown for three different samples.
    Fig. 8. Experimental results from the SPAD array camera. Comparison between the standard FP on the HDR dataset and the quantized FP on the binarized dataset with the median exposure strategy is shown for three different samples.
    (a1), (a2) Example raw SPAD array data captured and (b1), (b2) show the denoised versions. (c1) and (c2) shows the SNR for selected bright-field and dark-field images.
    Fig. 9. (a1), (a2) Example raw SPAD array data captured and (b1), (b2) show the denoised versions. (c1) and (c2) shows the SNR for selected bright-field and dark-field images.
    1: input: initial guess O(k), system pupil P(k), measurements y^n(r), iteration number T, LED number L, and bit-depth M
    2: fort=1,2,,Tdo
    3:     forn=1,2,,Ldo
    4:         ψ(r)=F1[P(k)Ot1,n(kkn)]
    5:         zn(r)=|ψ(r)|2, yn(r)=QM[αn·zn(r)]
    6:        E=|y^n(r)yn(r)|0 ▹ Proposed error-map
    7:        ψ(r)=[y^n(r)αn·2ME+|ψ(r)|(1E)]exp[iψ(r)]
    8:        Ot,n(kkn)=Ot1,n(kkn)δ[P(k)]F[ψ(r)ψ(r)]|P(k)|max[|P(k)|2+ξ] ▹ Sequential Gauss–Newton update
    9: return:OT,L(k)
    Table 1. Proposed Quantized FP Reconstruction
    Xi Yang, Pavan Chandra Konda, Shiqi Xu, Liheng Bian, Roarke Horstmeyer. Quantized Fourier ptychography with binary images from SPAD cameras[J]. Photonics Research, 2021, 9(10): 1958
    Download Citation