• Photonics Research
  • Vol. 8, Issue 10, 1624 (2020)
Zhenyu Zhou1, Jun Xia1、*, Jun Wu1, Chenliang Chang2, Xi Ye3, Shuguang Li3, Bintao Du1, Hao Zhang1, and Guodong Tong1
Author Affiliations
  • 1Joint International Research Laboratory of Information Display and Visualization, School of Electronic Science and Engineering, Southeast University, Nanjing 210096, China
  • 2Department of Bioengineering, University of California, Los Angeles, California 90095, USA
  • 3Shanghai Aerospace Electronic Technology Institute, Shanghai 201109, China
  • show less
    DOI: 10.1364/PRJ.398583 Cite this Article Set citation alerts
    Zhenyu Zhou, Jun Xia, Jun Wu, Chenliang Chang, Xi Ye, Shuguang Li, Bintao Du, Hao Zhang, Guodong Tong. Learning-based phase imaging using a low-bit-depth pattern[J]. Photonics Research, 2020, 8(10): 1624 Copy Citation Text show less
    (a) Beam passes through an ideal random phase mask with negligible thickness and speckles generated by two light beams with different incident angles. The two speckle patterns show high similarity, and the speckle grains in the circles indicate the same local features. (b) Conceptual demonstration of the optical memory effect. Placing a phase object causes a local tilt of the incident light wavefront, which results in a partial translation of the speckle.
    Fig. 1. (a) Beam passes through an ideal random phase mask with negligible thickness and speckles generated by two light beams with different incident angles. The two speckle patterns show high similarity, and the speckle grains in the circles indicate the same local features. (b) Conceptual demonstration of the optical memory effect. Placing a phase object causes a local tilt of the incident light wavefront, which results in a partial translation of the speckle.
    Experimental setup for speckle pattern acquisition. Phase objects are loaded by the spatial light modulator. The thin diffuser is placed at the back focal plane of the 4−f system. (a) Designated speckle acquisition window (white dotted line box). (b) Autocorrelation of speckle patterns at different diffraction distances d2 and the correlation width is ∼20 μm. (c) Cross-correlation coefficients between speckle patterns corresponding to different incoming wavefronts at distances d2 varying from 5 to 80 mm. POL, linear polarizer; SLM, spatial light modulator; BS, beam splitter; CAM, camera.
    Fig. 2. Experimental setup for speckle pattern acquisition. Phase objects are loaded by the spatial light modulator. The thin diffuser is placed at the back focal plane of the 4f system. (a) Designated speckle acquisition window (white dotted line box). (b) Autocorrelation of speckle patterns at different diffraction distances d2 and the correlation width is 20  μm. (c) Cross-correlation coefficients between speckle patterns corresponding to different incoming wavefronts at distances d2 varying from 5 to 80 mm. POL, linear polarizer; SLM, spatial light modulator; BS, beam splitter; CAM, camera.
    Schematic diagram of the proposed method for phase imaging and the basic architecture of CNN. The input to the network is a single-shot low-bit pattern or raw intensity measurement.
    Fig. 3. Schematic diagram of the proposed method for phase imaging and the basic architecture of CNN. The input to the network is a single-shot low-bit pattern or raw intensity measurement.
    Experimental results of phase recovery on (a) random grayscale image datasets (i–iii) and (b) human face datasets (iv–vi) with different diffraction distances d2. The images in leftmost column of each graph block are the speckle patterns, and the phase maps in the blue and the orange solid line boxes are estimates implemented by SDVF and DNN, respectively.
    Fig. 4. Experimental results of phase recovery on (a) random grayscale image datasets (i–iii) and (b) human face datasets (iv–vi) with different diffraction distances d2. The images in leftmost column of each graph block are the speckle patterns, and the phase maps in the blue and the orange solid line boxes are estimates implemented by SDVF and DNN, respectively.
    (a) Raw measurement and processed patterns with different bit depth; (b) SSIM of the reconstructions at each image bit depth.
    Fig. 5. (a) Raw measurement and processed patterns with different bit depth; (b) SSIM of the reconstructions at each image bit depth.
    Experimental demonstration of phase imaging with low-bit speckle pattern. Results of reconstructing random smooth phase maps (left) and human face images (right) via DNN with patterns of different bit depths. The images in the middle column of each graph group are enlarged views of the areas selected by the yellow dotted box in the low-bit speckle patterns in the first column. The speckle patterns acquired at a distance of d2=60 mm show lower local similarity and correspondingly lower reconstruction accuracy than the case of d2=5 mm.
    Fig. 6. Experimental demonstration of phase imaging with low-bit speckle pattern. Results of reconstructing random smooth phase maps (left) and human face images (right) via DNN with patterns of different bit depths. The images in the middle column of each graph group are enlarged views of the areas selected by the yellow dotted box in the low-bit speckle patterns in the first column. The speckle patterns acquired at a distance of d2=60  mm show lower local similarity and correspondingly lower reconstruction accuracy than the case of d2=5  mm.
    Generalizability testing of the trained DNN in full-bit (10 bit measurement) and low-bit (1 bit binary pattern) imaging and comparison of the results of phase recovery under the three schemes: (i) imaging using diffraction patterns (without diffuser) via DNN; (ii) imaging using speckle patterns (with diffuser) via DNN; (iii) imaging using speckle patterns (with diffuser) via SDVF. All the data acquisitions adopt the same experimental configuration except for the diffuser settings. The distance between the diffuser and the camera sensor is fixed to 5 mm in both scheme (ii) and scheme (iii).
    Fig. 7. Generalizability testing of the trained DNN in full-bit (10 bit measurement) and low-bit (1 bit binary pattern) imaging and comparison of the results of phase recovery under the three schemes: (i) imaging using diffraction patterns (without diffuser) via DNN; (ii) imaging using speckle patterns (with diffuser) via DNN; (iii) imaging using speckle patterns (with diffuser) via SDVF. All the data acquisitions adopt the same experimental configuration except for the diffuser settings. The distance between the diffuser and the camera sensor is fixed to 5 mm in both scheme (ii) and scheme (iii).
    (a) Gray statistics of captured speckle images. Inset: graph of imaging accuracy and pattern sparseness at various binarization thresholds. (b) Result of reconstructing objects from binary patterns with different sparseness.
    Fig. 8. (a) Gray statistics of captured speckle images. Inset: graph of imaging accuracy and pattern sparseness at various binarization thresholds. (b) Result of reconstructing objects from binary patterns with different sparseness.
    d2MethodMean Value 1Mean Value 2
    60 mmSDVF0.91110.6484
    DNN0.95930.7746
    30 mmSDVF0.90770.6838
    DNN0.97200.7790
    10 mmSDVF0.93200.7701
    DNN0.95520.8570
    5 mmSDVF0.92990.8038
    DNN0.96860.9147
    Table 1. Mean Values of Structural Similarity Index (SSIM) of DNN and SDVF on the Dataset
    MethodBit DepthLFW Face (Train)ImageNet Random Phase
    DNN10 bit0.87290.73570.8816
    (Diffraction)1 bit0.62000.48740.6628
    DNN10 bit0.89480.80280.9297
    (Speckle)1 bit0.79560.74940.8721
    SDVF10 bit0.72040.55240.9281
    1 bit0.60510.52200.9234
    Table 2. Mean Values of Structural Similarity Index (SSIM) of DNN (Speckle), DNN (Diffraction) and SDVF on Three Classes of Samples
    Zhenyu Zhou, Jun Xia, Jun Wu, Chenliang Chang, Xi Ye, Shuguang Li, Bintao Du, Hao Zhang, Guodong Tong. Learning-based phase imaging using a low-bit-depth pattern[J]. Photonics Research, 2020, 8(10): 1624
    Download Citation