• Photonics Research
  • Vol. 11, Issue 4, 631 (2023)
Huanhao Li1、2、†, Zhipeng Yu1、2、†, Qi Zhao1、2、†, Yunqi Luo3, Shengfu Cheng1、2, Tianting Zhong1、2, Chi Man Woo1、2, Honglin Liu1、4, Lihong V. Wang5、7、*, Yuanjin Zheng3、8、*, and Puxiang Lai1、2、6、9、*
Author Affiliations
  • 1Department of Biomedical Engineering, Hong Kong Polytechnic University, Hong Kong, China
  • 2Hong Kong Polytechnic University Shenzhen Research Institute, Shenzhen 518063, China
  • 3School of Electrical and Electronics Engineering, Nanyang Technological University, Singapore 639798, Singapore
  • 4Key Laboratory for Quantum Optics, Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, Shanghai 201800, China
  • 5Caltech Optical Imaging Laboratory, Andrew and Peggy Cherng Department of Medical Engineering, California Institute of Technology, Pasadena, California 91125, USA
  • 6Photonics Research Institute, Hong Kong Polytechnic University, Hong Kong, China
  • 7e-mail: LVW@caltech.edu
  • 8e-mail: yjzheng@ntu.edu.sg
  • 9e-mail: puxiang.lai@polyu.edu.hk
  • show less
    DOI: 10.1364/PRJ.472512 Cite this Article Set citation alerts
    Huanhao Li, Zhipeng Yu, Qi Zhao, Yunqi Luo, Shengfu Cheng, Tianting Zhong, Chi Man Woo, Honglin Liu, Lihong V. Wang, Yuanjin Zheng, Puxiang Lai. Learning-based super-resolution interpolation for sub-Nyquist sampled laser speckles[J]. Photonics Research, 2023, 11(4): 631 Copy Citation Text show less

    Abstract

    Information retrieval from visually random optical speckle patterns is desired in many scenarios yet considered challenging. It requires accurate understanding or mapping of the multiple scattering process, or reliable capability to reverse or compensate for the scattering-induced phase distortions. In whatever situation, effective resolving and digitization of speckle patterns are necessary. Nevertheless, on some occasions, to increase the acquisition speed and/or signal-to-noise ratio (SNR), speckles captured by cameras are inevitably sampled in the sub-Nyquist domain via pixel binning (one camera pixel contains multiple speckle grains) due to finite size or limited bandwidth of photosensors. Such a down-sampling process is irreversible; it undermines the fine structures of speckle grains and hence the encoded information, preventing successful information extraction. To retrace the lost information, super-resolution interpolation for such sub-Nyquist sampled speckles is needed. In this work, a deep neural network, namely SpkSRNet, is proposed to effectively up sample speckles that are sampled below 1/10 of the Nyquist criterion to well-resolved ones that not only resemble the comprehensive morphology of original speckles (decompose multiple speckle grains from one camera pixel) but also recover the lost complex information (human face in this study) with high fidelity under normal- and low-light conditions, which is impossible with classic interpolation methods. These successful speckle super-resolution interpolation demonstrations are essentially enabled by the strong implicit correlation among speckle grains, which is non-quantifiable but could be discovered by the well-trained network. With further engineering, the proposed learning platform may benefit many scenarios that are physically inaccessible, enabling fast acquisition of speckles with sufficient SNR and opening up new avenues for seeing big and seeing clearly simultaneously in complex scenarios.
    f1(y,y^)=NPCC(y,y^)+MSE(y,y^)=(yy)(y^y^)σyσy^+||yy^||2,

    View in Article

    f2(y,y^)=SSIM(y,y^)+CL(y,y^)=(2yy^+c1)(σyy^+c2)(y2+y^2+c1)(σy2+σy^2+c2)+(yy^)2+ϵ2,

    View in Article

    F1(y,y^)=f1(y,y^)+f1[Sn(y),Sn(y^)]+f1(y,y^),

    View in Article

    F2(y,y^)=f2(y,y^)+f2[Sn(y),Sn(y^)]f2(y,y^),

    View in Article

    Huanhao Li, Zhipeng Yu, Qi Zhao, Yunqi Luo, Shengfu Cheng, Tianting Zhong, Chi Man Woo, Honglin Liu, Lihong V. Wang, Yuanjin Zheng, Puxiang Lai. Learning-based super-resolution interpolation for sub-Nyquist sampled laser speckles[J]. Photonics Research, 2023, 11(4): 631
    Download Citation