• Photonics Research
  • Vol. 11, Issue 1, 1 (2023)
Yuezhi He1、2, Jing Yao1、2, Lina Liu1、2, Yufeng Gao1、2, Jia Yu1、2, Shiwei Ye1、2, Hui Li1、2, and Wei Zheng1、2、*
Author Affiliations
  • 1Research Center for Biomedical Optics and Molecular Imaging, Shenzhen Key Laboratory for Molecular Imaging, Guangdong Provincial Key Laboratory of Biomedical Optical Imaging Technology, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
  • 2CAS Key Laboratory of Health Informatics, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
  • show less
    DOI: 10.1364/PRJ.469231 Cite this Article Set citation alerts
    Yuezhi He, Jing Yao, Lina Liu, Yufeng Gao, Jia Yu, Shiwei Ye, Hui Li, Wei Zheng. Self-supervised deep-learning two-photon microscopy[J]. Photonics Research, 2023, 11(1): 1 Copy Citation Text show less

    Abstract

    Artificial neural networks have shown great proficiency in transforming low-resolution microscopic images into high-resolution images. However, training data remains a challenge, as large-scale open-source databases of microscopic images are rare, particularly 3D data. Moreover, the long training times and the need for expensive computational resources have become a burden to the research community. We introduced a deep-learning-based self-supervised volumetric imaging approach, which we termed “Self-Vision.” The self-supervised approach requires no training data, apart from the input image itself. The lightweight network takes just minutes to train and has demonstrated resolution-enhancing power on par with or better than that of a number of recent microscopy-based models. Moreover, the high throughput power of the network enables large image inference with less postprocessing, facilitating a large field-of-view (2.45 mm×2.45 mm) using a home-built two-photon microscopy system. Self-Vision can recover images from fourfold undersampled inputs in the lateral and axial dimensions, dramatically reducing the acquisition time. Self-Vision facilitates the use of a deep neural network for 3D microscopy imaging, easing the demanding process of image acquisition and network training for current resolution-enhancing networks.
    VL.R.=(VOriginal*PSF)n,

    View in Article

    PReLU(yi)=yi,if  yi0,

    View in Article

    PReLU(yi)=aiyi,if  yi<0,

    View in Article

    yexpansion=PReLU[Conv3d1,16,5(x)],

    View in Article

    yshrinking=PReLU[Conv3d16,6,3(yexpansion)].

    View in Article

    ygrouped convolution=Conv3d6,6,3,2(4)(yshrinking),

    View in Article

    youtput=Conv3d16,1,5{UP[Conv3d6,16,3(ygrouped convolution)]},

    View in Article

    MSE(θ)=1ni=1n[F(x,θ)Y]2,

    View in Article

    Yuezhi He, Jing Yao, Lina Liu, Yufeng Gao, Jia Yu, Shiwei Ye, Hui Li, Wei Zheng. Self-supervised deep-learning two-photon microscopy[J]. Photonics Research, 2023, 11(1): 1
    Download Citation