• Journal of Innovative Optical Health Sciences
  • Vol. 17, Issue 2, 2350015 (2024)
Yanwei Zhang1、2, Song Lang1、2, Xuan Cao3, Hanqing Zheng2, and Yan Gong1、2、*
Author Affiliations
  • 1School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, Anhui 230026, P. R. China
  • 2Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, Jiangsu 215163, P. R. China
  • 3School of Physical Science and Technology, Suzhou University of Science and Technology, Suzhou, Jiangsu 215009, P. R. China
  • show less
    DOI: 10.1142/S1793545823500153 Cite this Article
    Yanwei Zhang, Song Lang, Xuan Cao, Hanqing Zheng, Yan Gong. Deep neural network based on multi-level wavelet and attention for structured illumination microscopy[J]. Journal of Innovative Optical Health Sciences, 2024, 17(2): 2350015 Copy Citation Text show less

    Abstract

    Structured illumination microscopy (SIM) is a popular and powerful super-resolution (SR) technique in biomedical research. However, the conventional reconstruction algorithm for SIM heavily relies on the accurate prior knowledge of illumination patterns and signal-to-noise ratio (SNR) of raw images. To obtain high-quality SR images, several raw images need to be captured under high fluorescence level, which further restricts SIM’s temporal resolution and its applications. Deep learning (DL) is a data-driven technology that has been used to expand the limits of optical microscopy. In this study, we propose a deep neural network based on multi-level wavelet and attention mechanism (MWAM) for SIM. Our results show that the MWAM network can extract high-frequency information contained in SIM raw images and accurately integrate it into the output image, resulting in superior SR images compared to those generated using wide-field images as input data. We also demonstrate that the number of SIM raw images can be reduced to three, with one image in each illumination orientation, to achieve the optimal tradeoff between temporal and spatial resolution. Furthermore, our MWAM network exhibits superior reconstruction ability on low-SNR images compared to conventional SIM algorithms. We have also analyzed the adaptability of this network on other biological samples and successfully applied the pretrained model to other SIM systems.
    Yanwei Zhang, Song Lang, Xuan Cao, Hanqing Zheng, Yan Gong. Deep neural network based on multi-level wavelet and attention for structured illumination microscopy[J]. Journal of Innovative Optical Health Sciences, 2024, 17(2): 2350015
    Download Citation