• Advanced Imaging
  • Vol. 1, Issue 1, 011001 (2024)
Hanchu Ye1, Zitong Ye1, Yunbo Chen1, Jinfeng Zhang1, Xu Liu1, Cuifang Kuang1、2、3、*, Youhua Chen1、3、*, and Wenjie Liu1、2、*
Author Affiliations
  • 1State Key Laboratory of Extreme Photonics and Instrumentation, College of Optical Science and Engineering, Zhejiang University, Hangzhou, China
  • 2Zhejiang Lab, Hangzhou, China
  • 3Ningbo Innovation Center, Zhejiang University, Ningbo, China
  • show less
    DOI: 10.3788/AI.2024.10003 Cite this Article
    Hanchu Ye, Zitong Ye, Yunbo Chen, Jinfeng Zhang, Xu Liu, Cuifang Kuang, Youhua Chen, Wenjie Liu. Video-level and high-fidelity super-resolution SIM reconstruction enabled by deep learning[J]. Advanced Imaging, 2024, 1(1): 011001 Copy Citation Text show less

    Abstract

    Structure illumination microscopy (SIM) imposes no special requirements on the fluorescent dyes used for sample labeling, yielding resolution exceeding twice the optical diffraction limit with low phototoxicity, which is therefore very favorable for dynamic observation of live samples. However, the traditional SIM algorithm is prone to artifacts due to the high signal-to-noise ratio (SNR) requirement, and existing deep-learning SIM algorithms still have the potential to improve imaging speed. Here, we introduce a deep-learning-based video-level and high-fidelity super-resolution SIM reconstruction method, termed video-level deep-learning SIM (VDL-SIM), which has an imaging speed of up to 47 frame/s, providing a favorable observing experience for users. In addition, VDL-SIM can robustly reconstruct sample details under a low-light dose, which greatly reduces the damage to the sample during imaging. Compared with existing SIM algorithms, VDL-SIM has faster imaging speed than existing deep-learning algorithms, and higher imaging fidelity at low SNR, which is more obvious for traditional algorithms. These characteristics enable VDL-SIM to be a useful video-level super-resolution imaging alternative to conventional methods in challenging imaging conditions.
    CB(x)=Pooling(y).

    View in Article

    y=Conv{x}+Conv{Drop(Conv{x})},

    View in Article

    TCB(x)=Conv{ConvT{x}+y}+Conv{Drop(Conv{ConvT{x}+y})},

    View in Article

    Hanchu Ye, Zitong Ye, Yunbo Chen, Jinfeng Zhang, Xu Liu, Cuifang Kuang, Youhua Chen, Wenjie Liu. Video-level and high-fidelity super-resolution SIM reconstruction enabled by deep learning[J]. Advanced Imaging, 2024, 1(1): 011001
    Download Citation