• PhotoniX
  • Vol. 5, Issue 1, 1 (2024)
Binglin Shen1, Chenggui Luo1, Wen Pang2, Yajing Jiang3, Wenbo Wu3, Rui Hu1, Junle Qu1, Bobo Gu2, and Liwei Liu1、*
Author Affiliations
  • 1Key Laboratory of Optoelectronic Devices and Systems of Guangdong Province and Ministry of Education, College of Physics and Optoelectronic Engineering, Shenzhen University, Shenzhen 518060, China
  • 2Med-X Research Institute and School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200030, China
  • 3Department of Chemistry, Institute of Molecular Aggregation Science, Tianjin University, Tianjin 300072, China
  • show less
    DOI: 10.1186/s43074-023-00117-0 Cite this Article
    Binglin Shen, Chenggui Luo, Wen Pang, Yajing Jiang, Wenbo Wu, Rui Hu, Junle Qu, Bobo Gu, Liwei Liu. Surmounting photon limits and motion artifacts for biological dynamics imaging via dual-perspective self-supervised learning[J]. PhotoniX, 2024, 5(1): 1 Copy Citation Text show less

    Abstract

    Visualizing rapid biological dynamics like neuronal signaling and microvascular flow is crucial yet challenging due to photon noise and motion artifacts. Here we present a deep learning framework for enhancing the spatiotemporal relations of optical microscopy data. Our approach leverages correlations of mirrored perspectives from conjugated scan paths, training a model to suppress noise and motion blur by restoring degraded spatial features. Quantitative validation on vibrational calcium imaging validates significant gains in spatiotemporal correlation (2.2×), signal-to-noise ratio (9–12 dB), structural similarity (6.6×), and motion tolerance compared to raw data. We further apply the framework to diverse in vivo experiments from mouse cerebral hemodynamics to zebrafish cardiac dynamics. This approach enables the clear visualization of the rapid nutrient flow (30 mm/s) in microcirculation and the systolic and diastolic processes of heartbeat (2.7 cycle/s), as well as cellular and vascular structure in deep cortex. Unlike techniques relying on temporal correlations, learning inherent spatial priors avoids motion-induced artifacts. This self-supervised strategy flexibly enhances live microscopy under photon-limited and motion-prone regimes.
    Binglin Shen, Chenggui Luo, Wen Pang, Yajing Jiang, Wenbo Wu, Rui Hu, Junle Qu, Bobo Gu, Liwei Liu. Surmounting photon limits and motion artifacts for biological dynamics imaging via dual-perspective self-supervised learning[J]. PhotoniX, 2024, 5(1): 1
    Download Citation