• Optics and Precision Engineering
  • Vol. 32, Issue 18, 2836 (2024)
Ao CHENG1, Guoqiang ZHAO2, Ruobing ZHANG2, and Lirong WANG1,*
Author Affiliations
  • 1Soochow University, School of Electronic and information, Suzhou25000, China
  • 2Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou15000, China
  • show less
    DOI: 10.37188/OPE.20243218.2836 Cite this Article
    Ao CHENG, Guoqiang ZHAO, Ruobing ZHANG, Lirong WANG. Instance segmentation of mouse brain scanning electron microscopy images based on fine-tuning nature image model[J]. Optics and Precision Engineering, 2024, 32(18): 2836 Copy Citation Text show less

    Abstract

    The accuracy and robustness of segmentation models are critical considerations in the processing of mouse brain electron microscopy images. We proposed a highly robust two-dimensional segmentation algorithm tailored to the technical characteristics of electron microscopy images, aiming to accurately delineate the morphological structure of cells in each slice. Aiming at accurately delineate the morphological structure of cells in each section,a highly robust two-dimensional segmentation algorithm based on natural image model tailored to the technical characteristics of electron microscopy images was proposed. EM-SAM was based on fine-tuning the backbone network of pre-trained large natural image model SAM for maximizing the capability of features extraction. The model employed the image encoder from the SAM architecture, augmented with a U-shaped decoder, and was fine-tuned specifically for the segmentation of mouse brain electron microscopy images. Experimental results demonstrate that A-Rand achieves 0.054 on public dataset SNEMI3D. Additionally, AP-50 and AP-75 reach 0.883 and 0.604, respectively, on public dataset MitoEM. EM-SAM exhibits high accuracy and robustness in neural segmentation tasks of electron microscopy images, and it can be fine-tuned for different tasks.
    Ao CHENG, Guoqiang ZHAO, Ruobing ZHANG, Lirong WANG. Instance segmentation of mouse brain scanning electron microscopy images based on fine-tuning nature image model[J]. Optics and Precision Engineering, 2024, 32(18): 2836
    Download Citation