• Laser & Optoelectronics Progress
  • Vol. 59, Issue 22, 2215005 (2022)
Haitao Yin* and Yongying Yue
Author Affiliations
  • College of Automation & College of Artificial Intelligence, Nanjing University of Posts and Telecommunications, Nanjing 210023, Jiangsu , China
  • show less
    DOI: 10.3788/LOP202259.2215005 Cite this Article Set citation alerts
    Haitao Yin, Yongying Yue. Medical Image Fusion Based on Semisupervised Learning and Generative Adversarial Network[J]. Laser & Optoelectronics Progress, 2022, 59(22): 2215005 Copy Citation Text show less

    Abstract

    To efficiently employ a small amount of labeled data, a medical image fusion network based on semisupervised learning and a generative adversarial network is developed. The developed fusion network comprises one generator and two discriminators. A semisupervised learning scheme is developed to train the network, including the supervised-training, unsupervised training, and parameters fine-tuning phases. Furthermore, the generator is constructed using a fusion inspired U-Net, squeeze and excitation attention modules. The discriminator contains three convolution layers, one fully connected layer, and a sigmoid activation function. The experimental findings on different multimodal medical images exhibit the proposed approach is competitive with six existing deep-learning based approaches in terms of visual effects and objective indexes. Moreover, the ablation investigations show the effectiveness of a semisupervised learning scheme that can enhance the quality of fused images.
    Haitao Yin, Yongying Yue. Medical Image Fusion Based on Semisupervised Learning and Generative Adversarial Network[J]. Laser & Optoelectronics Progress, 2022, 59(22): 2215005
    Download Citation