• Acta Optica Sinica
  • Vol. 40, Issue 20, 2010001 (2020)
Songwang Tian, Suzhen Lin*, Haiwei Lei*, Dawei Li, and Lifang Wang
Author Affiliations
  • College of Data Science and Technology, North University of China, Taiyuan, Shanxi 030051, China
  • show less
    DOI: 10.3788/AOS202040.2010001 Cite this Article Set citation alerts
    Songwang Tian, Suzhen Lin, Haiwei Lei, Dawei Li, Lifang Wang. Multi-Band Image Synchronous Super-Resolution and Fusion Method Based on Improved WGAN-GP[J]. Acta Optica Sinica, 2020, 40(20): 2010001 Copy Citation Text show less
    Overall framework of the proposed method
    Fig. 1. Overall framework of the proposed method
    Generator network architecture
    Fig. 2. Generator network architecture
    Discriminator network architecture
    Fig. 3. Discriminator network architecture
    Effect of loss function on results. (a) Adversarial loss+content loss; (b) adversarial loss+perceptual loss; (c) adversarial loss+content loss+perceptual loss
    Fig. 4. Effect of loss function on results. (a) Adversarial loss+content loss; (b) adversarial loss+perceptual loss; (c) adversarial loss+content loss+perceptual loss
    Influence of network structure on results. (a) Low-level image spatial combination information result; (b) high-level feature space combined information results
    Fig. 5. Influence of network structure on results. (a) Low-level image spatial combination information result; (b) high-level feature space combined information results
    Fusion results. (a) Low resolution infrared long wave images; (b) low-resolution infrared short wave images; (c) low resolution visible images; (d) CNN; (e) GAN; (f) Densefuse; (g) DGCNN; (h) proposed method
    Fig. 6. Fusion results. (a) Low resolution infrared long wave images; (b) low-resolution infrared short wave images; (c) low resolution visible images; (d) CNN; (e) GAN; (f) Densefuse; (g) DGCNN; (h) proposed method
    Objective evaluation results.(a) Evaluation metrics for the first fused results; (b) evaluation metrics for the second fused results; (c) evaluation metrics for the third fused results; (d) evaluation metrics for the fourth fused results; (e) evaluation metrics for the fifth fused results; (f) evaluation metrics for the sixth fused results
    Fig. 7. Objective evaluation results.(a) Evaluation metrics for the first fused results; (b) evaluation metrics for the second fused results; (c) evaluation metrics for the third fused results; (d) evaluation metrics for the fourth fused results; (e) evaluation metrics for the fifth fused results; (f) evaluation metrics for the sixth fused results
    Fusion results. (a) Low resolution infrared long wave image; (b) low-resolution infrared short wave image; (c) low resolution visible image; (d) CNN; (e) GAN; (f) Densefuse; (g) DGCNN; (h) proposed method
    Fig. 8. Fusion results. (a) Low resolution infrared long wave image; (b) low-resolution infrared short wave image; (c) low resolution visible image; (d) CNN; (e) GAN; (f) Densefuse; (g) DGCNN; (h) proposed method
    MethodIEAGCSFEIICGM
    CNN7.013.0370.169.2532.643.0298.98
    GAN7.091.7327.854.6317.711.7286.73
    Densefuse7.592.1343.375.8222.422.1297.45
    DGCNN7.372.5249.316.9425.252.5177.43
    Proposed method7.444.2437.0210.3438.954.22107.52
    Table 1. Objective evaluation index values
    Songwang Tian, Suzhen Lin, Haiwei Lei, Dawei Li, Lifang Wang. Multi-Band Image Synchronous Super-Resolution and Fusion Method Based on Improved WGAN-GP[J]. Acta Optica Sinica, 2020, 40(20): 2010001
    Download Citation