• Acta Optica Sinica
  • Vol. 39, Issue 10, 1015001 (2019)
Zetao Jiang and Yuting He*
Author Affiliations
  • Guangxi Key Laboratory of Image and Graphic Intelligent Processing, Guilin University of Electronic Technology, Guilin, Guangxi 541004, China
  • show less
    DOI: 10.3788/AOS201939.1015001 Cite this Article Set citation alerts
    Zetao Jiang, Yuting He. Infrared and Visible Image Fusion Method Based on Convolutional Auto-Encoder and Residual Block[J]. Acta Optica Sinica, 2019, 39(10): 1015001 Copy Citation Text show less
    Architecture of residual block
    Fig. 1. Architecture of residual block
    Network architecture of proposed method
    Fig. 2. Network architecture of proposed method
    Diagram of fusion strategy
    Fig. 3. Diagram of fusion strategy
    Decline curves of different loss functions in training process
    Fig. 4. Decline curves of different loss functions in training process
    Framework of training process
    Fig. 5. Framework of training process
    The first group of image fusion contrast experiments. (a) Infrared image; (b) visible image; (c) method in Ref. [15]; (d) method in Ref. [16]; (e) method in Ref. [17]; (f) method in Ref. [18]; (g) proposed method
    Fig. 6. The first group of image fusion contrast experiments. (a) Infrared image; (b) visible image; (c) method in Ref. [15]; (d) method in Ref. [16]; (e) method in Ref. [17]; (f) method in Ref. [18]; (g) proposed method
    The second group of image fusion contrast experiments. (a) Infrared image; (b) visible image; (c) method in Ref. [15]; (d) method in Ref. [16]; (e) method in Ref. [17]; (f) method in Ref. [18]; (g) proposed method
    Fig. 7. The second group of image fusion contrast experiments. (a) Infrared image; (b) visible image; (c) method in Ref. [15]; (d) method in Ref. [16]; (e) method in Ref. [17]; (f) method in Ref. [18]; (g) proposed method
    The third group of image fusion contrast experiments. (a) Infrared image; (b) visible image; (c) method in Ref. [15]; (d) method in Ref. [16]; (e) method in Ref. [17]; (f) method in Ref. [18]; (g) proposed method
    Fig. 8. The third group of image fusion contrast experiments. (a) Infrared image; (b) visible image; (c) method in Ref. [15]; (d) method in Ref. [16]; (e) method in Ref. [17]; (f) method in Ref. [18]; (g) proposed method
    Partial results of image fusion contrast experiments. (a1)-(a6) Infrared images; (b1)-(b6) visible images; (c1)-(c6) method in Ref. [15]; (d1)-(d6) method in Ref. [16]; (e1)-(e6) method in Ref. [17]; (f1)-(f6) method in Ref. [18]; (g1)-(g6) proposed method
    Fig. 9. Partial results of image fusion contrast experiments. (a1)-(a6) Infrared images; (b1)-(b6) visible images; (c1)-(c6) method in Ref. [15]; (d1)-(d6) method in Ref. [16]; (e1)-(e6) method in Ref. [17]; (f1)-(f6) method in Ref. [18]; (g1)-(g6) proposed method
    Fusion methodIESDAGMI
    Method in Ref. [15]6.707237.0493.529722.3850
    Method in Ref. [16]6.138132.4363.397330.7770
    Method in Ref. [17]6.698433.5903.349022.7620
    Method in Ref. [18]6.751035.1923.435923.1432
    Proposed method6.641138.2704.145531.8710
    Table 1. Objective evaluation indicators of the first group of comparative experimental results
    Fusion methodIESDAGMI
    Method in Ref. [15]7.100053.6733.804015.6260
    Method in Ref. [16]6.954049.5134.253016.5480
    Method in Ref. [17]6.971052.7813.717219.3090
    Method in Ref. [18]7.194751.6644.449613.0329
    Proposed method7.475458.7034.484224.5260
    Table 2. Objective evaluation indicators of the second group of comparative experimental results
    Fusion methodIESDAGMI
    Method in Ref. [15]7.411439.8173.012417.6580
    Method in Ref. [16]7.145935.9163.646717.6800
    Method in Ref. [17]7.076434.8793.171616.9430
    Method in Ref. [18]7.170337.7273.352321.7977
    Proposed method7.348441.7583.845127.3920
    Table 3. Objective evaluation indicators of the third group of comparative experimental results
    Zetao Jiang, Yuting He. Infrared and Visible Image Fusion Method Based on Convolutional Auto-Encoder and Residual Block[J]. Acta Optica Sinica, 2019, 39(10): 1015001
    Download Citation