• Laser & Optoelectronics Progress
  • Vol. 57, Issue 8, 081013 (2020)
Heng Li1、*, Liming Zhang2、3、**, Meirong Jiang2, and Yulong Li1
Author Affiliations
  • 1School of Electronics and Information Engineering, Lanzhou Jiaotong University, Lanzhou, Gansu 730070, China
  • 2Faculty of Geomatics, Lanzhou Jiaotong University, Lanzhou, Gansu 730070, China
  • 3Gansu Provincial Engineering Laboratory for National Geographic State Monitoring, Lanzhou, Gansu 730070, China
  • show less
    DOI: 10.3788/LOP57.081013 Cite this Article Set citation alerts
    Heng Li, Liming Zhang, Meirong Jiang, Yulong Li. An Infrared and Visible Image Fusion Algorithm Based on ResNet152[J]. Laser & Optoelectronics Progress, 2020, 57(8): 081013 Copy Citation Text show less

    Abstract

    In order to improve the details of fusion image from infrared and visible image and reduce artifacts and noise, an infrared and visible image fusion algorithm based on ResNet152 deep learning model is proposed. Firstly, the source image is decomposed into the low frequency part and the high frequency part. The low frequency part is fused by the average weighting strategy to put a new low frequency part. The high frequency part is extracted by ResNet152 to obtain multiple feature layers.The L1 regularization, convolution operation, bilinear interpolation upsampling, and maximum selection strategy for the feature layers to obtain the maximum weight layer. Multiplying the maximum weight layer and the high frequency part to obtain a new high frequency part. Finally, the image is reconstructed by the new low frequency part and high frequency part. Experimental results show that the proposed algorithm can get more texture information while retaining the significant features of the image, and effectively reduces artifacts and noise. The subjective evaluation and objective evaluation are better than the comparison algorithm.
    Heng Li, Liming Zhang, Meirong Jiang, Yulong Li. An Infrared and Visible Image Fusion Algorithm Based on ResNet152[J]. Laser & Optoelectronics Progress, 2020, 57(8): 081013
    Download Citation