• Laser & Optoelectronics Progress
  • Vol. 58, Issue 14, 1410024 (2021)
Chunping Hou1, Xiaocong Wang1, Han Xia2, and Yang Yang1、*
Author Affiliations
  • 1School of Electrical and Information Engineering,Tianjin University, Tianjin 300072, China
  • 2Tianjin International Engineering Institute, Tianjin University, Tianjin 300072, China
  • show less
    DOI: 10.3788/LOP202158.1410024 Cite this Article Set citation alerts
    Chunping Hou, Xiaocong Wang, Han Xia, Yang Yang. Infrared and Visible Image Fusion Method Based on Dual-Channel Generative Adversarial Network[J]. Laser & Optoelectronics Progress, 2021, 58(14): 1410024 Copy Citation Text show less

    Abstract

    Considering that the existing infrared and visible image fusion methods do not entirely consider the information differences between different modalities and within the same modalities and the fusion image exhibit problems such as loss of detailed texture information and low contrast, this paper proposes an infrared and visible image fusion method based on a dual-channel generative adversarial network. The generation and identification networks are trained through confrontation, and the trained generation network is used as the final image fusion model. The fusion model uses dual-channel to extract features from infrared and visible images to retain more cross-modal information. Furthermore, a self-attention mechanism is introduced to enhance the input features and improve feature-richness in the modal to strengthen the global dependence of feature pixels. The experimental results on the TNO public dataset show that compared with the existing image fusion methods, the fused image obtained by the method has a higher contrast and richer detailed texture than the image obtained using existing image fusion methods. The fused image can efficiently fit human visual perception and performs well across a range of evaluation metrics.
    Chunping Hou, Xiaocong Wang, Han Xia, Yang Yang. Infrared and Visible Image Fusion Method Based on Dual-Channel Generative Adversarial Network[J]. Laser & Optoelectronics Progress, 2021, 58(14): 1410024
    Download Citation