• Journal of Infrared and Millimeter Waves
  • Vol. 39, Issue 6, 810 (2020)
Zhi-Jian LI1、2, Feng-Bao YANG1、*, Yu-Bin GAO3, Lin-Na JI1, and Peng HU1
Author Affiliations
  • 1School of Information and Communication Engineering, North University of China, Taiyuan030051, China
  • 2North University of China, Shuozhou, Shuozhou036000, China
  • 3Department of Mathematics, North University of China, Taiyuan030051, China
  • show less
    DOI: 10.11972/j.issn.1001-9014.2020.06.021 Cite this Article
    Zhi-Jian LI, Feng-Bao YANG, Yu-Bin GAO, Lin-Na JI, Peng HU. Fusion method for infrared and other-type images based on the multi-scale Gaussian filtering and morphological transform[J]. Journal of Infrared and Millimeter Waves, 2020, 39(6): 810 Copy Citation Text show less
    Example of four-level decomposition by multi-scale Gaussian filtering
    Fig. 1. Example of four-level decomposition by multi-scale Gaussian filtering
    [in Chinese]
    Fig. 2. [in Chinese]
    [in Chinese]
    Fig. 3. [in Chinese]
    The two kinds of source images (a) infrared-visible images, (b) infrared intensity-polarization images
    Fig. 4. The two kinds of source images (a) infrared-visible images, (b) infrared intensity-polarization images
    [in Chinese]
    Fig. 5. [in Chinese]
    Fusion results of one pair of the infrared-visible images (a) infrared image, (b) visible image, (c)-(i) the fusion results of the DWT, DTCWT, SWT, WPT, NSCT, NSST, and the proposed methods.
    Fig. 6. Fusion results of one pair of the infrared-visible images (a) infrared image, (b) visible image, (c)-(i) the fusion results of the DWT, DTCWT, SWT, WPT, NSCT, NSST, and the proposed methods.
    Fusion results of one pair of the infrared intensity-polarization images (a) Infrared intensity image, (b) Infrared polarization image, (c)-(i) the fusion results of the DWT, DTCWT, SWT, WPT, NSCT, NSST, and the proposed methods.
    Fig. 7. Fusion results of one pair of the infrared intensity-polarization images (a) Infrared intensity image, (b) Infrared polarization image, (c)-(i) the fusion results of the DWT, DTCWT, SWT, WPT, NSCT, NSST, and the proposed methods.
    MethodsPyramid filterFilterLevels
    DWTrbio1.33
    DTCWT5-7q-63
    SWTbior1.33
    WPTbior1.33
    NSCTmaxflatdmaxflat54,8,16
    NSSTmaxflat4,8,16
    Table 1. The parameters set in the compared methods. ‘Filter’ represents the Orientation filter; ‘Levels’ denotes the decomposition levels and the corresponding number of orientations for each level.
    Source imagesParameters
    σ0k[K, M, N1, N2, N3]
    Infrared-visible0.61.4[3,2,0,1,2]
    Infrared intensity-polarization0.61.1[3,2,1,1,2]
    Table 2. The parameters of the proposed method for the four kinds of source images.
    ImagesMethodsQ0QAB/FQEIEMITCVIF
    Infrared-visibleDWT0.439 10.485 80.226 86.660 12.165 80.258 80.293 6
    DTCWT0.444 60.517 30.257 96.683 02.223 50.293 70.294 9
    SWT0.445 20.509 70.245 76.615 52.187 20.220 30.278 4
    WPT0.407 90.395 20.161 46.638 52.194 90.274 50.273 8
    NSCT0.466 90.528 10.259 56.696 12.263 30.294 00.314 5
    NSST0.465 30.523 10.257 06.685 82.257 50.290 20.310 3
    Proposed0.475 70.535 60.268 96.735 92.470 70.317 70.362 6
    Infrared intensity-polarizationDWT0.385 30.420 60.167 66.478 22.266 40.347 60.219 6
    DTCWT0.394 40.458 50.208 96.570 72.341 50.468 40.243 7
    SWT0.387 50.439 10.193 16.473 02.342 90.330 80.230 0
    WPT0.346 90.343 90.119 86.405 22.291 70.443 70.197 2
    NSCT0.413 30.467 50.197 76.564 62.391 70.458 50.257 4
    NSST0.413 80.464 10.199 56.574 02.389 80.459 70.259 2
    Proposed0.413 40.469 00.201 36.658 02.624 10.547 80.313 7
    Table 3. Objective assessment of all methods (the best result of each metric is highlighted in bold).
    Image sequencesDWTDTCWTSWTWPTNSCTNSSTProposed
    Nato_camp0.018 00.036 20.064 70.140 124.517 32.307 20.141 9
    Tree0.016 50.035 70.064 30.139 824.821 52.292 30.141 1
    Duine0.017 10.036 10.064 10.140 624.584 12.288 10.141 2
    Table 4. Average processing time (unit: sec.) comparison of eight methods. Each value represents the average run time of a frame in a certain sequence.
    Zhi-Jian LI, Feng-Bao YANG, Yu-Bin GAO, Lin-Na JI, Peng HU. Fusion method for infrared and other-type images based on the multi-scale Gaussian filtering and morphological transform[J]. Journal of Infrared and Millimeter Waves, 2020, 39(6): 810
    Download Citation