• Infrared and Laser Engineering
  • Vol. 50, Issue S2, 20200520 (2021)
Yu Zhi1, Juanjuan Zhu1, Rui Liu2, and Haidong Zhang2
Author Affiliations
  • 1College of Space Science and Technology, Xidian University, Xi'an 710071, China
  • 2Shenzhen Fairair Technology Co., Ltd, Shenzhen 518133, China
  • show less
    DOI: 10.3788/IRLA20200520 Cite this Article
    Yu Zhi, Juanjuan Zhu, Rui Liu, Haidong Zhang. Registration of thermal infrared image and visible image based on featured contour quadrilateral[J]. Infrared and Laser Engineering, 2021, 50(S2): 20200520 Copy Citation Text show less
    Flow chart of the proposed algorithm in this paper
    Fig. 1. Flow chart of the proposed algorithm in this paper
    Detection of contour feature points
    Fig. 2. Detection of contour feature points
    Featured contour. (a), (d) Contours of thermal infrared image and visible light image extracted by traditional method; (b), (e) Polygon approximation of contours in reference [10]; (c), (f) Featured contours extracted by proposed FCQ algorithm
    Fig. 3. Featured contour. (a), (d) Contours of thermal infrared image and visible light image extracted by traditional method; (b), (e) Polygon approximation of contours in reference [10]; (c), (f) Featured contours extracted by proposed FCQ algorithm
    Feature contours of thermal infrared and visible images extracted under complex background
    Fig. 4. Feature contours of thermal infrared and visible images extracted under complex background
    [in Chinese]
    Fig. 4. [in Chinese]
    Algorithm flow chart for generating featured contour quadrilateral
    Fig. 5. Algorithm flow chart for generating featured contour quadrilateral
    Calculation of displacement variable deviation value
    Fig. 6. Calculation of displacement variable deviation value
    The first registration result of thermal infrared image and visible image in experiment 1
    Fig. 7. The first registration result of thermal infrared image and visible image in experiment 1
    The second group of thermal infrared image and visible image registration results in experiment 1. (a), (b) Thermal infrared image and its featured contour quadrilateral; (c), (d) Visible image and its featured contour quadrilateral; (e), (f) Registration graph and fusion graph of the FCQ algorithm using improved homography transformation; (g), (h) Registration graph and the fusion graph of FCQ algorithm applying traditional homography transformation
    Fig. 8. The second group of thermal infrared image and visible image registration results in experiment 1. (a), (b) Thermal infrared image and its featured contour quadrilateral; (c), (d) Visible image and its featured contour quadrilateral; (e), (f) Registration graph and fusion graph of the FCQ algorithm using improved homography transformation; (g), (h) Registration graph and the fusion graph of FCQ algorithm applying traditional homography transformation
    [in Chinese]
    Fig. 8. [in Chinese]
    [in Chinese]
    Fig. 8. [in Chinese]
    Registration results of thermal infrared image and visible image in experiment 2
    Fig. 9. Registration results of thermal infrared image and visible image in experiment 2
    Registration result of thermal infrared image and visible image in experiment 3. (a) Thermal infrared image; (b) Visible image; (c) Registration image; (d) Fusion image; (e),(f) Registration graph and the fusion graph without applying the IHT
    Fig. 10. Registration result of thermal infrared image and visible image in experiment 3. (a) Thermal infrared image; (b) Visible image; (c) Registration image; (d) Fusion image; (e),(f) Registration graph and the fusion graph without applying the IHT
    [in Chinese]
    Fig. 10. [in Chinese]
    ${a_{00}}$${a_{11}}$${t_x}$${t_y}$
    Experiment 10.8840.82731.652-10.976
    Experiment 20.805 60.894 138.04713.425
    Experiment 30.8490.87838.283-21.244
    Table 1. Registration matrix parameters in experiments
    AlgorithmsMSERMSE
    SURF- experiment 16.033 3
    FCQ-experiment 1 without IHT3.073 7
    FCQ-experiment 1 with IHT1.520 31.233 0
    SURF-experiment 29.273 6
    FCQ-experiment 2 without IHT2.240 0
    FCQ-experiment 2 with IHT1.144 41.069 8
    SURF-Experiment 39.445 6
    FCQ-experiment 3 without IHT2.107 2
    FCQ-experiment 3 with IHT1.593 51.262 0
    Ref. [10] 6.838 22.615 0
    Ref. [12] 2.459 41.568 2
    Table 2. MSE, RMSE of the three experiments and the comparison groups
    Yu Zhi, Juanjuan Zhu, Rui Liu, Haidong Zhang. Registration of thermal infrared image and visible image based on featured contour quadrilateral[J]. Infrared and Laser Engineering, 2021, 50(S2): 20200520
    Download Citation