• Optics and Precision Engineering
  • Vol. 30, Issue 1, 1 (2022)
Zhihao LIU1, Weiqi JIN1,*, Li LI1, Mozhou SHA2, and Qin GUO2
Author Affiliations
  • 1MoE Key Lab of Photoelectronic Imaging Technology and System, Shool of Optics and Photonics, Beijing Institute of Technology, Beijing0008, China
  • 2Beijng Electro-Mechanical Engineering Institute, Beijing100074, China
  • show less
    DOI: 10.37188/OPE.20223001.0001 Cite this Article
    Zhihao LIU, Weiqi JIN, Li LI, Mozhou SHA, Qin GUO. Four-band coaxial imaging experimental platform and its image fusion methods[J]. Optics and Precision Engineering, 2022, 30(1): 1 Copy Citation Text show less

    Abstract

    To obtain and make full use of the multi-spectrum information of the scene, and to lay the foundation for the research of multi-band image algorithms, a four-band coaxial imaging experimental platform of visible light + near infrared, short wave infrared, mid-wave infrared and long-wave infrared was developed based on uncooled infrared focal plane array (IRFPA). Image processing cases based on the four-band imaging experimental platform were presented. FPGA was used in the preprocessing of each channel of image and the fusion of multi-band image. The image quality of each band was optimized by the preprocessing procedure, that included the blind point correction of the visible sensor and nonuniformity correction of the mid-wave and long-wave infrared sensors based on grad-filtering. Dual-band and four-band image fusion enhanced the color of the fusion image obtained by linear combination in the YUV color space by color transfer, thus resulting in a natural color fusion image as well as ensuring the operating efficiency of the algorithm. Dual-band infrared temperature measurement was performed using medium and long-wave infrared. The blackbody experiment shows that in the temperature range of 20-80 ℃, the accuracy of dual-band temperature measurement is significantly higher than that of single-band temperature measurement, the error of dual-band temperature measurement is less than 3.5%, and the single-point temperature fluctuation range is less than 0.7%. The outfield experiment results show that information fusion images can effectively enhance the human eye’s understanding of scene information. The four-band imaging experimental platform can easily obtain the four-band information of the scene, and image fusion and dual-band temperature measurement can strengthen the understanding of scene information.
    Cx,y(γ)=i=1i=Nj=0j=iγi-j,jxi-jyj=mTγ(1)

    View in Article

    E(γ)=x=1P(Cx,y-IX¯)2(2)

    View in Article

    γ=(MΤM)-1MΤg(3)

    View in Article

    Yi=k1Vis+k2LWIR,Vis>LWIRk2Vis+k1LWIR,VisLWIRUi=m1Vis-m2LWIRVi=m3LWIR-m4Vis(4)

    View in Article

    Yo=(Yi-μi,Y)σT,Y/σi,Y+μT,YUo=(Ui-μi,U)σT,U/σi,U+μT,UVo=(Vi-μi,V)σT,V/σi,V+μT,V(5)

    View in Article

    Yi=k1Vis+k2SWIR+k3MWIR+k4LWIR,      Vis+SWIR>MWIR+LWIRk4Vis+k3SWIR+k2MWIR+k1LWIR,      Vis+SWIRMWIR+LWIRUi=m1Vis+m2SWIR-m3MWIR-m4LWIRVi=m5MWIR+m6LWIR-m7Vis-m8SWIR(6)

    View in Article

    UT=14ADf'2λminλmaxRVλ·ελτaλτ0λMebλ,Tdλ(7)

    View in Article

    QT=U1TU2T=λ1maxλ1minRV1λτaλτ0λMebλ,Tdλλ2maxλ2minRV2λτaλτ0λMebλ,Tdλ(8)

    View in Article

    T=-20 204.1Q3+58 910.1Q2-57 778.2Q+19 093.4(9)

    View in Article

    Zhihao LIU, Weiqi JIN, Li LI, Mozhou SHA, Qin GUO. Four-band coaxial imaging experimental platform and its image fusion methods[J]. Optics and Precision Engineering, 2022, 30(1): 1
    Download Citation