• Optics and Precision Engineering
  • Vol. 31, Issue 21, 3212 (2023)
Wenzhe GONG, Jinkui CHU, Haoyuan CHENG, and Ran ZHANG*
Author Affiliations
  • Key Laboratory for Micro/Nano Technology and System of Liaoning Province, Dalian University of Technology, Dalian116024, China
  • show less
    DOI: 10.37188/OPE.20233121.3212 Cite this Article
    Wenzhe GONG, Jinkui CHU, Haoyuan CHENG, Ran ZHANG. Underwater polarization image fusion based on unsupervised learning and attention mechanisms[J]. Optics and Precision Engineering, 2023, 31(21): 3212 Copy Citation Text show less

    Abstract

    As light propagation in water is subject to absorption and scattering effects, acquiring underwater images using conventional intensity cameras can result in low brightness of imaging results, blurred images, and loss of details. In this study, a deep fusion network was applied to underwater polarimetric images; the underwater polarimetric images were fused with light-intensity images using deep learning. First, the underwater active polarization imaging model was analyzed, an experimental setup was built to obtain underwater polarization images to construct a training dataset, and appropriate transformations were performed to expand the dataset. Second, an end-to-end learning framework was constructed based on unsupervised learning and guided by attention mechanism for fusing polarimetric and light intensity images and the loss function and weight parameters were elaborated. Finally, the produced dataset was used to train the network under different loss weight parameters and the fused images were evaluated based on different image evaluation metrics. The experimental results show that the fused underwater images are more detailed, with 24.48% higher information entropy and 139% higher standard deviation than light-intensity images. Unlike other traditional fusion algorithms, the method does not require manual weight parameter adjustment, has faster operation speed, strong robustness, and self-adaptability, which is important for ocean detection and underwater target recognition.
    I(x,y)=S(x,y)+B(x,y)+F(x,y)(1)

    View in Article

    S(x,y)=J(x,y)t(x,y)(2)

    View in Article

    t(x,y)=e-βx,yρx,y(3)

    View in Article

    B(x,y)=B(1-t(x,y))(4)

    View in Article

    I(x,y)=J(x,y)t(x,y)+B(1-t(x,y))(5)

    View in Article

    J(x,y)=I(x,y)-B(1-t(x,y))t(x,y)(6)

    View in Article

    S=S0S1S2S3=I0°+I90°I0°-I90° I45°-I135°Ir-Il(7)

    View in Article

    S'=S0'S1'S2'S3'=121cos2θsin2θ0cos2θcos22θcos2θsin2θ0sin2θcos2θsin2θsin22θ00000S0S1S2S3,(8)

    View in Article

    I'θ=12S0+S1cos2θ+S2sin2θ(9)

    View in Article

    DoLP=S12+S22S0(10)

    View in Article

    φ=12arctanS2S1(11)

    View in Article

    X'=σFcXFsXX+X(12)

    View in Article

                   Fc(X)=BNPWConv2δBNPWConv1GAP(X),(13)

    View in Article

              Fs(X)=BNPWConv2δBNConv1(X).(14)

    View in Article

    LossMSW-SSIM=1-15ω3,5,7,9,11γωLossSSIMIS0,If;ω+1-γωLossSSIMIDoLP,If;ω(15)

    View in Article

    LossSSIMx,y;ω=2ϖxϖy+C12ωxωy+C2ϖx2+ϖy2+C1σωx2+σωy2+C2(16)

    View in Article

    γω=gσωS02gσωS02+gσωDoLP2(17)

    View in Article

    LossL1=1MNIavg-If1(18)

    View in Article

    LMix=αLossMSW-SSIM+1-αGσLossL1(19)

    View in Article

    H(X)=E[log1p(ai)]=-i=1np(ai)logp(ai)(20)

    View in Article

    σ=1MNi=1Mj=1NFi,j-μ2μ=1MNi=1Mj=1NFi,j(21)

    View in Article

    MI(A,B)=H(A)+H(B)-H(A,B)(22)

    View in Article

    MI=12MI(IS0,If)+12MI(IDoLP,If)(23)

    View in Article

    SSIM=12SSIM(IS0,If)+12SSIM(IDoLP,If)(24)

    View in Article

    Wenzhe GONG, Jinkui CHU, Haoyuan CHENG, Ran ZHANG. Underwater polarization image fusion based on unsupervised learning and attention mechanisms[J]. Optics and Precision Engineering, 2023, 31(21): 3212
    Download Citation