• Laser & Optoelectronics Progress
  • Vol. 59, Issue 22, 2201001 (2022)
Yiming Guo1、2、3, Xiaoqing Wu1、3、*, Changdong Su1、2、3, Shitai Zhang1、2、3, Cuicui Bi1、2、3, and Zhiwei Tao1、2
Author Affiliations
  • 1Key Laboratory of Atmospheric Optics, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, Anhui, China
  • 2University of Science and Technology of China, Hefei 230026, Anhui, China
  • 3Advanced Laser Technology Laboratory of Anhui Province, Hefei 230037, Anhui, China
  • show less
    DOI: 10.3788/LOP202259.2201001 Cite this Article Set citation alerts
    Yiming Guo, Xiaoqing Wu, Changdong Su, Shitai Zhang, Cuicui Bi, Zhiwei Tao. Rapid Restoration of Turbulent Degraded Images Based on Bidirectional Multi-Scale Feature Fusion[J]. Laser & Optoelectronics Progress, 2022, 59(22): 2201001 Copy Citation Text show less

    Abstract

    This study proposes a generative adversarial network (GAN) based on bidirectional multi-scale feature fusion to reconstruct target celestial images captured by various ground-based telescopes, which are influenced by atmospheric turbulence. This approach first constructs a dataset for network training by convolving a long-exposure atmospheric turbulence degradation model with clear images and then validates the network's performance on a simulated turbulence image dataset. Furthermore, images of the International Space Station collected by the Munin ground-based telescope (Cassegrain-type telescope) that were influenced by atmospheric turbulence are included in this study. These images were sent to the proposed neural network model for testing. Different image restoration assessment shows that the proposed network has a good real-time performance and can produce restoration results within 0.5 s, which is more than 10 times faster than standard nonneural network restoration approaches; the peak signal to noise ratio (PSNR) is improved by 2 dB?3 dB, and structural similarity (SSIM) is enhanced by 9.3%. Simultaneously, the proposed network has a pretty good restoration impact on degraded images that are influenced by real turbulence.
    g(x,y)=h(x,y)*f(x,y)+n(x,y)
    H(u,v)=e-3.44λfvu2+vv2r053
    H(u,v)=e-k(vu2+vv2)5/6
    minGmaxDV(D,G)minGmaxDExPdata(x)logD(x)+Ezpdata(z)log1-DG(z)
    L=LGAN+λ·LX
    LGAN=n=1N-DθDGθGIB
    LX=1Wi,jHi,jx=1Wi,jy=1Hi,ji,jISx,y-i,jGθGIBx,y2
    RPSN=10log10CmaxI2EMS
    EMS=1mni=0m-1j=0n-1Ii,j-ki,j2
    SSIMx,y=2uxuy+c12σxy+c2ux2+uy2+c1σx2+σy2+c2
    FR=1m×ni=1mj=2n(fi,j-fi,j-1)2
    FC=1m×ni=2mj=1n(fi,j-fi-1,j)2
    FS=FR2+FC2
    G¯=1m×ni=1mj=1nfi,jxi2+fi,jyj221/2
    Yiming Guo, Xiaoqing Wu, Changdong Su, Shitai Zhang, Cuicui Bi, Zhiwei Tao. Rapid Restoration of Turbulent Degraded Images Based on Bidirectional Multi-Scale Feature Fusion[J]. Laser & Optoelectronics Progress, 2022, 59(22): 2201001
    Download Citation