• Laser & Optoelectronics Progress
  • Vol. 59, Issue 22, 2201001 (2022)
Yiming Guo1、2、3, Xiaoqing Wu1、3、*, Changdong Su1、2、3, Shitai Zhang1、2、3, Cuicui Bi1、2、3, and Zhiwei Tao1、2
Author Affiliations
  • 1Key Laboratory of Atmospheric Optics, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, Anhui, China
  • 2University of Science and Technology of China, Hefei 230026, Anhui, China
  • 3Advanced Laser Technology Laboratory of Anhui Province, Hefei 230037, Anhui, China
  • show less
    DOI: 10.3788/LOP202259.2201001 Cite this Article Set citation alerts
    Yiming Guo, Xiaoqing Wu, Changdong Su, Shitai Zhang, Cuicui Bi, Zhiwei Tao. Rapid Restoration of Turbulent Degraded Images Based on Bidirectional Multi-Scale Feature Fusion[J]. Laser & Optoelectronics Progress, 2022, 59(22): 2201001 Copy Citation Text show less
    Downloaded target celestial images from Hubble official website
    Fig. 1. Downloaded target celestial images from Hubble official website
    Degraded images of simulated target celestial bodies subjected to atmospheric turbulence with different intensities. (a) Degraded images when k=0.001; (b) degraded images when k=0.0025; (c) degraded images when k=0.005
    Fig. 2. Degraded images of simulated target celestial bodies subjected to atmospheric turbulence with different intensities. (a) Degraded images when k=0.001; (b) degraded images when k=0.0025; (c) degraded images when k=0.005
    Generative adversarial network
    Fig. 3. Generative adversarial network
    Multi-scale feature fusion
    Fig. 4. Multi-scale feature fusion
    Topology diagram of generated network architecture
    Fig. 5. Topology diagram of generated network architecture
    Topology structure diagram of BmffGAN overall network[19]
    Fig. 6. Topology structure diagram of BmffGAN overall network[19]
    Process of BmffGAN training. (a) Curve of loss function changing with epoch; (b) curve of PSNR changing with epoch
    Fig. 7. Process of BmffGAN training. (a) Curve of loss function changing with epoch; (b) curve of PSNR changing with epoch
    Comparison of restoration effects of different algorithms on simulated atmospheric turbulence images under k=0.005. (a) Degraded images when the additive noise mean is 0, and the variance is 0.001; (b) SGL algorithm; (c) CLEAR algorithm; (d) IBD algorithm; (e) DNCNN algorithm; (f) BmffGAN
    Fig. 8. Comparison of restoration effects of different algorithms on simulated atmospheric turbulence images under k=0.005. (a) Degraded images when the additive noise mean is 0, and the variance is 0.001; (b) SGL algorithm; (c) CLEAR algorithm; (d) IBD algorithm; (e) DNCNN algorithm; (f) BmffGAN
    Comparison of restoration effects of different algorithms on simulated atmospheric turbulence images under k=0.0025. (a) Degraded images when the additive noise mean is 0, and the variance is 0.001; (b) SGL algorithm; (c) CLEAR algorithm; (d) IBD algorithm; (e) DNCNN algorithm; (f) BmffGAN
    Fig. 9. Comparison of restoration effects of different algorithms on simulated atmospheric turbulence images under k=0.0025. (a) Degraded images when the additive noise mean is 0, and the variance is 0.001; (b) SGL algorithm; (c) CLEAR algorithm; (d) IBD algorithm; (e) DNCNN algorithm; (f) BmffGAN
    Comparison of restoration effects of different algorithms on simulated atmospheric turbulence images under k=0.001. (a) Degraded images when the additive noise mean is 0, and the variance is 0.001; (b) SGL algorithm; (c) CLEAR algorithm; (d) IBD algorithm; (e) DNCNN algorithm; (f) BmffGAN
    Fig. 10. Comparison of restoration effects of different algorithms on simulated atmospheric turbulence images under k=0.001. (a) Degraded images when the additive noise mean is 0, and the variance is 0.001; (b) SGL algorithm; (c) CLEAR algorithm; (d) IBD algorithm; (e) DNCNN algorithm; (f) BmffGAN
    Evaluation indexes of different algorithms for restoration of simulated atmospheric turbulence images with different intensities (average value). (a) PSNR; (b) SSIM; (c) GMSD; (d) recovery time
    Fig. 11. Evaluation indexes of different algorithms for restoration of simulated atmospheric turbulence images with different intensities (average value). (a) PSNR; (b) SSIM; (c) GMSD; (d) recovery time
    Munin ground-based telescope and star chart software
    Fig. 12. Munin ground-based telescope and star chart software
    Comparison experiment for restoring the ISS images affected by real turbulence. (a) ISS images affected by real turbulence; (b) SGL algorithm; (c) CLEAR algorithm; (d) IBD algorithm; (e) DNCNN algorithm; (f) BmffGAN
    Fig. 13. Comparison experiment for restoring the ISS images affected by real turbulence. (a) ISS images affected by real turbulence; (b) SGL algorithm; (c) CLEAR algorithm; (d) IBD algorithm; (e) DNCNN algorithm; (f) BmffGAN
    NetworkSpaceFrequencyAverageGradentTime /s
    SGL264.511.377.83
    CLEAR255.461.8321.41
    IBD55.701.725.97
    DNCNN278.202.192.33
    BmffGAN8.612.050.40
    Table 1. Objective evaluation of different networks(average value)
    Yiming Guo, Xiaoqing Wu, Changdong Su, Shitai Zhang, Cuicui Bi, Zhiwei Tao. Rapid Restoration of Turbulent Degraded Images Based on Bidirectional Multi-Scale Feature Fusion[J]. Laser & Optoelectronics Progress, 2022, 59(22): 2201001
    Download Citation