• Laser & Optoelectronics Progress
  • Vol. 58, Issue 16, 1610005 (2021)
Yushuang Zhang, Wenbo Han*, Danfei Huang**, Liying Zhao, and Aiqi Zhong
Author Affiliations
  • College of Optoelectronic Engineering, Changchun University of Science and Technology, Changchun, Jilin 130022, China
  • show less
    DOI: 10.3788/LOP202158.1610005 Cite this Article Set citation alerts
    Yushuang Zhang, Wenbo Han, Danfei Huang, Liying Zhao, Aiqi Zhong. Research on Multi-Frame Sea Surface Image Super Resolution Algorithm Based on Deep Learning[J]. Laser & Optoelectronics Progress, 2021, 58(16): 1610005 Copy Citation Text show less
    Structural diagram of proposed network
    Fig. 1. Structural diagram of proposed network
    Schematic of light flow estimation
    Fig. 2. Schematic of light flow estimation
    Map of convolutional neural networks in pyramid hierarchy
    Fig. 3. Map of convolutional neural networks in pyramid hierarchy
    Optical flow estimation of multi-frame images. (a)(d)(g) First image; (b)(e)(h) second image; (c)(f)(i) optical flow estimation map
    Fig. 4. Optical flow estimation of multi-frame images. (a)(d)(g) First image; (b)(e)(h) second image; (c)(f)(i) optical flow estimation map
    Spatial transformation module
    Fig. 5. Spatial transformation module
    Structural diagram of residual network
    Fig. 6. Structural diagram of residual network
    High-resolution image sequence and its target frame image
    Fig. 7. High-resolution image sequence and its target frame image
    Simulated low-resolution image sequence and its target frame image
    Fig. 8. Simulated low-resolution image sequence and its target frame image
    Comparison of experimental results of ship images. (a) Original image; (b) Bicubic algorithm; (c) SRCNN algorithm; (d) VDSR algorithm; (e) VDR-DUF algorithm; (f) proposed algorithm
    Fig. 9. Comparison of experimental results of ship images. (a) Original image; (b) Bicubic algorithm; (c) SRCNN algorithm; (d) VDSR algorithm; (e) VDR-DUF algorithm; (f) proposed algorithm
    Comparison of experimental results of beach images. (a) Original image; (b) Bicubic algorithm; (c) SRCNN algorithm; (d) VDSR algorithm; (e) VDR-DUF algorithm; (f) proposed algorithm
    Fig. 10. Comparison of experimental results of beach images. (a) Original image; (b) Bicubic algorithm; (c) SRCNN algorithm; (d) VDSR algorithm; (e) VDR-DUF algorithm; (f) proposed algorithm
    Comparison of experimental results of cliff coast images. (a) Original image; (b) Bicubic algorithm; (c) SRCNN algorithm; (d) VDSR algorithm; (e) VDR-DUF algorithm; (f) proposed algorithm
    Fig. 11. Comparison of experimental results of cliff coast images. (a) Original image; (b) Bicubic algorithm; (c) SRCNN algorithm; (d) VDSR algorithm; (e) VDR-DUF algorithm; (f) proposed algorithm
    Comparison of experimental results of sea surfing images. (a) Original image; (b) Bicubic algorithm; (c) SRCNN algorithm; (d) VDSR algorithm; (e) VDR-DUF algorithm; (f) proposed algorithm
    Fig. 12. Comparison of experimental results of sea surfing images. (a) Original image; (b) Bicubic algorithm; (c) SRCNN algorithm; (d) VDSR algorithm; (e) VDR-DUF algorithm; (f) proposed algorithm
    ImageBicubic algorithmSRCNN algorithmVDSR algorithm
    PSNR /dBSSIMPSNR /dBSSIMPSNR /dBSSIM
    Fig.828.630.9428.880.9529.680.74
    Fig.930.570.9232.000.9334.050.93
    Fig.1029.330.8330.180.8531.190.85
    Fig.1129.640.9530.730.9731.620.98
    ImageVSR-DUF algorithmProposed algorithm
    PSNR /dBSSIMPSNR /dBSSIM
    Fig.825.950.8930.040.96
    Fig.928.450.9033.770.95
    Fig.1024.320.8130.790.85
    Fig.1125.010.9532.780.98
    Table 1. Objective evaluation indexes of each algorithm
    Yushuang Zhang, Wenbo Han, Danfei Huang, Liying Zhao, Aiqi Zhong. Research on Multi-Frame Sea Surface Image Super Resolution Algorithm Based on Deep Learning[J]. Laser & Optoelectronics Progress, 2021, 58(16): 1610005
    Download Citation