• Laser & Optoelectronics Progress
  • Vol. 57, Issue 14, 141002 (2020)
Weipei Jin1, Jichang Guo1、*, and Qing Qi1、2
Author Affiliations
  • 1School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China
  • 2School of Physics and Electronic Information Engineering, Qinghai Nationalities University, Xining, Qinghai 810007, China
  • show less
    DOI: 10.3788/LOP57.141002 Cite this Article Set citation alerts
    Weipei Jin, Jichang Guo, Qing Qi. Underwater Image Enhancement Based on Conditional Generative Adversarial Network[J]. Laser & Optoelectronics Progress, 2020, 57(14): 141002 Copy Citation Text show less
    Framework of StarGAN
    Fig. 1. Framework of StarGAN
    RRDB network structure. (a) RRDB module; (b) dense block structure
    Fig. 2. RRDB network structure. (a) RRDB module; (b) dense block structure
    Framework of the proposed method
    Fig. 3. Framework of the proposed method
    Network structure of generative model
    Fig. 4. Network structure of generative model
    Network structure of discriminative model
    Fig. 5. Network structure of discriminative model
    Four categories of label images. (a)Indoor image; (b) bluish underwater image; (c) greenish underwater image; (d) yellowish underwater image
    Fig. 6. Four categories of label images. (a)Indoor image; (b) bluish underwater image; (c) greenish underwater image; (d) yellowish underwater image
    Sharpness results of synthesized underwater images. (a) Underwater images; (b) results of CLAHE algorithm; (c) results of RED algorithm; (d) results of CycleGAN algorithm; (e) results of UWGAN algorithm; (f) results of StarGAN algorithm; (g) results of proposed method; (h) original images
    Fig. 7. Sharpness results of synthesized underwater images. (a) Underwater images; (b) results of CLAHE algorithm; (c) results of RED algorithm; (d) results of CycleGAN algorithm; (e) results of UWGAN algorithm; (f) results of StarGAN algorithm; (g) results of proposed method; (h) original images
    Sharpness results of the bluish underwater images. (a) Underwater images; (b) results of CLAHE algorithm; (c) results of RED algorithm; (d) results of CycleGAN algorithm; (e) results of UWGAN algorithm; (f) results of StarGAN algorithm; (g) results of proposed method
    Fig. 8. Sharpness results of the bluish underwater images. (a) Underwater images; (b) results of CLAHE algorithm; (c) results of RED algorithm; (d) results of CycleGAN algorithm; (e) results of UWGAN algorithm; (f) results of StarGAN algorithm; (g) results of proposed method
    Sharpness results of the greenish underwater images. (a) Underwater images; (b) results of CLAHE algorithm; (c) results of RED algorithm; (d) results of CycleGAN algorithm; (e) results of UWGAN algorithm; (f) results of StarGAN algorithm; (g) results of proposed method
    Fig. 9. Sharpness results of the greenish underwater images. (a) Underwater images; (b) results of CLAHE algorithm; (c) results of RED algorithm; (d) results of CycleGAN algorithm; (e) results of UWGAN algorithm; (f) results of StarGAN algorithm; (g) results of proposed method
    Sharpness results of the yellowish underwater images. (a) Underwater images; (b) results of CLAHE algorithm; (c) results of RED algorithm; (d) results of CycleGAN algorithm; (e) results of UWGAN algorithm; (f) results of StarGAN algorithm; (g) results of proposed method
    Fig. 10. Sharpness results of the yellowish underwater images. (a) Underwater images; (b) results of CLAHE algorithm; (c) results of RED algorithm; (d) results of CycleGAN algorithm; (e) results of UWGAN algorithm; (f) results of StarGAN algorithm; (g) results of proposed method
    Comparison of experimental results with different modules. (a) Underwater images; (b) results with residual block; (c) results of proposed method
    Fig. 11. Comparison of experimental results with different modules. (a) Underwater images; (b) results with residual block; (c) results of proposed method
    Image styleNumber of images
    TrainTest for realunderwater imageTest for synthesizedunderwater image
    Indoor image31542800
    Bluish underwater image2921449280
    Greenish underwater image1265319280
    Yellowish underwater image968129280
    Table 1. Number of images used for training and testing
    MethodBluish underwater imageGreenish underwater imageYellowish underwater image
    UCIQEInformationentropyUCIQEInformationentropyUCIQEInformationentropy
    CLAHE0.47057.08410.48737.09740.46307.0848
    RED0.54606.96780.55417.15060.54596.6468
    CycleGAN0.56477.24500.56147.16770.55827.4000
    UWGAN0.57077.28090.56147.32340.58177.3333
    StarGAN0.56516.95980.55837.21120.55897.0824
    Ours0.57767.29960.57507.31770.58687.6801
    Table 2. Comparison of UCIQE and information entropy using different methods in the synthesized image
    MethodBluish underwater imageGreenish underwater imageYellowish underwater image
    SSIMMSESSIMMSESSIMMSE
    CLAHE0.84081823.50.8713815.30.84451686.6
    RED0.87521274.90.9212332.70.79772353.5
    CycleGAN0.42314367.00.41734280.10.33715105.6
    UWGAN0.8587514.40.8848492.90.8650561.3
    StarGAN0.7490836.40.8388313.70.7996540.9
    Ours0.9052241.80.9223203.20.9019545.1
    Table 3. Comparison of SSIM and MSE using different methods in the synthesized image
    MethodBluish underwater imageGreenish underwater imageYellowish underwater image
    UCIQEInformationentropyUCIQEInformationentropyUCIQEInformationentropy
    Original image0.49377.30150.49517.43090.47416.9084
    CLAHE0.48727.27020.51087.42570.49877.1475
    RED0.54017.16540.55687.38260.52616.7265
    CycleGAN0.56867.45980.58977.59280.57637.3997
    UWGAN0.56817.26930.58717.46560.59907.1673
    StarGAN0.59187.47530.58767.58210.58727.4947
    Ours0.62217.64300.60927.69020.60127.5778
    Table 4. Comparison of UCIQE and information entropy using different methods in the real image
    NetworkBluish underwater imageGreenish underwater imageYellowish underwater image
    UCIQEInformationentropyUCIQEInformationentropyUCIQEInformationentropy
    Original image0.49377.30150.49517.43090.47416.9084
    Residual block0.57447.37290.58197.60100.57797.3933
    Ours0.62217.64300.60927.69020.60127.5778
    Table 5. Comparison results of UCIQE and information entropy of different networks
    Weipei Jin, Jichang Guo, Qing Qi. Underwater Image Enhancement Based on Conditional Generative Adversarial Network[J]. Laser & Optoelectronics Progress, 2020, 57(14): 141002
    Download Citation