• Acta Optica Sinica
  • Vol. 41, Issue 7, 0728003 (2021)
Zishuo Han, Chunping Wang*, Qiang Fu, and Bin Zhao
Author Affiliations
  • Department of Electronic and Optical Engineering, Shijiazhuang Campus, Army Engineering University, Shijiazhuang, Hebei 050003, China
  • show less
    DOI: 10.3788/AOS202141.0728003 Cite this Article Set citation alerts
    Zishuo Han, Chunping Wang, Qiang Fu, Bin Zhao. Remote Sensing Image Mode Translation by Spatial Disentangled Representation Based GAN[J]. Acta Optica Sinica, 2021, 41(7): 0728003 Copy Citation Text show less
    Basic framework of SDR-CycleGAN
    Fig. 1. Basic framework of SDR-CycleGAN
    Network structure of style encoder
    Fig. 2. Network structure of style encoder
    Network structure of content encoder
    Fig. 3. Network structure of content encoder
    Network structure of content domain translation module
    Fig. 4. Network structure of content domain translation module
    Network structure of decoder
    Fig. 5. Network structure of decoder
    Network structure of discriminator
    Fig. 6. Network structure of discriminator
    Working process diagram of discriminator
    Fig. 7. Working process diagram of discriminator
    Samples of SEN1-2 dataset
    Fig. 8. Samples of SEN1-2 dataset
    Samples of SARptical dataset
    Fig. 9. Samples of SARptical dataset
    Samples of WHU-SEN-City dataset. (a) SAR image; (b) ORS image
    Fig. 10. Samples of WHU-SEN-City dataset. (a) SAR image; (b) ORS image
    Image blocks of WHU-SEN-City dataset
    Fig. 11. Image blocks of WHU-SEN-City dataset
    Schematic diagram of image cutting. (a) Example of scene image; (b) image blocks
    Fig. 12. Schematic diagram of image cutting. (a) Example of scene image; (b) image blocks
    Examples of SAR image to ORS image translation on SEN1-2 dataset
    Fig. 13. Examples of SAR image to ORS image translation on SEN1-2 dataset
    Examples of ORS image to SAR image translation on SEN1-2 dataset
    Fig. 14. Examples of ORS image to SAR image translation on SEN1-2 dataset
    Examples of SAR image to ORS image translation on SARptical dataset
    Fig. 15. Examples of SAR image to ORS image translation on SARptical dataset
    Examples of ORS image to SAR image translation on SARptical dataset
    Fig. 16. Examples of ORS image to SAR image translation on SARptical dataset
    Examples of SAR image to ORS image translation on WHU-SEN-City dataset. (a) SAR images; (b) ORS images; (c) BRIT translation results; (d) CR-CycleGAN translation results; (e) MUNIT translation results; (f) S-CycleGAN translation results; (g) DSMAP translation results; (h) SDR-CycleGAN translation results
    Fig. 17. Examples of SAR image to ORS image translation on WHU-SEN-City dataset. (a) SAR images; (b) ORS images; (c) BRIT translation results; (d) CR-CycleGAN translation results; (e) MUNIT translation results; (f) S-CycleGAN translation results; (g) DSMAP translation results; (h) SDR-CycleGAN translation results
    Examples of ORS image to SAR image translation on WHU-SEN-City dataset. (a) SAR images; (b) ORS images; (c) BRIT translation results; (d) CR-CycleGAN translation results; (e) S-CycleGAN translation results; (f) MUNIT translation results; (g) DSMAP translation results; (h) SDR-CycleGAN translation results
    Fig. 18. Examples of ORS image to SAR image translation on WHU-SEN-City dataset. (a) SAR images; (b) ORS images; (c) BRIT translation results; (d) CR-CycleGAN translation results; (e) S-CycleGAN translation results; (f) MUNIT translation results; (g) DSMAP translation results; (h) SDR-CycleGAN translation results
    MethodPSNR /dBSSIMFSIM
    DRIT10.1400.2560.582
    CR-CycleGAN10.1840.2010.629
    S-CycleGAN11.2630.2580.664
    MUINT13.5890.2460.670
    DSMAP14.9170.2880.653
    SDR-CycleGAN15.4660.3210.687
    Table 1. Quality assessments of SAR image to ORS image translation on SEN1-2 dataset
    MethodPSNR /dBSSIMFSIM
    CR-CycleGAN9.2700.2310.685
    S-CycleGAN10.7940.2610.694
    DRIT11.4310.2520.682
    MUINT13.3720.2570.689
    DSMAP13.8490.2780.701
    SDR-CycleGAN13.9120.2930.711
    Table 2. Quality assessments of ORS image to SAR image translation on SEN1-2 dataset
    MethodPSNR /dBSSIMFSIM
    DRIT10.6850.2730.652
    S-CycleGAN10.8500.2820.658
    CR-CycleGAN11.8080.3110.664
    MUNIT11.8540.2870.660
    DSMAP12.6850.2890.662
    SDR-CycleGAN13.3670.3230.687
    Table 3. Quality assessments of SAR image to ORS image translation on SARptical dataset
    MethodPSNR /dBSSIMFSIM
    DRIT14.5880.2100.723
    MUNIT14.6200.2110.720
    S-CycleGAN14.7180.2160.725
    CR-CycleGAN15.2630.2570.708
    DSMAP15.2670.2400.720
    SDR-CycleGAN16.0680.2470.728
    Table 4. Quality assessments of ORS image to SAR image translation on SARptical dataset
    MethodPSNR /dBSSIMFSIM
    DRIT8.7950.2100.565
    CR-CycleGAN11.3600.2480.649
    MUNIT13.1240.3170.699
    S-CycleGAN13.4720.3910.734
    DSMAP13.7290.4470.714
    SDR-CycleGAN14.1160.4720.763
    Table 5. Quality assessment of SAR image to ORS image translation on WHU-SEN-City dataset
    MethodPSNR /dBSSIMFSIM
    DRIT9.0760.1520.696
    CR-CycleGAN10.9980.1120.687
    S-CycleGAN11.1970.2540.682
    MUNIT13.0330.3960.711
    DSMAP13.0760.3740.697
    SDR-CycleGAN13.1700.4050.732
    Table 6. Quality assessment of ORS image to SAR image translation on WHU-SEN-City dataset
    Zishuo Han, Chunping Wang, Qiang Fu, Bin Zhao. Remote Sensing Image Mode Translation by Spatial Disentangled Representation Based GAN[J]. Acta Optica Sinica, 2021, 41(7): 0728003
    Download Citation