• Acta Optica Sinica
  • Vol. 40, Issue 5, 0510001 (2020)
Linmiao Hu1、2、3 and Yong Zhang1、3、*
Author Affiliations
  • 1Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, China
  • 2University of Chinese Academy of Sciences, Beijing 100049, China
  • 3Key Laboratory of Infrared System Detection and Imaging Technology, Chinese Academy of Sciences, Shanghai 200083, China
  • show less
    DOI: 10.3788/AOS202040.0510001 Cite this Article Set citation alerts
    Linmiao Hu, Yong Zhang. Facial Image Translation in Short-Wavelength Infrared and Visible Light Based on Generative Adversarial Network[J]. Acta Optica Sinica, 2020, 40(5): 0510001 Copy Citation Text show less
    Structure of CycleGAN model
    Fig. 1. Structure of CycleGAN model
    Structure of generator and discriminator. (a) Generator; (b) discriminator
    Fig. 2. Structure of generator and discriminator. (a) Generator; (b) discriminator
    Structure of improved CycleGAN framework
    Fig. 3. Structure of improved CycleGAN framework
    Comparison of generated images by different frameworks. (a) Short-wave images; (b) proposed framework; (c) DRIT; (d) UNIT; (e) MUNIT; (f) CycleGAN; (g) DualGAN; (h) reference images
    Fig. 4. Comparison of generated images by different frameworks. (a) Short-wave images; (b) proposed framework; (c) DRIT; (d) UNIT; (e) MUNIT; (f) CycleGAN; (g) DualGAN; (h) reference images
    ModelFIDAccuracy (all)Accuracy(frontal)
    CycleGAN48.21730.1370.146
    CycleGAN+Lidentity65.00520.2200.267
    Table 1. Results of identity loss function on Facenet
    α2FIDAccuracy (all)Accuracy (frontal)
    01.05.010.012.515.020.050.048.217352.925341.649841.372143.440543.167038.418065.97260.1370.1210.1330.1520.1440.1610.1420.1450.1460.1190.1460.1790.1650.1750.1670.154
    Table 2. Index analysis of overall loss function on Facenet
    α3FIDAccuracy (all)Accuracy (frontal)
    00.050.501.005.0050.0048.217341.433252.560258.183287.7636105.10970.1370.1680.2520.2340.2160.0340.1460.2140.3110.2940.2430.029
    Table 3. Index analysis of synthesis-reconstruction loss function on Facenet
    α2α3FIDAccuracy (all)Accuracy (frontal)
    0101581010111500.050.050.500.400.500.500.5048.217343.791539.206448.615543.939647.335149.966848.28150.1370.2340.2000.2970.2600.3340.2900.2710.1460.2880.2160.3700.3250.4090.3930.354
    Table 4. Results of proposed framework with different parameters
    FrameworkFIDAccuracy (all)Accuracy(frontal)
    Real imageProposed frameworkCycleGANDualGANUNITMUNITDRIT16.759047.335148.217346.755650.926869.142252.69060.8320.3340.1370.0780.1660.1120.2220.4090.1460.0860.2140.1290.290
    Table 5. Index analysis of results generated by different frameworks
    Linmiao Hu, Yong Zhang. Facial Image Translation in Short-Wavelength Infrared and Visible Light Based on Generative Adversarial Network[J]. Acta Optica Sinica, 2020, 40(5): 0510001
    Download Citation