• Laser & Optoelectronics Progress
  • Vol. 57, Issue 18, 181018 (2020)
Xiaoman Cui and Fengqin Yu*
Author Affiliations
  • School of Internet of Things Engineering, Jiangnan University, Wuxi, Jiangsu 214122, China
  • show less
    DOI: 10.3788/LOP57.181018 Cite this Article Set citation alerts
    Xiaoman Cui, Fengqin Yu. Multi Style Sketch-Photo Generation Based on Conditional Generation Adversarial Networks[J]. Laser & Optoelectronics Progress, 2020, 57(18): 181018 Copy Citation Text show less
    VAE's basic framework
    Fig. 1. VAE's basic framework
    Discriminator model
    Fig. 2. Discriminator model
    Conditional generation adversarial networks based on VAE
    Fig. 3. Conditional generation adversarial networks based on VAE
    Total loss
    Fig. 4. Total loss
    Sketches in multiple styles. (a) Result by Sobel operator; (b) result by taking the inverse and performing Gaussian blur; (c) result by Median filter and Laplace filter; (d) sketch in CUHK dataset
    Fig. 5. Sketches in multiple styles. (a) Result by Sobel operator; (b) result by taking the inverse and performing Gaussian blur; (c) result by Median filter and Laplace filter; (d) sketch in CUHK dataset
    Flow chart of model training process
    Fig. 6. Flow chart of model training process
    Synthesis results of face photos. (a) Test sketches; (b) images generated by the method in Ref. [4]; (c) images generated by the method in Ref. [7]; (d) images generated by the method in Ref. [9]; (e) images generated by our method; (f) real photos
    Fig. 7. Synthesis results of face photos. (a) Test sketches; (b) images generated by the method in Ref. [4]; (c) images generated by the method in Ref. [7]; (d) images generated by the method in Ref. [9]; (e) images generated by our method; (f) real photos
    Generation results of face photos. (a) Test sketches; (b) generation results of test set by the single style generated network; (c) generation results of test set by universal style network model; (d) real photos
    Fig. 8. Generation results of face photos. (a) Test sketches; (b) generation results of test set by the single style generated network; (c) generation results of test set by universal style network model; (d) real photos
    MethodInRef. [4]InRef. [7]InRef. [9]Ourmethod
    SSIM0.550.540.690.77
    Table 1. SSIM values of different methods in dataset
    Xiaoman Cui, Fengqin Yu. Multi Style Sketch-Photo Generation Based on Conditional Generation Adversarial Networks[J]. Laser & Optoelectronics Progress, 2020, 57(18): 181018
    Download Citation