• Laser & Optoelectronics Progress
  • Vol. 58, Issue 12, 1210021 (2021)
Yu Shen, Qian Yang*, Yubin Yuan, and Lin Wang
Author Affiliations
  • College of Electronics and Information Engineering, Lanzhou Jiaotong University, Lanzhou, Gansu 730070, China
  • show less
    DOI: 10.3788/LOP202158.1210021 Cite this Article Set citation alerts
    Yu Shen, Qian Yang, Yubin Yuan, Lin Wang. Image Style Transfer with Clear Target Edges[J]. Laser & Optoelectronics Progress, 2021, 58(12): 1210021 Copy Citation Text show less
    Network framework diagram
    Fig. 1. Network framework diagram
    VGG-19 network feature extraction
    Fig. 2. VGG-19 network feature extraction
    Representation of foreground and background of the image
    Fig. 3. Representation of foreground and background of the image
    Linear combination of mask color channels
    Fig. 4. Linear combination of mask color channels
    Deep matting network structure
    Fig. 5. Deep matting network structure
    Comparison of matting effects. (a1) (a2) Original images; (b1) (b2) Trimap; (c1) (c2) traditional matting; (d1) (d2) depth matting of this paper
    Fig. 6. Comparison of matting effects. (a1) (a2) Original images; (b1) (b2) Trimap; (c1) (c2) traditional matting; (d1) (d2) depth matting of this paper
    Transform network structure
    Fig. 7. Transform network structure
    Comparison of style transfer texture of different convolution kernels. (a1)(a2) Content images; (b1)(b2) style images; (c1)(c2) 7×7 convolution kernel transfer texture; (d1)(d2) 3×3 convolution kernel transfer texture
    Fig. 8. Comparison of style transfer texture of different convolution kernels. (a1)(a2) Content images; (b1)(b2) style images; (c1)(c2) 7×7 convolution kernel transfer texture; (d1)(d2) 3×3 convolution kernel transfer texture
    Graphs of loss functions. (a) Content image; (b) style image
    Fig. 9. Graphs of loss functions. (a) Content image; (b) style image
    Texture comparison. (a1)(a2) Content images; (b1)(b2) style images; (c1)(c2) before normalization; (d1)(d2) after normalization
    Fig. 10. Texture comparison. (a1)(a2) Content images; (b1)(b2) style images; (c1)(c2) before normalization; (d1)(d2) after normalization
    Effect of style and content trade-off.(a) η=0; (b) η=0.25; (c)η=0.50; (d) η=0.75; (e) η=1.00; (f) style image
    Fig. 11. Effect of style and content trade-off.(a) η=0; (b) η=0.25; (c)η=0.50; (d) η=0.75; (e) η=1.00; (f) style image
    Transfer results of this article
    Fig. 12. Transfer results of this article
    Comparison of experimental results. (a1)--(a4) Content images; (b1)--(b4) style images; (c1)--(c4) images based on method proposed by Gatys et al[5]; (d1)--(d4) images based on method proposed by Ulyanov et al[10]; (e1)--(e4) images based on method proposed by Huang et al[12]; (f1)--(f4) images based on method proposed by Chen et al[26]; (g1)--(g4) images based on method proposed by Li et al[27]; (h1)--(h4) images based on our method
    Fig. 13. Comparison of experimental results. (a1)--(a4) Content images; (b1)--(b4) style images; (c1)--(c4) images based on method proposed by Gatys et al[5]; (d1)--(d4) images based on method proposed by Ulyanov et al[10]; (e1)--(e4) images based on method proposed by Huang et al[12]; (f1)--(f4) images based on method proposed by Chen et al[26]; (g1)--(g4) images based on method proposed by Li et al[27]; (h1)--(h4) images based on our method
    Objective evaluation. (a) MSSIM; (b) PSNR; (c) AvG; (d) QAB/F
    Fig. 14. Objective evaluation. (a) MSSIM; (b) PSNR; (c) AvG; (d) QAB/F
    LayerConv1Conv2Conv3Conv4Conv5
    Stride124816
    Receptive field5144092196
    Table 1. Stride length and receptive field parameter settings
    LayerOutput sizeSize, StrideDepthParameter
    Input224×224×3
    Conv1111×111×93×3×3, 2(×96)110728
    Maxpool155×55×963×3, 20
    Fire2, Fire355×55×128212004
    Fire455×55×256220646
    Avgpool427×27×2563×3, 20
    Fire527×27×256224742
    Fire6, Fire727×27×384290936
    Fire827×27×512277581
    Maxpool813×12×5123×3, 20
    Fire913×13×512277581
    Conv1013×13×10001×1, 1(×1000)1103400
    Avgpool101×1×100013×13, 10
    Table 2. Transfer network parameters
    Yu Shen, Qian Yang, Yubin Yuan, Lin Wang. Image Style Transfer with Clear Target Edges[J]. Laser & Optoelectronics Progress, 2021, 58(12): 1210021
    Download Citation