• Laser & Optoelectronics Progress
  • Vol. 59, Issue 4, 0410014 (2022)
Ning Zhao and Libo Liu*
Author Affiliations
  • School of Information Engineering, Ningxia University, Yinchuan , Ningxia 750021, China
  • show less
    DOI: 10.3788/LOP202259.0410014 Cite this Article Set citation alerts
    Ning Zhao, Libo Liu. Generation Model of Character Posture TransferBased on Self-attention Mechanism[J]. Laser & Optoelectronics Progress, 2022, 59(4): 0410014 Copy Citation Text show less
    Two-stage character pose transfer image generation model
    Fig. 1. Two-stage character pose transfer image generation model
    Improved self-attention mechanism
    Fig. 2. Improved self-attention mechanism
    Texture refinement generation network
    Fig. 3. Texture refinement generation network
    Residual block with self-attention mechanism
    Fig. 4. Residual block with self-attention mechanism
    Perform ablation experiments on the DeepFashion dataset.(a) Sample 1; (b) sample 2; (c) sample 3; (d) sample 4
    Fig. 5. Perform ablation experiments on the DeepFashion dataset.(a) Sample 1; (b) sample 2; (c) sample 3; (d) sample 4
    Perform ablation experiments on the Market-1501dataset. (a) Sample 1; (b) sample 2; (c) sample 3; (d) sample 4
    Fig. 6. Perform ablation experiments on the Market-1501dataset. (a) Sample 1; (b) sample 2; (c) sample 3; (d) sample 4
    ModelMarket-1501Deepfashion
    SSIMISMask-SSIMMask-ISSSIMIS
    Baseline0.2743.4720.7123.4560.6143.112
    Baseline+D0.3153.4700.7893.4490.7613.108
    Baseline+D+Lper0.3113.5010.7673.6720.7593.301
    Baseline+D+Lper+SA0.3183.4960.8233.6650.7943.478
    Real data1.0003.8901.0003.7061.0003.898
    Table 1. Ablation experiment
    ModelMarket-1501DeepFashion
    SSIMISMask-SSIMMask-ISSSIMIS
    PG2[40.2533.4600.7923.4350.7623.090
    DPIG190.0993.4830.6143.4910.6143.228
    Def-GAN200.2903.1850.8053.5020.7563.439
    UPIS210.1513.4310.7423.4850.7472.971
    PATN10.3113.3230.8113.7730.7733.209
    XingGAN60.3133.5060.8163.8720.7783.476
    Ours0.3183.4960.8233.6650.7943.478
    Real data1.0003.8901.0003.7061.0003.898
    Table 2. Comparision of SSIM and IS by different methods
    Ning Zhao, Libo Liu. Generation Model of Character Posture TransferBased on Self-attention Mechanism[J]. Laser & Optoelectronics Progress, 2022, 59(4): 0410014
    Download Citation