• Optoelectronics Letters
  • Vol. 18, Issue 3, 175 (2022)
Zhibin ZHANG, Wanli XUE*, and Guokai FU
Author Affiliations
  • The Key Laboratory of Computer Vision and System of Ministry of Education, Tianjin Key Laboratory of Intelligence Computing and Novel Software Technology, Tianjin University of Technology, Tianjin 300384, China
  • show less
    DOI: 10.1007/s11801-022-0165-3 Cite this Article
    ZHANG Zhibin, XUE Wanli, FU Guokai. Unsupervised image-to-image translation by semantics consistency and self-attention[J]. Optoelectronics Letters, 2022, 18(3): 175 Copy Citation Text show less

    Abstract

    Unsupervised image-to-image translation is a challenging task for computer vision. The goal of image translation is to learn a mapping between two domains, without corresponding image pairs. Many previous works only focused on image-level translation but ignored image features processing, which led to a certain semantics loss, such as the changes of the background of the generated image, partial transformation, and so on. In this work, we propose a method of image-to-image translation based on generative adversarial nets (GANs). We use autoencoder structure to extract image features in the generator and add semantic consistency loss on extracted features to maintain the semantic consistency of the generated image. Self-attention mechanism at the end of generator is used to obtain long-distance dependency in image. At the same time, as expanding the convolution receptive field, the quality of the generated image is enhanced. Quantitative experiment shows that our method significantly outperforms previous works. Especially on images with obvious foreground, our model shows an impressive improvement.
    ZHANG Zhibin, XUE Wanli, FU Guokai. Unsupervised image-to-image translation by semantics consistency and self-attention[J]. Optoelectronics Letters, 2022, 18(3): 175
    Download Citation