Unsupervised image-to-image translation by semantics consistency and self-attention

Zhibin ZHANG; Wanli XUE; Guokai FU

doi:10.1007/s11801-022-0165-3

[1] GOODFELLOW I, POUGET-ABADIE J, MIRZA M, et al. Generative adversarial nets[C]//Advances in Neural Information Processing Systems (NeurIPS), December 8-13, 2014, Montreal, Quebec, Canada. Cambridge:MIT Press, 2014, 27:2672-2680.

[2] ISOLA P, ZHU J Y, ZHOU T H, et al. Image-to-image translation with conditional adversarial networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 21-26, 2017, Honolulu, Hawaii, USA. New York:IEEE, 2017: 1125-1134.

[3] ZHU J Y, PARK T, ISOLA P, et al. Unpaired image-to-image translation using cycle-consistent adversarial networks[C]//Proceedings of the IEEE International Conference on Computer Vision (ICCV), October 22-29, 2017, Venice, Italy. New York:IEEE, 2017:2223-2232.

[4] CHEN X, JIA C Y. An overview of image-to-image translation using generative adversarial networks[C]//International Conference on Pattern Recognition (ICPR), January 10-15, 2021, Milan, Italy. Berlin, Heidelberg:Springer Cham, 2021:366-380.

[5] ZHU J Y, PHILIPP K, SHECHTMAN E, et al. Generative visual manipulation on the natural image manifold[C]//European Conference on Computer Vision (ECCV), October 8-16, 2016, Amsterdam, Netherlands. Berlin, Heidelberg:Springer-Verlag, 2016:597-613.

[6] LARSEN A, S?NDERBY S, LAROCHELLE H, et al. Autoencoding beyond pixels using a learned similarity metric[C]//International Conference on Machine Learning (ICML), June 19-24, 2016, New York City, NY, USA. New York:ACM, 2016:1558-1566.

[7] ZHAO Y, CHEN C Y. Unpaired image-to-image translation via latent energy transport[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 20-25, 2021. New York:IEEE, 2021:16418-16427.

[8] CHEN X Y, XU C, YANG X K, et al. Attention-GAN for object transfiguration in wild images[C]//European Conference on Computer Vision (ECCV), September 8-14, 2018, Munich, Germany. Heidelberg:Springer-Verlag, 2018:167-184.

[9] ZHANG H, GOODFELLOW I, METAXAS D, et al. Self-attention generative adversarial networks[C]//International Conference on Machine Learning (ICML), June 10-15, 2019, Long Beach, CA, USA. New York: ACM, 2019:7354-7363.

[10] CAO J Z, MO L Y, ZHANG Y F, et al. Multi-marginal wasserstein GAN[C]//Advances in Neural Information Processing Systems (NeurIPS), December 8-14, 2019, Vancouver Convention Center, Vancouver, Canada.Cambridge:MIT Press, 2019, 32:1776-1786.

[11] LIU H D, GU X F, SAMARAS D. Wasserstein GAN with quadratic transport cost[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 27- November 2, 2019, Seoul, Korea. New York:IEEE, 2019:4832-4841.

[12] MAO X D, LI Q, XIE H R, et al. Least squares generative adversarial networks[C]//Proceedings of the IEEE International Conference on Computer Vision, October 22-29, 2017, Venice, Italy. New York:IEEE, 2017:2794-2802.

[13] HEUSEL M, RAMSAUER H, UNTERTHINER T, et al. GANs trained by a two time-scale update rule converge to a local Nash equilibrium[C]//Advances in Neural Information Processing Systems (NeurIPS), December 8-14, 2017, Long Beach, CA, USA. Cambridge:MIT Press, 2017, 30:6626-6637.

[14] ZEILER M, FERGUS R. Visualizing and understanding convolutional networks[C]//European Conference on Computer Vision (ECCV), September 6-12, 2014, Switzerland, Zurich. Berlin, Heidelberg:Springer-Verlag, 2014:818-833.

[15] HUANG X, LIU M Y, BELONGIE S, et al. Multimodal unsupervised image-to-image translation[C]//European Conference on Computer Vision (ECCV), September 8-14, 2018, Munich, Germany. Berlin, Heidelberg: Springer-Verlag, 2018:185-208.

[16] MEJJATI Y, RICHARDT C, TOMPKIN J, et al. Unsupervised attention-guided image-to-image translation[C]//Advances in Neural Information Processing Systems (NeurIPS), December 3-8, 2018, Montreal Convention Centre, Montreal, Canada. Cambridge:MIT Press, 2018, 31:3693-3703.