首页|Unsupervised image-to-image translation by semantics consistency and self-attention

Unsupervised image-to-image translation by semantics consistency and self-attention

扫码查看
Unsupervised image-to-image translation is a challenging task for computer vision.The goal of image translation is to learn a mapping between two domains,without corresponding image pairs.Many previous works only focused on image-level translation but ignored image features processing,which led to a certain semantics loss,such as the changes of the background of the generated image,partial transformation,and so on.In this work,we propose a method of image-to-image translation based on generative adversarial nets(GANs).We use autoencoder structure to extract image features in the generator and add semantic consistency loss on extracted features to maintain the semantic consistency of the generated image.Self-attention mechanism at the end of generator is used to obtain long-distance dependency in image.At the same time,as expanding the convolution receptive field,the quality of the generated image is enhanced.Quantitative experiment shows that our method significantly outperforms previous works.Especially on images with obvious foreground,our model shows an impressive improvement.

ZHANG Zhibin、XUE Wanli、FU Guokai

展开 >

The Key Laboratory of Computer Vision and System of Ministry of Education,Tianjin Key Laboratory of Intelligence Computing and Novel Software Technology,Tianjin University of Technology,Tianjin 300384,China

国家自然科学基金国家自然科学基金国家自然科学基金国家自然科学基金天津市科技计划

6190613562020106004920483016190602720JCQNJC01350

2022

光电子快报(英文版)
天津理工大学

光电子快报(英文版)

EI
影响因子:0.641
ISSN:1673-1905
年,卷(期):2022.18(3)
  • 2
  • 16