首页|DE-GAN: Domain Emb e dde d GAN for High Quality Face Image Inpainting

DE-GAN: Domain Emb e dde d GAN for High Quality Face Image Inpainting

扫码查看
Domain knowledge of face shapes and structures plays an important role in face inpainting. However, general inpainting methods focus mainly on the resolution of generated images without considering the particular structure of human faces and generally produce inharmonious facial parts. Existing faceinpainting methods incorporate only one type of facial feature for face completion, and their results are still undesirable. To improve face inpainting quality, we propose a Domain Embedded Generative Adversarial Network (DE-GAN) for face inpainting. DE-GAN embeds three types of face domain knowledge (i.e., face mask, face part, and landmark image) via a hierarchical variational auto-encoder (HVAE) into a latent variable space to guide face completion. Two adversarial discriminators, a global discriminator and a patch discriminator, are used to judge whether the generated distribution is close to the real distribution or not. Experiments on two public face datasets demonstrate that our proposed method generates higher quality inpainting results with consistent and harmonious facial structures and appearance than existing methods and achieves the state-of-the-art performance, esp. for inpainting under-pose variations.(c) 2021 Elsevier Ltd. All rights reserved.

Face InpaintingDomain EmbeddingAdversarial Generative Model

Zhang, Xian、Wang, Xin、Shi, Canghong、Yan, Zhe、Li, Xiaojie、Kong, Bin、Lyu, Siwei、Zhu, Bin、Yin, Youbing、Song, Qi、Wu, Xi、Mumtaz, Imran、Lv, Jiancheng

展开 >

Chengdu Univ Informat Technol

Keya Med

Xihua Univ

SUNY Buffalo

Microsoft Res Asia

Univ Agr Faisalabad

Sichuan Univ

展开 >

2022

Pattern Recognition

Pattern Recognition

EISCI
ISSN:0031-3203
年,卷(期):2022.124
  • 24
  • 42