Currently,the realistic avatars converted from sketch avatars has the problems of insufficient lifelikeness and low face recognition rate.In response to this,a realistic avatar conversion method with improved CycleGAN is proposed.Firstly,a face feature extractor is added to the U-Net self-encoder.Secondly,the features extracted by the face feature extrac-tor and the features in the U-Net decoder are fused using the channel connection method,and the fused features are further de-coded.Finally,the base model CycleGAN is transformed into a supervised learning model so as to add image spatial loss and style loss to the converted avatar and the real avatar.The experimental results show that the improved model reduces the FID value by 27.31 and improves Rank-1 by 19％on the CUHK test set,and reduces the FID value by 8.65 and improves Rank-1 by 4.1％on the XM2VTS test set,compared with the results collected from the converted real avatar of the base model.
关键词
CycleGAN/U-Net自编码/人脸特征提取器/监督学习/图像空间损失/风格损失
Key words
CycleGAN/U-Net self-encoding/face feature extractor/supervised learning/image spatial loss/style loss
维普
万方数据