计算机工程与设计2024,Vol.45Issue(12) :3674-3680.DOI:10.16208/j.issn1000-7024.2024.12.020

基于自适应跨域距离一致的有限数据图像修复

Image inpainting under limited data based on adaptive cross-domain distance consistency

厉嘉琦 肖婷 杨孟平 王喆
计算机工程与设计2024,Vol.45Issue(12) :3674-3680.DOI:10.16208/j.issn1000-7024.2024.12.020

基于自适应跨域距离一致的有限数据图像修复

Image inpainting under limited data based on adaptive cross-domain distance consistency

厉嘉琦 1肖婷 1杨孟平 1王喆2
扫码查看

作者信息

  • 1. 华东理工大学信息科学与工程学院,上海 200237
  • 2. 华东理工大学信息科学与工程学院,上海 200237;华东理工大学能源化工过程智能制造教育部重点实验室,上海 200237
  • 折叠

摘要

针对现有深度学习图像修复方法在有限数据场景下存在的修复质量差、多样性弱等问题,在预训练基础上提出一种域自适应的方法,迁移源域中可学习的知识,补充训练中所需的信息.对源域和目标域中的特征信息进行探究,发现特征中的结构信息可作为公共表征,为域自适应提供学习的来源;为更有针对性地完成域自适应过程,提出一种自适应跨域距离一致性损失,自适应地调节损失权重,保留更多与目标域接近的源域相对距离,完成对源域知识的学习.实验结果表明,所提方法能有效提升修复质量和真实性,并且具有良好的泛化性.

Abstract

To address the issues of poor results and limited diversity in existing deep learning-based image inpainting methods,a domain adaptation approach was proposed based on the pre-training.The learnable knowledge was transferred from the source domain to supplement the required information during training.Structural information in the feature space was explored as the public representation between the source and target domains.An adaptive cross-domain distance consistency loss was proposed to preserve relative distances between the source and target domains by adaptively adjusting the loss weight.Experimental results demonstrate that the proposed method effectively improves the inpainting quality and realism,and exhibits good generalization performance.

关键词

图像修复/深度学习/有限数据/预训练/域自适应/公共表征/相对距离

Key words

image inpainting/deep learning/limited data/pre-training/domain adaptation/public representation/relative dis-tance

引用本文复制引用

出版年

2024
计算机工程与设计
中国航天科工集团二院706所

计算机工程与设计

CSTPCD北大核心
影响因子:0.617
ISSN:1000-7024
段落导航相关论文