Study on image inpainting based on attention mechanism and edge generation
岳贺飞 1刘华明 1王秀友 1毕学慧1
扫码查看
点击上方二维码区域，可以放大扫码查看
作者信息
1. 阜阳师范大学 计算机与信息工程学院,安徽 阜阳 236000
折叠
摘要
针对图像中大面积缺失区域修复产生纹理结构不清晰和上下文语义内容不协调的问题,提出基于注意力机制和边缘生成的图像修复算法.以生成对抗网络作为整体架构,添加边缘生成网络和ECA注意力机制模块,旨在强调破损区域内部边缘的修复,重点突出感兴趣区域与图像内容整体的一致性;采用感知损失函数进一步约束图像内容的生成,使纹理细节修复更加清晰.在CelebA和Paris Street View数据集上进行测试,实验结果表明,算法在峰值信噪比和结构相似度两项指标上均有所提升,对图像修复实践具有一定的参考价值.
Abstract
To solve the problem of unclear texture structure and incongruity of contextual semantic content in the image when repairing large missing areas,an image repair algorithm is proposed based on attention mecha-nism and edge generation.The algorithm takes generative abduction network as the overall architecture,and adds edge generation module and ECA attention mechanism.The purpose of the repair network is to emphasize the semantic information of the inner edge of the damaged area and the area of interest to ensure the overall consistency of the repair content.At the same time,the perception loss function is modified to further constrain the generation of image content,and the inpainting details are more realistic.This method applies experiments in the CelebA and Paris Street View data sets.The experimental results show that both peak signal to noise ra-tio and structural similarity index measurement have been improved,which offers reference for the practice of image restoration.
关键词
图像修复/边缘生成/注意力机制/感知损失
Key words
image inpainting/edge generation/attention mechanism/perceptual loss
维普
万方数据