Using image smoothing structure information to guide image inpainting
Using image structure features for image inpainting is a new method that has emerged in recent years with the widespread application of deep learning techniques.This method can generate plausible con-tent within missing areas,but the restoration results heavily rely on the extracted content of image struc-tures.In practical training,errors can propagate and accumulate,directly impacting the quality of the gen-erated image when there is noise or distortion in the image structure.This method is still in the exploratory phase and faces challenges such as difficulty in network training,poor robustness,and inconsistent seman-tic context in generated images.To address these issues,this paper proposed a parallel network structure for image inpainting guided by smooth image structures.The generated content of the smooth image struc-ture was not directly used as input for the next-level network but served as guidance information for the de-coding layer of network.Additionally,to better match and balance the feature relationship between the structure and the image,this paper combined transformer and introduces a multi-scale feature guidence module.This module utilized the powerful modeling capability of transformers to establish connections be-tween global features,matching and balancing features between structure and image textures.Experimen-tal results demonstrate that the proposed method effectively restores missing content in images on three commonly used datasets and can be used as an image editing tool for object removal.
万方数据
维普
