首页|基于双生成器生成对抗网络的壁画图像虚拟修复方法

基于双生成器生成对抗网络的壁画图像虚拟修复方法

扫码查看
针对现有的基于生成对抗网络的壁画修复方法,其生成样本缺乏多样性,容易造成大规模特征丢失等问题.提出一种基于双生成器生成对抗网络(BGGAN)的壁画图像虚拟修复方法.首先,从两个随机方向进行样本生成,保证了生成样本的多样性.其次,对Dilate U-Net Kares生成器模型,改进下采样阶段的膨胀卷积扩张率,取消池化操作.最后,设计损失函数,将均方误差(MSE)损失与对抗损失相结合,通过λG 约束生成样本的特征梯度.在所收集壁画数据集上进行修复测试,测试结果与多种图像修复方法对比.结果表明,所提算法获得的图像修复结果细节更清晰.修复后图像的峰值信噪比(PSNR)相较对比模型平均提高了约1.12 dB,结构相似度(SSIM)平均提高了约0.047.
The mural image virtual restoration method based on bi-generator generative adversarial network
Aiming at the existing fresco restoration methods based on generative adversarial networks,their generated samples lack diversity and are prone to large-scale feature loss and other problems.A virtual restoration method for fresco images based on bi-generator generative adversarial network(BGGAN)is proposed.Firstly,sample generation from two random directions ensures the diversity of generated samples.Secondly,for the Dilate U-Net Kares generator model,the inflated convolutional expansion rate in the downsampling stage is improved and the pooling operation is eliminated.Finally,the loss function is designed to combine the MSE loss with the adversarial loss,and the feature gradient of the generated samples is constrained by λG.Restoration tests are performed on the collected mural dataset,and the test results are compared with multiple image restoration methods.The results show that the image restoration results obtained by the proposed algorithm have clearer details.The peak signal-to-noise ratio(PSNR)of the restored image is improved by about 1.12 dB on average compared to the comparison model,and the structural similarity(SSIM)is improved by about 0.047 on average.

image processingvirtual restoration of muralsgenerative adversarial networkU-Net

杨卓林、曹建芳、张英俊、彭存赫

展开 >

太原科技大学计算机科学与技术学院 太原 030024

忻州师范学院计算机系 忻州 034000

图像处理 壁画虚拟修复 生成对抗网络 U-Net

国家自然科学基金面上项目教育部人文社会科学研究项目(规划基金项目)山西省自然基金面上项目山西省文物局2024年度文物科研课题

6237239721YJAZH0022022030212212222024KT23

2024

国外电子测量技术
北京方略信息科技有限公司

国外电子测量技术

CSTPCD
影响因子:1.414
ISSN:1002-8978
年,卷(期):2024.43(7)
  • 21