计算机与数字工程2024,Vol.52Issue(8) :2457-2463,2492.DOI:10.3969/j.issn.1672-9722.2024.08.037

基于生成式对抗网络的复杂结构图像生成方法

Generative Adversarial Network-Based Method for Generating Complex Structured Images

陈颀周 邵清 卢军国 李全全
计算机与数字工程2024,Vol.52Issue(8) :2457-2463,2492.DOI:10.3969/j.issn.1672-9722.2024.08.037
✕

基于生成式对抗网络的复杂结构图像生成方法

Generative Adversarial Network-Based Method for Generating Complex Structured Images

陈颀周 1邵清 1卢军国 2李全全1
扫码查看

作者信息

  • 1. 上海理工大学光电信息与计算机工程学院 上海 200093
  • 2. 上海外高桥造船有限公司 上海 200137
  • 折叠

摘要

在图像生成任务中,生成式对抗网络通常更倾向于学习图像的纹理特征等低级模式,而忽略其形状特征等高级模式,导致生成不规则图像.为了解决这一问题,论文提出残差注意力多通道生成式对抗网络.首先,利用残差连接,使模型信息的传输效率变得更高,模型训练变得更加稳定.第二,引入自注意力机制加强生成图像的长距离依赖,提升模型对形状的建模能力.第三,利用HS通道隐藏亮度细节,而突出图中对象轮廓的特点,将HS通道输入判别器,作为额外判别依据,使模型的FID分数获得了进一步提升.实验结果表明,在几何结构复杂的数据集上,该模型能够生成视觉效果更好、更符合现实情况的图像.

Abstract

In image generation tasks,generative adversarial networks usually prefer to learn low-level patterns,such as tex-tures of images,but ignore high-level patterns,such as their shapes.To solve this problem,this paper proposes a residual attention multi-channel generative adversarial network.Firstly,the residual connection is used to make information transmission more effi-cient and the model training becomes more stable.Secondly,the self-attention mechanism is introduced to improve the long-range dependence of the generated images and enhance the modeling capacity of the model on shapes.Thirdly,the model's FID score is further improved by using the concatenation of RGB and HS channels of an image as the input of the discriminator,where the HS channels hides the luminance details while highlighting the object contours in the figure.The experimental results show that the mod-el is able to generate images with better visual effects on datasets with complex geometric structures.

关键词

图像生成/生成式对抗网络/残差网络/自注意力机制/颜色通道

Key words

image generation/generative adversarial networks/residual networks/self-attention/color channel

引用本文复制引用

基金项目

国家自然科学基金项目(61502220)

上海市科学教育委员会(19511105103)

出版年

2024
计算机与数字工程
中国船舶重工集团公司第七0九研究所

计算机与数字工程

CSTPCD
影响因子:0.355
ISSN:1672-9722
段落导航相关论文