应用光学2024,Vol.45Issue(1) :107-117.DOI:10.5768/JAO202445.0102005

基于显著性的双鉴别器GAN图像融合算法

Saliency-based dual discriminator GAN image fusion algorithm

谢一博 刘卫国 周顺 李梦晗
应用光学2024,Vol.45Issue(1) :107-117.DOI:10.5768/JAO202445.0102005

基于显著性的双鉴别器GAN图像融合算法

Saliency-based dual discriminator GAN image fusion algorithm

谢一博 1刘卫国 1周顺 1李梦晗1
扫码查看

作者信息

  • 1. 西安工业大学光电工程学院,陕西西安 710021
  • 折叠

摘要

针对红外图像与可见光图像在不同场景的特征表达不同的问题,提出一种基于显著性的双鉴别器生成对抗网络方法,将红外与可见光的特征信息相融合.区别于传统的生成对抗网络,该算法采用双鉴别器方式分别鉴别源图像与融合图像中的显著性区域,以两幅源图像的显著性区域作为鉴别器的输入,使融合图像保留更多的显著特征;并将梯度约束引入其损失函数中,使显著对比度和丰富纹理信息保留在融合图像中.实验结果表明:本文方法在熵值(entropy,EN)、平均梯度(mean gradient,MG)、空间频率(spatial frequency,SF)及边缘强度(edge intensity,EI)4个评价指标中均优于其他对比算法.该研究实现了红外图像与可见光图像高效融合,有望在目标识别等领域中获得应用.

Abstract

To address the problem that infrared images and visible images have different feature expressions in different scenes,an saliency-based dual discriminator generative adversarial network method was proposed to fuse the infrared and visible feature information.Different from the traditional generative adversarial network,a dual discriminator approach was adopted to discriminate the saliency regions in the source images and the fusion images respectively in this algorithm,and the saliency regions of the two source images were used as the input of the discriminator so that the fusion image retained more salient features.The gradient constraint was introduced into its loss function so that the salient contrast and rich texture information could retain in the fusion image.The experimental results show that the proposed method outperforms other comparison algorithms in four evaluation indexes:entropy(EN),mean gradient(MG),spatial frequency(SF)and edge intensity(EI).This study achieves efficient fusion of infrared images and visible images,which is expected to gain applications in fields such as target recognition.

关键词

图像处理/生成对抗网络/图像融合/显著性区域/目标识别

Key words

image processing/generative adversarial networks/image fusion/salient regions/target recognition

引用本文复制引用

基金项目

陕西省教育厅科研计划重点项目(21JY017)

陕西省自然科学基础研究计划(2022JQ-676)

中国博士后科学基金(2022M712493)

出版年

2024
应用光学
中国兵工学会 中国兵器工业第二0五研究所

应用光学

CSTPCD北大核心
影响因子:0.517
ISSN:1002-2082
参考文献量7
段落导航相关论文