基于照明感知和密集网络的红外与可见光图像融合
Infrared and Visible Image Fusion Based on Illumination Perception and Dense Net
张杰 1许光宇 1陈浩宇1
作者信息
- 1. 安徽理工大学 计算机科学与工程学院,安徽 淮南 232001
- 折叠
摘要
针对现有方法忽略照明不平衡、存在对比度低、纹理细节丢失等问题,本研究提出一种基于照明感知和密集网络的红外与可见光图像融合方法.首先,从可见光图像中获取照明概率并计算照明感知权重以指导训练网络,通过特征提取与信息度量模块来计算源图像的自适应信息保留度,用于保持融合结果与源图像间的自适应相似性.同时,照明感知损失与相似性约束损失函数使模型在结构、对比度、亮度上能够全天候地生成包含显著目标和丰富纹理细节信息的融合图像.本研究在TNO与MSRS2个公共数据集上进行主、客观评估.实验结果表明,本研究弥补了照明不平衡的缺陷,在保留更多红外目标的同时,也有效地保留了更多可见光图像的纹理细节信息.
Abstract
Aiming at the problems of ignoring illumination imbalance,low contrast and texture detail loss in existing meth-ods,this paper proposed a fusion method of infrared and visible image based on illumination perception and dense network.Firstly,the illumination probability was obtained from the visible image and the illumination perception weight was calcu-lated to guide the training network.The adaptive information retention of the source image was calculated by the feature ex-traction and information measurement module to maintain the adaptive similarity between the fusion result and the source image.At the same time,the illumination perception loss and the similarity constraint loss function enabled the model to generate all-weather fusion images containing significant objects and rich texture details in terms of structure,contrast and brightness.In this study,two public data sets,TNO and MSRS,were used for subjective and objective assessment.The ex-perimental results show that this study can make up for the defect of illumination imbalance,and effectively retain more tex-ture details of visible images while preserving more infrared targets.
关键词
图像融合/红外图像/可见光图像/照明感知/密集网络Key words
image fusion/infrared image/visible image/illumination perception/dense net引用本文复制引用
基金项目
国家自然科学基金(61471004)
安徽理工大学研究生创新基金(2022CX2125)
出版年
2024
国家科技期刊平台
NSTL
万方数据