首页|高频域多深度空洞网络的遥感图像全色锐化算法

高频域多深度空洞网络的遥感图像全色锐化算法

扫码查看
遥感图像全色锐化是提取多光谱图像的光谱信息和全色图像的结构信息,将其融合成高分辨率多光谱遥感图像的过程.然而,高分辨率多光谱图像会存在光谱或结构信息的缺失问题.为了优化这一问题,该文提出一种基于多深度神经网络的遥感图像全色锐化算法,该算法有结构保护和光谱保护2个模块.结构保护模块使用滤波操作,提取全色图像和多光谱图像的高频信息,然后采用多深度神经网络提取图像的多尺度信息,从而提高模型的空间信息提取能力,减小过拟合的风险;光谱保护模块通过跳跃连接将上采样的多光谱图像与结构保护模块相连接,以保护图像的光谱信息.为了验证新模型的有效性,在相同实验条件下,将所提方法与多种遥感图像全色锐化算法进行比较,并从主观视觉效果和客观评价2个方面进行评估.实验结果表明,所提方法能够改善当前算法存在的结构信息缺失现象,更好地保护多光谱图像的光谱信息以及全色图像的结构信息.
A pansharpening algorithm for remote sensing images based on high-frequency domain and multi-depth dilated network
The pansharpening of remote sensing images is a process that extracts the spectral information of multispectral images and the structural information of panchromatic images and then fuse the information to form high-resolution multispectral remote sensing images,which,however,suffer a lack of spectral or structural information.To mitigate this problem,this study proposed a pansharpening algorithm for remote sensing images based on a multi-depth neural network.This algorithm includes a structural protection module and a spectral protection module.The structural protection module extracts the high-frequency information of panchromatic and multispectral images through filtering and then extracts the multi-scale information of the images using a multi-depth neural network.The purpose is to improve the spatial information extraction ability of the model and to reduce the risk of overfitting.The spectral protection module connects the upsampled multispectral images with the structural protection module through a skip connection.To validate the effectiveness of the new algorithm,this study,under consistent experimental conditions,compared the new algorithm with multiple pansharpening algorithms for remote sensing images and assessed these algorithms from the angles of subjective visual effects and objective evaluation.The results indicate that the algorithm proposed in this study can effectively protect the spectral information of multispectral images and the structural information of panchromatic images in solving the lack of structural information in current algorithms for image fusion.

remote sensing pansharpeningmulti-depth networkmulti-scale learningskip connectionspatial and spectral fusion

郭彭浩、邱建林、赵淑男

展开 >

南通理工学院计算机与信息工程学院,南通 226001

南通大学信息科学技术学院,南通 226001

北方夜视科技(南京)研究院有限公司,南京 211100

遥感图像全色锐化 多深度网络 多尺度学习 跳跃连接 空谱融合

国家自然科学基金青年项目南通市科技局项目&&

61701245JCZ2022097JCZ21096

2024

自然资源遥感
中国国土资源航空物探遥感中心

自然资源遥感

CSTPCD北大核心
影响因子:1.275
ISSN:2097-034X
年,卷(期):2024.36(3)