首页|结合空间语义注意力的二段式遥感图像修复网络

结合空间语义注意力的二段式遥感图像修复网络

扫码查看
高分辨率遥感图像的缺失区域中地物种类复杂多样、空间异质性高,导致图像修复结果中存在纹理模糊和结构扭曲的问题,且在边界和复杂纹理区域尤为突出。因此提出一种结合空间语义注意力的二段式遥感图像修复网络。该网络由粗修复网络和精修复网络串联而成,旨在使用粗略修复网络提供的先验信息,引导精修复网络对缺失区域的复原。在粗修复网络中,构建多级损失结构以强化网络训练的稳定性;在精修复网络中,提出一种新的空间语义注意力机制,并依据网络特征的分布特点,区别性将空间语义注意力嵌入在编码器和解码器中,以确保局部特征的连续性和全局语义信息的相关性。实验结果表明,所提方法相比于现有其他算法可以进一步提升图像修复效果。
A two-stage remote sensing image inpainting network combined with spatial semantic attention
In high-resolution remote sensing images,missing areas feature intricate surface features and pronounced spatial heterogeneity,causing the image inpainting results to suffer texture blurring and structural distortion,particularly for boundaries and areas with complex textures.This study proposed a two-stage remote sensing image inpainting network combined with spatial semantic attention(SSA).The network comprised two networks in series:one for coarse image inpainting and one for fine-scale image inpainting(also referred to as the coarse and fine-scale networks,respectively).This network was designed to guide the fine-scale network to restore the missing areas using the priori information provided by the coarse network.In the coarse network,a multi-level loss structure was constructed to enhance the stability of network training.In the fine-scale network,a novel SSA mechanism was proposed,with SSA being embedded differentially in the encoder and decoder based on the distribution of network features.This ensured the continuity of local features and the correlation of global semantic information.The experimental results show that the network proposed in this study can further improve the image inpainting effects compared to other existing algorithms.

two-stage networkremote sensing image inpaintingspatial semantic attentioncontinuity of local fea-turescorrelation of global semantic information

刘宇佳、谢诗哲、杜阳、严瑾、南燕云、温中凯

展开 >

辽宁工程技术大学测绘与地理科学学院,阜新 123000

中国地质大学(北京)信息工程学院,北京 100083

南京航空航天大学航天学院,南京 210016

中国地震应急搜救中心,北京 100049

首都师范大学资源环境与旅游学院,北京 100048

中国空间技术研究院遥感卫星总体部,北京 100094

展开 >

二段式网络 遥感图像修复 空间语义注意力 局部特征连续性 全局语义信息相关性

国家自然科学基金项目中国地震应急搜救中心青年科技基金项目

42061073SJ2101

2024

自然资源遥感
中国国土资源航空物探遥感中心

自然资源遥感

CSTPCD北大核心
影响因子:1.275
ISSN:2097-034X
年,卷(期):2024.36(1)
  • 32