自然资源遥感2024,Vol.36Issue(1) :58-66.DOI:10.6046/gtzyyg.2022362

结合空间语义注意力的二段式遥感图像修复网络

A two-stage remote sensing image inpainting network combined with spatial semantic attention

刘宇佳 谢诗哲 杜阳 严瑾 南燕云 温中凯
自然资源遥感2024,Vol.36Issue(1) :58-66.DOI:10.6046/gtzyyg.2022362

结合空间语义注意力的二段式遥感图像修复网络

A two-stage remote sensing image inpainting network combined with spatial semantic attention

刘宇佳 1谢诗哲 2杜阳 3严瑾 4南燕云 5温中凯6
扫码查看

作者信息

  • 1. 辽宁工程技术大学测绘与地理科学学院,阜新 123000
  • 2. 中国地质大学(北京)信息工程学院,北京 100083
  • 3. 南京航空航天大学航天学院,南京 210016
  • 4. 中国地震应急搜救中心,北京 100049;首都师范大学资源环境与旅游学院,北京 100048
  • 5. 中国地震应急搜救中心,北京 100049
  • 6. 南京航空航天大学航天学院,南京 210016;中国空间技术研究院遥感卫星总体部,北京 100094
  • 折叠

摘要

高分辨率遥感图像的缺失区域中地物种类复杂多样、空间异质性高,导致图像修复结果中存在纹理模糊和结构扭曲的问题,且在边界和复杂纹理区域尤为突出.因此提出一种结合空间语义注意力的二段式遥感图像修复网络.该网络由粗修复网络和精修复网络串联而成,旨在使用粗略修复网络提供的先验信息,引导精修复网络对缺失区域的复原.在粗修复网络中,构建多级损失结构以强化网络训练的稳定性;在精修复网络中,提出一种新的空间语义注意力机制,并依据网络特征的分布特点,区别性将空间语义注意力嵌入在编码器和解码器中,以确保局部特征的连续性和全局语义信息的相关性.实验结果表明,所提方法相比于现有其他算法可以进一步提升图像修复效果.

Abstract

In high-resolution remote sensing images,missing areas feature intricate surface features and pronounced spatial heterogeneity,causing the image inpainting results to suffer texture blurring and structural distortion,particularly for boundaries and areas with complex textures.This study proposed a two-stage remote sensing image inpainting network combined with spatial semantic attention(SSA).The network comprised two networks in series:one for coarse image inpainting and one for fine-scale image inpainting(also referred to as the coarse and fine-scale networks,respectively).This network was designed to guide the fine-scale network to restore the missing areas using the priori information provided by the coarse network.In the coarse network,a multi-level loss structure was constructed to enhance the stability of network training.In the fine-scale network,a novel SSA mechanism was proposed,with SSA being embedded differentially in the encoder and decoder based on the distribution of network features.This ensured the continuity of local features and the correlation of global semantic information.The experimental results show that the network proposed in this study can further improve the image inpainting effects compared to other existing algorithms.

关键词

二段式网络/遥感图像修复/空间语义注意力/局部特征连续性/全局语义信息相关性

Key words

two-stage network/remote sensing image inpainting/spatial semantic attention/continuity of local fea-tures/correlation of global semantic information

引用本文复制引用

基金项目

国家自然科学基金项目(42061073)

中国地震应急搜救中心青年科技基金项目(SJ2101)

出版年

2024
自然资源遥感
中国国土资源航空物探遥感中心

自然资源遥感

CSTPCDCSCD北大核心
影响因子:1.275
ISSN:2097-034X
被引量1
参考文献量32
段落导航相关论文