计算机工程与设计2024,Vol.45Issue(2) :500-507.DOI:10.16208/j.issn1000-7024.2024.02.023

融合卷积和上下文变压器的遥感图像配准

Registration of remote sensing images by combining convolution and context Transformer

侯建行 陈颖 李翔 李铖昊
计算机工程与设计2024,Vol.45Issue(2) :500-507.DOI:10.16208/j.issn1000-7024.2024.02.023

融合卷积和上下文变压器的遥感图像配准

Registration of remote sensing images by combining convolution and context Transformer

侯建行 1陈颖 1李翔 1李铖昊1
扫码查看

作者信息

  • 1. 上海应用技术大学计算机科学与信息工程学院,上海 201418
  • 折叠

摘要

针对卷积神经网络在遥感图像配准上鲁棒性弱、精度低的问题,提出一种结合残差网络和变压器并融入四重注意力的配准算法.提出一种卷积和遥感上下文变压器混合的网络结构,替换残差网络残差块并与其它预训练卷积层结合,以特征提取.将四重注意力机制融入特征提取网络,提高遥感图像区分性特征表示.设计双向匹配网络,采用皮尔逊互相关算法建立遥感图像之间的对应关系.实验结果表明,该模型在遥感图像配准多个评估指标下均优于其它模型.

Abstract

Aiming at the problem of weak robustness and low accuracy of convolutional neural networks in remote sensing image registration,a registration algorithm combining residual network and Transformer and integrating quadruple attention was pro-posed.A hybrid network structure of convolution and remote sensing context Transformer was proposed,in which the residual network residual block was replaced and it was combined with other pre-trained convolutional layers for feature extraction.The quadruple attention mechanism was integrated into the feature extraction network to improve the discriminatory feature represen-tation of remote sensing images.A bidirectional matching network was designed,and the Pearson cross-correlation algorithm was used to establish the correspondence between remote sensing images.Experimental results show that the model is better than other models under multiple evaluation indexes of remote sensing image registration.

关键词

遥感图像配准/残差网络/变压器/混合网络结构/四重注意力/双向匹配网络/皮尔逊

Key words

remote sensing image registration/residual network/Transformer/hybrid network structure/convolutional quater-nary attention/bidirectional matching network/Pearson

引用本文复制引用

基金项目

国家自然科学基金项目(61976140)

上海应用技术大学协同创新基金项目(XTCX2022-25)

出版年

2024
计算机工程与设计
中国航天科工集团二院706所

计算机工程与设计

CSTPCD北大核心
影响因子:0.617
ISSN:1000-7024
参考文献量21
段落导航相关论文