首页|基于双模态高效特征学习的高分辨率遥感图像分割

基于双模态高效特征学习的高分辨率遥感图像分割

扫码查看
遥感图像因具有丰富的语义信息和空间信息,增加了语义分割的难度.然而已有提取双模态特征的分割方法采用相同的主干网络,没有考虑互补特征的差异,存在特征提取、特征融合和上采样恢复细节信息不足等问题,无法准确高效的学习高分辨率遥感图像信息.因此,本文提出基于双模态高效特征学习的高分辨率遥感图像分割算法.首先,针对不同模态的遥感图像设计合适的编码器,高效的提取双模态特征,并通过交互加强模块减少不同路径特征之间的差异.其次,提出双模态特征聚合模块和深层特征提取模块进一步融合和提取双模态特征,使网络能够充分学习互补信息.最后,提出多层特征上采样模块,利用语义信息丰富的高层特征对细节信息丰富的低层特征进行加权操作,逐步上采样实现特征高效恢复,提升分割性能.实验结果表明,所提算法在ISPRS Potsdam和Vaihingen数据集上的总体精度分别达到了 94.52%、90.45%,能够高效的提取并融合高分辨率遥感图像的双模态特征,提高遥感图像分割的准确率.
High resolution remote sensing image segmentation based on dual-modal efficient feature learning
With the rapid development of spatial technology,the resolution of remote sensing images gradually improves.The detailed information and spatial information contained in remote-sensing images are also richer.The ensuing problems are that the difference between various categories becomes and the difference between the same categories becomes larger,i.e.,the phenomenon of the same spectrum of foreign objects and the different spectrum of the same objects is serious.However,the existing dual-modal segmentation methods do not extract the dual-modal feature information of remote-sensing images separately,and the fusion features are insufficient.The details of upsampling recovery are also insufficient,resulting in the inability to accurately and efficiently learn remote-sensing image information,thereby resulting in segmentation errors,edge blur,and other problems.This study proposes a high resolution remote-sensing image segmentation based on dual-modal efficient feature learning.The algorithm designs appropriate encoders for different modal remote sensing images,efficiently extracts dual-modal features,and reduces the differences between different path features through interactive reinforcement modules.Then,the dual-modal feature aggregation module and the deep feature-extraction module are proposed to further fuse and extract the dual-modal features.As a result,the network can fully learn the complementary information of the dual-modal.Finally,a multi-layer feature upsampling module is proposed,which uses high-level features with rich semantic information to weight the low-level features with rich detail information.Gradual upsampling is then conducted to achieve efficient feature recovery and improve segmentation performance.In this paper,experiments on the Potsdam and Vaihingen datasets demonstrate that the overall accuracy reaches 94.52%and 90.45%,respectively.Experimental results show that the segmentation effect of the proposed algorithm is better than that of existing algorithms.The proposed algorithm can efficiently extract and fuse the multi-modal complementary features of high resolution remote-sensing images and improve the segmentation accuracy of remote-sensing images.This study proposes a high-resolution remote-sensing image segmentation based on dual-modal eficient feature learning.Experiments on the ISPRS Potsdam and Vaihingen datasets show that the proposed model is more suitable for segmenting low vegetation and trees,buildings,and roads with very similar spectral features.It can also achieve the accurate segmentation of small targets,such as cars.However,the complexity of the model needs to be further reduced,and much room for improvement in accuracy remains.In the future,a better segmentation network will be designed to fuse more than two modal features and thus obtain more feature information to achieve more accurate remote sensing image segmentation.

remote sensing image segmentationefficient feature extractionintegrationdual-modal feature aggregationdeep feature extractionmultilayer feature upsampling

张银胜、吉茹、童俊毅、杨宇龙、胡宇翔、单慧琳

展开 >

无锡学院电子信息工程学院,无锡 214105

南京信息工程大学电子与信息工程学院,南京 210044

遥感图像分割 高效特征提取 交互融合 双模态特征聚合 深层特征提取 多层特征上采样

国家自然科学基金国家自然科学基金江苏省研究生科研与实践创新计划

6207124062106111SJCX23 0379

2024

遥感学报
中国地理学会环境遥感分会 中国科学院遥感应用研究所

遥感学报

CSTPCD北大核心
影响因子:2.921
ISSN:1007-4619
年,卷(期):2024.28(2)
  • 27