基于卷积神经网络与注意力机制的高光谱图像分类
Hyperspectral image classification based on convolutional neural network and attention mechanism
高玉鹏 1闫伟红 2潘新1
作者信息
- 1. 内蒙古农业大学计算机与信息工程学院,内蒙古呼和浩特 010018
- 2. 中国农业科学院草原研究所,内蒙古呼和浩特 010010
- 折叠
摘要
由于浅层卷积神经网络(convolutional neural network,CNN)模型感受野的限制,无法捕获远距离特征,在高光谱图像(hyperspectral image,HSI)分类问题中无法充分利用图像空间-光谱信息,很难获得较高精度的分类结果.针对上述问题,本文提出了一种基于卷积神经网络与注意力机制的模型(model based on convolutional neural network and attention mechanism,CNNAM),该模型利用CA(coordinate attention)对图像通道数据进行位置编码,并利用以自注意力机制为核心架构的Transformer模块对其进行远距离特征提取以解决CNN感受野的限制问题.CNNAM在In-dian Pines和Salinas两个数据集上得到的总体分类精度分别为97.63％和99.34％,对比于其他模型,本文提出的模型表现出更好的分类性能.另外,本文以是否结合CA为参考进行了消融实验,并证明了CA在CNNAM中发挥重要作用.实验证明将传统CNN与注意力机制相结合可以在HSI分类问题中获得更高的分类精度.
Abstract
Due to the limitation of the receptive field of the shallow convolutional neural network(CNN)model,long distance features cannot be captured,and the spatial-spectral information of the image cannot be fully utilized in hyperspectral image classification,so it is difficult to obtain high precision classification results.To solve these problems,this paper proposes a model based on convolutional neural network and attention mechanism(CNNAM).The model uses coordinate attention(CA)to encode the position of the image channel data,and uses the Transformer module with self-attention mechanism as the core ar-chitecture to extract the long distance features to solve the CNN receptive field limitation problem.The overall classification accuracy of the proposed model on Indian Pines and Salinas datasets is 97.63％and 99.34％.Compared with other models,the proposed model shows better classification performance.In addition,the ablation experiments are carried out based on whether CA is combined with CNNAM,and it is proved that CA playes an important role in CNNAM.Experiments show that the combination of tradi-tional CNN and attention mechanism can achieve higher classification accuracy in HSI classification.
关键词
高光谱图像分类(HSI)/卷积神经网络(CNN)/coordinate/attention/TransformerKey words
hyperspectral image(HSI)classification/convolutional neural network(CNN)/coordinate attention(CA)/Transformer引用本文复制引用
基金项目
国家自然科学基金(61962048)
国家自然科学基金(61562067)
中央高校基本科研业务费专项(1610332020020)
出版年
2024
NETL
NSTL
维普
万方数据