首页|基于双路径交叉融合网络的肺结节CT图像分类方法

基于双路径交叉融合网络的肺结节CT图像分类方法

扫码查看
针对肺结节计算机断层(CT)图像具有的细节多样性以及类间相似性的问题,构建了一种集卷积神经网络(Convolutional neural network,CNN)和Transformer优势的双路径交叉融合网络对肺结节进行更精确的分类.首先,以窗口多头自注意力和滑动窗口多头自注意力为基础,构建全局特征块,用于捕获结节的形态特征;以大核注意力为基础构建局部特征块,用于提取结节的纹理、密度等内部特征.其次,设计特征融合块用于融合上一阶段的局部与全局特征,使每一条路径都能获得更综合的判别信息.然后,引入KL(Kullback-leibler)散度来增加不同尺度特征之间的分布差异性,优化网络性能.最后,采用决策层融合的方法获得分类结果.在LIDC-IDRI数据集上进行实验,网络的分类准确率、召回率、精确率、特异性、受试者操作特征(ROC)曲线下的面积(Area under curve,AUC)分别为 94.16%、93.93%、93.03%、92.54%、97.02%.实验结果表明,所提方法具有较好的肺结节良恶性分类能力.
Pulmonary Nodule Computed Tomography Image Classification Method Based on Dual-Path Cross-Fusion Network
Pulmonary nodule computed tomography(CT)images have diverse details and interclass similarity.To address this problem,a dual-path cross-fusion network combining the advantages of convolutional neural network(CNN)and Transformer is constructed to classify pulmonary nodules more accurately.First,based on windows multi-head self-attention and shifted windows multi-head self-attention,a global feature block is constructed to capture the morphological features of nodules;then,a local feature block is constructed based on large kernel attention,which is used to extract internal features such as the texture and density of nodules.A feature fusion block is designed to fuse local and global features of the previous stage so that each path can collect more comprehensive discriminative information.Subsequently,Kullback-Leibler(KL)divergence is introduced to increase the distribution difference between features of different scales and optimize network performance.Finally,a decision-level fusion method is used to obtain the classification results.Experiments are conducted on the LIDC-IDRI dataset,and the network achieves a classification accuracy,recall,precision,specificity,and area under curve(AUC)of 94.16%,93.93%,93.03%,92.54%,and 97.02%,respectively.Experimental results show that this method can classify benign and malignant pulmonary nodules effectively.

classification of benign and malignant pulmonary nodulesCT imagelocal-global featureTransformerattention mechanism

杨萍、张鑫、温帆、田吉、何宁

展开 >

北京联合大学智慧城市学院,北京 100101

肺结节良恶性分类 CT图像 局部-全局特征 Transformer 注意力机制

国家自然科学基金国家自然科学基金

6217204562272049

2024

激光与光电子学进展
中国科学院上海光学精密机械研究所

激光与光电子学进展

CSTPCD北大核心
影响因子:1.153
ISSN:1006-4125
年,卷(期):2024.61(8)
  • 1
  • 28