首页|结合CNN和Transformer病变信号引导的蜂窝肺CT图像识别

结合CNN和Transformer病变信号引导的蜂窝肺CT图像识别

扫码查看
蜂窝肺是多种肺部疾病晚期的CT影像表现,其影像特征表现为多样化的囊状病变,呈现蜂窝样外观.现有的计算机辅助诊断方法,难以有效解决蜂窝肺病灶形态不一、位置不同所导致的识别准确率不高的问题.因此,提出一种结合CNN和Transformer病变信号引导下的蜂窝肺CT影像识别模型.采用多尺度信息增强模块丰富CNN获取的不同尺度下特征的空间信息与通道信息,同时使用病变信号生成模块以强化病变特征表达;利用Transformer获取特征的长距离依赖信息以弥补CNN在提取全局信息方面的缺陷;引入多头交叉注意力机制融合特征信息获得分类结果.实验结果表明,该模型在蜂窝肺和COVID-CT数据集中分别取得了99.67%、97.08%的精确度,对比其他模型具有更加精准的识别结果,验证了模型的有效性和泛化性.
Combination of CNN and Transformer for Lesion-Guided Honeycomb Lung CT Image Recognition
Honeycomb lung is a CT imaging manifestation of various advanced lung diseases,characterized by diverse cystic lesions presenting a honeycomb-like appearance.Existing computer-aided diagnosis methods struggle to effectively address the low identification accuracy caused by the varied morphology and different locations of cellular lung lesions.Therefore,a combined CNN and Transformer model guided by lesion signals is proposed for cellular lung CT image recognition.In this model,a multi-scale information enhancement module is first employed to enrich the spatial and channel information of features obtained by CNN at different scales.Simultaneously,a lesion signal generation module is used to strengthen the expression of lesion features.Subsequently,Transformer is utilized to capture long-range dependency information of features,compensating for the deficiency of CNN in extracting global information.Finally,a multi-head cross-attention mechanism is introduced to fuse feature information and obtain classification results.Experimental results demonstrate that the proposed model achieves accuracies of 99.67%and 97.08%on the honeycomb lung and COVID-CT dataset,respectively.It outperforms other models,providing more precise recognition results and validating the effectiveness and generalization of the model.

image processinghoneycomb lunglesion signalmulti-scale information enhancementcross attention

杨炳乾、冯秀芳、董云云、张源榕

展开 >

太原理工大学软件学院,山西 晋中 030600

图像处理 蜂窝肺 病变信号 多尺度信息增强 交叉注意力

国家自然科学基金山西省重点研发计划山西省应用基础研究计划

62306206202102020101007202203021212207

2024

激光与光电子学进展
中国科学院上海光学精密机械研究所

激光与光电子学进展

CSTPCD北大核心
影响因子:1.153
ISSN:1006-4125
年,卷(期):2024.61(14)
  • 2