首页|融合多注意力机制的自监督小样本医学图像分割

融合多注意力机制的自监督小样本医学图像分割

扫码查看
主流的基于全监督的深度学习分割模型在丰富的标记数据上训练时可以取得良好的效果,但医疗图像领域的图像分割存在标注成本高、分割目标种类多的问题,且往往缺少足够的标注数据。提出一个模型,通过融合自监督从数据中提取标签,利用超像素表征图像特性,进行小样本标注条件下的图像分割。引入多注意力机制使得模型更多关注图像的空间特征,位置注意模块和通道注意模块致力于单一图像内部的多尺度特征融合,而外部注意力模块显著突出了不同样本间的联系。在CHAOS健康腹部器官数据集上进行实验,1-shot极端情况下DSC达0。76,相较baseline分割结果提升3%左右。通过调整N-way-K-shot任务数来探讨小样本学习的意义,在7-shot设置下DSC有显著提升,与基于全监督的深度学习分割效果的差距在可接受范围内。
Self-supervised few-shot medical image segmentation with multi-attention mechanism
Mainstream fully supervised deep learning segmentation models can achieve good results when trained on abundant labeled data,but the image segmentation in the medical field faces the chal-lenges of high annotation cost and diverse segmentation targets,often lacking sufficient labeled data.The model proposed in this paper incorporates the idea of extracting labels from data through self-super-vision,utilizing superpixels to represent image characteristics for image segmentation under conditions of small sample annotation.The introduction of multiple attention mechanisms allows the model to fo-cus more on spatial features of the image.The position attention module and channel attention module aim to fuse multi-scale features within a single image,while the external attention module highlights the connections between different samples.Experiments were conducted on the CHAOS healthy abdominal organ dataset.In the extreme case of the 1-shot,DSC reached 0.76,which is about 3%higher than the baseline result.In addition,this paper explores the significance of few-shot learning by adjusting the number of N-way-K-shot tasks.Under the 7-shot setting,DSC achieves significant improvement,which is within an acceptable range of the segmentation effect based on full supervision based on deep learning.

few-shotattention mechanismself-supervisionprototype network

要媛媛、刘宇航、程雨菁、彭梦晓、郑文

展开 >

太原理工大学计算机科学与技术学院(大数据学院),山西 晋中 030600

长治医学院山西省智能数据辅助诊疗工程研究中心,山西 长治 046000

小样本 注意力机制 自监督 原型网络

国家自然科学基金山西省关键核心技术和共性技术研发攻关专项项目

117022892020XXX013

2024

计算机工程与科学
国防科学技术大学计算机学院

计算机工程与科学

CSTPCD北大核心
影响因子:0.787
ISSN:1007-130X
年,卷(期):2024.46(3)
  • 30