计算机工程与科学2024,Vol.46Issue(3) :479-487.DOI:10.3969/j.issn.1007-130X.2024.03.010

融合多注意力机制的自监督小样本医学图像分割

Self-supervised few-shot medical image segmentation with multi-attention mechanism

要媛媛 刘宇航 程雨菁 彭梦晓 郑文
计算机工程与科学2024,Vol.46Issue(3) :479-487.DOI:10.3969/j.issn.1007-130X.2024.03.010

融合多注意力机制的自监督小样本医学图像分割

Self-supervised few-shot medical image segmentation with multi-attention mechanism

要媛媛 1刘宇航 1程雨菁 1彭梦晓 1郑文2
扫码查看

作者信息

  • 1. 太原理工大学计算机科学与技术学院(大数据学院),山西 晋中 030600
  • 2. 太原理工大学计算机科学与技术学院(大数据学院),山西 晋中 030600;长治医学院山西省智能数据辅助诊疗工程研究中心,山西 长治 046000
  • 折叠

摘要

主流的基于全监督的深度学习分割模型在丰富的标记数据上训练时可以取得良好的效果,但医疗图像领域的图像分割存在标注成本高、分割目标种类多的问题,且往往缺少足够的标注数据.提出一个模型,通过融合自监督从数据中提取标签,利用超像素表征图像特性,进行小样本标注条件下的图像分割.引入多注意力机制使得模型更多关注图像的空间特征,位置注意模块和通道注意模块致力于单一图像内部的多尺度特征融合,而外部注意力模块显著突出了不同样本间的联系.在CHAOS健康腹部器官数据集上进行实验,1-shot极端情况下DSC达0.76,相较baseline分割结果提升3%左右.通过调整N-way-K-shot任务数来探讨小样本学习的意义,在7-shot设置下DSC有显著提升,与基于全监督的深度学习分割效果的差距在可接受范围内.

Abstract

Mainstream fully supervised deep learning segmentation models can achieve good results when trained on abundant labeled data,but the image segmentation in the medical field faces the chal-lenges of high annotation cost and diverse segmentation targets,often lacking sufficient labeled data.The model proposed in this paper incorporates the idea of extracting labels from data through self-super-vision,utilizing superpixels to represent image characteristics for image segmentation under conditions of small sample annotation.The introduction of multiple attention mechanisms allows the model to fo-cus more on spatial features of the image.The position attention module and channel attention module aim to fuse multi-scale features within a single image,while the external attention module highlights the connections between different samples.Experiments were conducted on the CHAOS healthy abdominal organ dataset.In the extreme case of the 1-shot,DSC reached 0.76,which is about 3%higher than the baseline result.In addition,this paper explores the significance of few-shot learning by adjusting the number of N-way-K-shot tasks.Under the 7-shot setting,DSC achieves significant improvement,which is within an acceptable range of the segmentation effect based on full supervision based on deep learning.

关键词

小样本/注意力机制/自监督/原型网络

Key words

few-shot/attention mechanism/self-supervision/prototype network

引用本文复制引用

基金项目

国家自然科学基金(11702289)

山西省关键核心技术和共性技术研发攻关专项项目(2020XXX013)

出版年

2024
计算机工程与科学
国防科学技术大学计算机学院

计算机工程与科学

CSTPCD北大核心
影响因子:0.787
ISSN:1007-130X
参考文献量30
段落导航相关论文