多级特征交互Transformer的多器官图像分割
Multi-level Feature Interaction Transformer for Multi-organ Image Segmentation
武书磊 1张方红 2杨有 2刘学文2
作者信息
- 1. 重庆师范大学计算机与信息科学学院,重庆 401331
- 2. 重庆师范大学重庆国家应用数学中心,重庆 401331
- 折叠
摘要
多器官医学图像分割有助于医生做出临床诊断.针对CNN提取全局特征能力弱,Transformer提取局部特征能力弱,以及Transformer具有二次方计算复杂度的问题,提出了用于多器官医学图像分割的多级特征交互Transformer模型.所提模型采用CNN提取局部特征,局部特征经Swin Transformer输出全局特征;通过下采样分别产生多级局部和全局特征,每级局部和全局特征经过交互并增强;每级增强后的特征经多级特征融合模块进行交叉融合;再次融合后的特征经过上采样和分割头输出分割掩码.所提模型在Synapse和ACDC数据集上进行实验,平均DSC和平均HD95 系数值为 80.16%和 19.20 mm,均优于LGNet和RFE-UNet等代表性模型.该模型对多器官医学图像分割是有效的.
Abstract
Clinical diagnoses can be facilitated through the utilization of multi-organ medical image segmentation.This study proposes a multi-level feature interaction Transformer model to address the issues of weak global feature extraction capability in CNN,weak local feature extraction capability in Transformer,and the quadratic computational complexity problem of Transformer for multi-organ medical image segmentation.The proposed model employs CNN for extracting local features,which are then transformed into global features through Swin Transformer.Multi-level local and global features are generated through down-sampling,and each level of local and global features undergo interaction and enhancement.After the enhancement at each level,the features are cross-fused by multi-level feature fusion modules.The features,once again fused,pass through up-sampling and segmentation heads to produce segmentation masks.The proposed model is experimented on the Synapse and ACDC datasets,achieving average dice similarity coefficient(DSC)and average 95th percentile Hausdorff distance(HD95)values of 80.16%and 19.20 mm,respectively.These results outperform representative models such as LGNet and RFE-UNet.The proposed model is effective for multi-organ medical image segmentation.
关键词
多器官医学图像分割/多级特征交互/Transformer/卷积神经网络(CNN)/语义分割/深度学习Key words
multi-organ medical image segmentation/multi-level feature interaction/Transformer/convolutional neural network(CNN)/semantic segmentation/deep learning引用本文复制引用
基金项目
重庆市教委科技研究项目(KJZD202200504)
重庆市自然科学基金创新发展联合基金(市教委)(CSTB2023NSCQ-LZX0142)
重庆市高等教育教学改革研究项目(232062)
出版年
2024
NETL
NSTL
万方数据