首页|融合卷积和Transformer的腹部多器官分割网络

融合卷积和Transformer的腹部多器官分割网络

扫码查看
腹部多器官分割在计算机辅助诊断中起着至关重要的作用,具有重要的研究价值。但由于腹部多器官边界模糊、背景复杂以及形状大小多变,使这项任务极具挑战性。为此,提出了一种融合卷积和Transformer的腹部多器官分割网络TCMSUnet。首先,在特征提取阶段设计了多尺度引导融合模块(GFM),利用高层特征提取的显著语义信息来引导低层特征以增强相邻特征的语义一致性,从而促进不同尺度特征的融合;随后设计了全局局部增强模块(GLE),通过空洞卷积和Transformer块结合来增强模型对全局局部上下文信息的提取,使模型在建立长距离依赖关系的同时加强特征的局部关联性;最后,在解码器部分引入多阶段损失聚合结构以加快模型的收敛并优化模型的性能。在Synapse数据集上评估了模型的性能,其平均Dice相似系数(DSC)为81。20%。实验结果表明,所提方法整体性能优于多种比较网络,并对形状大小多变的器官有更好的分割效果。
Abdominal Multi Organ Segmentation Network Combining Convolution and Transformer
Abdominal multi organ segmentation plays a crucial role in computer-aided diagnosis and has significant research value.However,due to the blurred boundaries of multiple organs in the abdomen,complex backgrounds,and variable shapes and sizes,this task is extremely challenging.To this end,TCMSUnet,a new abdominal multi organ segmentation network that integrates convolution and Transformer is proposed.Firstly,a multi-scale guided fusion module(GFM)was designed in the feature extraction stage,which utilizes the significant semantic information extracted from high-level features to guide low-level features and enhance the semantic consistency of adjacent features,thereby promoting the fusion of features at different scales.Subsequently,a global local enhancement module(GLE)was designed to enhance the model's extraction of global and local contextual information through a combination of dilated con-volution and Transformer blocks,enabling the model to establish long-range dependencies while enhancing local correlations of features.Finally,a multi-stage loss aggregation structure was introduced in the decoder section to accelerate the convergence of the model and optimize its performance.The performance of the model was evaluated on the Synapse dataset,with an average Dice similarity coefficient(DSC)of 81.20%.The experimental results show that the proposed method outperforms multiple comparison networks in overall per-formance and has better segmentation performance for organs with variable shapes and sizes.

medical image segmentationfeature fusionmulti scaledilated convolutionsTransformermultiple organs

杨萍、陈立伟、王庆凤、周莹

展开 >

西南科技大学 计算机科学与技术学院,四川 绵阳 621000

绵阳市中心医院 放射科,四川 绵阳 621000

医学图像分割 特征融合 多尺度 空洞卷积 Transformer 多器官

四川省自然科学基金项目四川省自然科学基金项目西南科技大学博士基金项目西南科技大学博士基金项目

2022NSFSC09402022NSFSC089419zx714320zx7137

2024

计算机技术与发展
陕西省计算机学会

计算机技术与发展

CSTPCD
影响因子:0.621
ISSN:1673-629X
年,卷(期):2024.34(9)