首页|2D/3D多模态医学图像配准算法研究

2D/3D多模态医学图像配准算法研究

扫码查看
2D/3D多模态配准在医学影像导航手术中起着重要作用,主要用于提供术前三维图像和术中二维图像的实时信息,帮助医生精准定位病灶,规划手术路径,从而提高手术的安全性和效率.提出了一种2D/3D多模态医学图像配准算法,首先利用Swin Transformer优秀的特征提取能力,构建了初始姿态估计模型,实现姿态参数的快速预测;接着,为了提升整个配准方法的鲁棒性,引入基于Grangeat关系的粗配准方法;最后设计了基于梯度下降的精配准模块,以提升整个配准过程的精确性,且在该模块将Sobel微分算子与归一化互相关结合,提升了参数优化过程中的灵敏度.实验结果表明,所提配准方法在正位和侧位配准中的误差满足配准要求,配准成功率有显著提升.
Research on 2D/3D multimodal medical image registration algorithm
2D/3D multimodal alignment plays an important role in medical image navigation surgery,which is mainly used to provide real-time information of preoperative 3D images and intraoperative 2D images to help doctors accu-rately locate the lesions and plan the surgical paths,so as to improve the safety and efficiency of surgery.A 2D/3D multimodal medical image alignment algorithm was proposed,which firstly utilized the excellent feature extraction capability of Swin Transformer to construct an initial pose estimation model to realize the fast prediction of pose pa-rameters.Then,in order to improve the robustness of the whole alignment method,a coarse alignment method based on the Grangeat relation was introduced.Finally,a fine alignment module based on gradient descent was designed.A fine alignment module based on gradient descent was designed to improve the accuracy of the whole alignment pro-cess,and the Sobel differential operator was combined with normalized correlation in this module to improve the sen-sitivity of the parameter optimization process.The experimental results show that the proposed alignment method meets the alignment requirements in the orthogonal and lateral alignment errors,and the alignment success rate is sig-nificantly improved.

2D/3D image registrationmultimodalityinitial pose estimationcoarse registrationfine registrationsimilarity measurement

徐密、诸葛斌、袁非牛、尹正虎、董黎刚、蒋献、孙应绮、宋嘉琦、史晓彤、苏雷、周屹博、林诗凡

展开 >

浙江工商大学信息与电子工程学院,浙江 杭州 310020

上海师范大学信息与机电工程学院,上海 201418

复旦大学附属儿科医院,上海 201102

2D/3D图像配准 多模态 初始姿态估计 粗配准 精配准 相似度测量

国家自然科学基金浙江省新型网络标准与应用技术重点实验室项目浙江省"尖兵领雁"研发攻关计划浙江省研究生一般项目国家级大学生创新创业训练计划国家级大学生创新创业训练计划国家级大学生创新创业训练计划浙江省大学生科技创新活动计划新苗人才计划

622723082013E100122023C032021120XJ06220332022103530222023103530402023103530691120KZN0223068G

2024

电信科学
中国通信学会 人民邮电出版社

电信科学

CSTPCD北大核心
影响因子:0.902
ISSN:1000-0801
年,卷(期):2024.40(3)
  • 28