临床超声医学杂志2024,Vol.26Issue(2) :114-119.

改良Transformer模型应用于乳腺结节超声报告自主生成的可行性研究

A feasibility study of modified Transformer model for intelligent generation of ultrasound report on breast nodules

王怡 周鑫仪 徐黎明 邓丹 冉海涛
临床超声医学杂志2024,Vol.26Issue(2) :114-119.

改良Transformer模型应用于乳腺结节超声报告自主生成的可行性研究

A feasibility study of modified Transformer model for intelligent generation of ultrasound report on breast nodules

王怡 1周鑫仪 1徐黎明 2邓丹 3冉海涛1
扫码查看

作者信息

  • 1. 400010 重庆市,重庆医科大学附属第二医院超声科重庆医科大学超声影像学研究所
  • 2. 西华师范大学计算机学院
  • 3. 长沙医学院医学影像学院
  • 折叠

摘要

目的 将改良Transformer模型应用于乳腺结节超声报告自主生成,并对其可行性进行初步探讨.方法 收集832例乳腺结节患者(共1284个结节)的超声图像构建BND数据集,引入一种改良Transformer模型对BND数据集进行智能分析,生成相应文本报告,并与Ensemble Model、SSD、R-FCN模型进行比较;同时引入LGK数据集,将改良Transformer模型与TieNet、Kerp、VTI、RNCM模型进行比较.采用BLEU评分评估各模型的性能.结果 在BND数据集中,改良模型的BLEU-1、BLEU-2、BLEU-3及BLEU-4评分分别为0.547、0.474、0.352、0.282,均高于Ensemble Model、SSD、R-FCN模型.在LGK数据集中,改良Transformer模型的BLEU-1、BLEU-2、BLEU-3及BLEU-4评分分别为0.579、0.391、0.288、0.152.结论 改良Transformer模型能够快速识别乳腺结节并自主生成标准报告,与Ensemble Model、SSD、R-FCN模型相比,获得了良好的BLEU评分,同时该模型在LGK数据集中BLEU评分也较高,表明改良Transformer模型具有较高的文本泛化性能.

Abstract

Objective To employ a modified Transformer model for intelligent generation of ultrasound reports on breast nodules,and to preliminarily explore the feasibility.Methods The ultrasound images of 832 patients with breast nodules(1284 nodules in total)were collected to construct the BND dataset.A modified Transformer model was introduced to intelligence analyze the BND dataset and generate the corresponding text report,which was compared with the Ensemble Model,SSD and R-FCN models,respectively.Moreover,the LGK dataset was introduced to compare the modified model with TieNet,Kerp,VTI,RNCM models,respectively.The performance of the models was evaluated by BLEU score.Results In the BND dataset,the BLEU-1,BLEU-2,BLEU-3 and BLEU-4 scores of the modified model were 0.547,0.474,0.352 and 0.282,respectively,which were higher than those in Ensemble Model,SSD and R-FCN models.In the LGK dataset,the BLEU-1,BLEU-2,BLEU-3 and BLEU-4 scores of the modified model were 0.579,0.391,0.288 and 0.152,respectively.Conclusion The modified Transformer model exhibits the ability to quickly identify breast nodules and generate standard reports independently.Compared with Ensemble Model,SSD and R-FCN models,it achieves a higher BLEU score.Furthermore,the modified model demonstrates exceptional performance on the LGK dataset,indicating it has strong text generalization capability.

关键词

深度学习/Transformer模型/乳腺结节/报告生成

Key words

Deep learning/Transformer model/Breast nodules/Report generation

引用本文复制引用

基金项目

国家自然科学基金(82071926)

出版年

2024
临床超声医学杂志
重庆医科大学第二临床学院,重庆医科大学附属第二医院

临床超声医学杂志

CSTPCDCSCD
影响因子:0.845
ISSN:1008-6978
参考文献量18
段落导航相关论文