首页|基于分级注意力的多示例口腔癌病理分类

基于分级注意力的多示例口腔癌病理分类

扫码查看
针对病理数据超大尺寸、标注成本高昂等问题带来的病理分类准确率较低的问题,基于多示例网络,引入分级注意力模块,设计一种兼顾示例级和图像块级损失的病理分类算法。回顾性收集皖南医学院第一附属医院口腔颌面外科186例口腔癌(126例鳞癌、60例腺癌),其数字病理切片划分为验证集、测试集及训练集。首先对病理图像进行前后背景分割,去掉背景中的噪声部分,然后采用ResNet50对分割后的病理图像提取特征,并将特征输入第一级注意力网络,得到基于图像块的注意力得分和损失,再根据注意力得分对图像块进行排序重置标签输入第二级注意力网络,得到基于示例级别的损失,最后将两级注意力的损失作为模型的总损失,通过训练最终网络,得到口腔癌分类结果。实验结果表明,使用两级注意力的多示例网络准确率为78。95%,AUC为0。8430,相较于基线模型均有更高表现。
Pathological classification of oral cancer based on multi-instance network and two-level attention
To address the problems of the low accuracy of pathological classification caused by the large size of pathological data and the high cost of labeling,a pathological classification algorithm for oral cancer is designed based on multi-instance network and two-level attention module,which takes losses at the instance level and image block level into account.A retrospective analysis is conducted on 186 cases of oral cancer(126 cases of squamous cell carcinoma and 60 cases of adenocarcinoma)in the Department of Oral and Maxillofacial Surgery,the First Affiliated Hospital of Wannan Medical College,and the digital pathological sections are divided into training set,verification set and test set.The foreground and background segmentations are performed on the pathological image,and the noise is removed from the background.ResNet50 is used to extract features from the segmented pathological images,and the features are input into the first-level attention network to obtain the attention score and loss based on image block.Then,the image blocks are sorted according to the attention score,and the reset labels are input into the second-level attention network to obtain the loss based on the instance level.The loss of the two-level attention is taken as the total loss of the model,and the prediction result is obtained by training the final network.The experimental results show that the multi-instance network using two-level attention achieves an accuracy of 78.95%and AUC of 0.8430,demonstrating superior performance than the baseline models.

oral cancermulti-instance learningtwo-level attentionpathological image

江慧敏、方立铭、陶龙

展开 >

皖南医学院医学影像学院,安徽芜湖 241000

口腔癌 多示例学习 两级注意力 病理图像

国家自然科学基金安徽省自然科学基金皖南医学院中青年重点科研项目

118011991908085QA30WK2023ZZD04

2024

中国医学物理学杂志
南方医科大学,中国医学物理学会

中国医学物理学杂志

CSTPCD
影响因子:0.483
ISSN:1005-202X
年,卷(期):2024.41(8)