首页|深度学习在口腔医学影像中的应用与挑战

深度学习在口腔医学影像中的应用与挑战

扫码查看
口腔医学影像是进行临床口腔疾病检测、筛查、诊断和治疗评估的重要工具,对口腔影像进行准确分析对于后续治疗计划的制定至关重要。常规的口腔医学影像分析依赖于医师的水平和经验,存在阅片效率低、可重复性低以及定量分析欠缺的问题。深度学习可以从大样本数据中自动学习并获取优良的特征表达,提升各类机器学习任务的效率和性能,目前已广泛应用于医学影像分析处理的各类任务之中。基于深度学习的口腔医学影像处理是目前的研究热点,但由于口腔医学领域内在的特殊性和复杂性,以及口腔医学影像数据样本量通常较小的问题,给深度学习方法在相关学习任务和场景的应用带来了新的挑战。本文从口腔医学影像领域常用的二维X射线影像、三维点云/网格影像和锥形束计算机断层扫描影像3种影像出发,介绍深度学习技术在口腔医学影像处理及分析领域应用的思路和现状,分析了各算法的优缺点及该领域所面临的问题和挑战,并对未来的研究方向和可能开展的临床应用进行展望,以助力智慧口腔建设。
Applications and challenges of deep learning in dental imaging
Dental imaging is an essential tool for the detection,screening,diagnosis,and therapeutic evaluation of clinical oral diseases,and the accurate analysis of the images is vital to the development of subsequent treatment plans.Deep learn-ing,which is widely used in many fields,such as machine translation,speech recognition,and computer vision,can auto-matically learn and obtain superior feature expressions from large sample data,thereby improving the efficiency and perfor-mance of various machine learning tasks.With the integration of artificial intelligence and various fields,smart healthcare has become an important application area of deep learning,providing an effective way of solving the following clinical prob-lems:1)the shortage of experienced radiologists in the field of dentistry cannot meet the rapidly growing medical demand.2)Despite sufficient medical resources,the number of experienced physicians cannot meet the rapidly growing medical demand.3)Different physicians have different interpretations of the same oral image,which are influenced by subjectiv-ity.Deep learning-based dental image processing is currently a popular research topic.The inherent specificity and com-plexity of the medical field and the problem of insufficient dental image data samples bring new challenges to the applica-tion of deep learning methods in relevant learning tasks and scenarios.This work mainly reviews the various applications of deep learning methods using three major dental imaging methods(i.e.,two-dimensional oral X-ray images,three-dimensional tooth point cloud/mesh images,cone beam computed tomography(CBCT)).These applications include tooth segmentation,caries detection,and tumor detection.The reviews on two-dimensional oral X-ray images focus on bitewing,periapical,and panoramic X-rays based on deep learning methods.Bitewing X-rays usually show the contact surface from the distal end of the canine to the most distal molar and are mainly used to diagnose proximal caries,assess the extent of caries,and identify secondary caries under existing restorations.For caries detection using bitewing X-rays,we mainly review deep learning methods using convolutional neural network architectures,such as full convolutional neural networks and U-Net architectures.Periodontitis and caries detection using periapical X-rays primarily introduces methods based on convolutional neural networks and backward propagation neural network.In contrast to bitewing and periapical X-rays,panoramic X-rays show not only teeth and gums but also the jaw,the skull,the spine,and other bones.We provide a focused review of the application of deep learning methods in panoramic radiographic images from three detection categories of directions:tooth detection and numbering,tooth segmentation,and non-dental disease detection.The three-dimensional tooth point cloud/mesh image is a digital 3D oral model obtained by scanning and reconstructing the patient's mouth in real time using an intraoral scanner.The reviews on the three-dimensional tooth point cloud/mesh image focus on tooth segmentation based on deep learning.The deep learning methods for tooth segmentation can be divided into two cat-egories:fully supervised and non-full supervision methods.For fully supervised methods,we mainly introduce the hierar-chical and end-to-end network architecture models with a large amount of labeled data and annotation.For non-full supervi-sion methods,we primarily review self-and semi-supervised learning methods that only require partially annotated data and methods that utilize weakly annotated ideas.Currently,CBCT imaging,which is a non-invasive,low-radiation technique,is widely used in dental diagnosis and treatment.This paper summarizes the deep learning methods for CBCT images,focusing on three major areas:tooth segmentation,dental implants,and oral and maxillofacial surgery.Nevertheless,ana-lyzing all aspects of the patient's oral and systemic health status to develop a personalized and high-level treatment plan for oral diseases using the deep learning methods that have been proposed is still difficult.Deep learning has made some prog-ress in the field of dental image processing but still faces some serious challenges.The small sample size has been a serious problem in the field of medical image analysis but can be effectively addressed using non-fully supervised deep learning methods,such as weakly supervised learning and self-supervised learning,with machine learning methods,including migra-tion learning,sample less learning,and incremental learning.In addition,the annotation of dental medical images is a time-consuming and laborious task that relies heavily on the experience of the practitioner,which is one of the barriers limiting the extensive and intensive application of deep learning.Therefore,automatic data annotation must be extensively studied.The development of deep learning applications in dental imaging is still in a relatively early stage.The development of this field cannot be achieved without the cooperation of computer scientists,clinicians,and experts in imaging equipment and software development in solve the problem of deploying lightweight deep learning networks in convenient medical devices.Therefore,the combination of deep learning and dental image analysis has been a major trend,with significant results in various analysis tasks,but require further research to lead the development of dental image analysis to a new phase.

deep learningdental imagingtooth detection and segmentationcaries detectioncomputer-aided diagnosis(CAD)

赵阳、李俊诚、成博栋、牛娜君、王龙光、高广谓、施俊

展开 >

上海大学通信与信息工程学院,上海 200444

西安电子科技大学计算机科学与技术学院,西安 710000

南京医科大学口腔医学院,南京 210000

空军航空大学电子科学学院,吉林 130022

南京邮电大学先进技术研究院,南京 210003

展开 >

深度学习 口腔医学影像 牙齿检测与分割 龋齿检测 计算机辅助诊断(CAD)

上海市自然科学基金上海市扬帆计划

23ZR142220023YF1412800

2024

中国图象图形学报
中国科学院遥感应用研究所,中国图象图形学学会 ,北京应用物理与计算数学研究所

中国图象图形学报

CSTPCD北大核心
影响因子:1.111
ISSN:1006-8961
年,卷(期):2024.29(3)
  • 105