RGB oralscan video-based orthodontic treatment monitoring

Yan TIAN ¹Hanshi FU ¹Hao WANG ¹Yuqi LIU ²Zhaocheng XU ³Hong CHEN ⁴Jianyuan LI ⁵Ruili WANG⁶

扫码查看

作者信息

1. School of Computer Science and Technology,Zhejiang Gongshang University,Hangzhou 310018,China;Shining3D Tech Co.,Ltd.,Hangzhou 311258,China
2. School of Information and Technology,Monash University,Melbourne 3800,Australia
3. School of Mathematical and Computational Sciences,Massey University,Auckland 0632,New Zealand
4. Department of Stomatology,Zhejiang Provincial People's Hospital,Hangzhou Medical College,Hangzhou 310014,China
5. School of Computer and Computing Science,Zhejiang University City College,Hangzhou 310015,China
6. School of Computer Science and Technology,Zhejiang Gongshang University,Hangzhou 310018,China
折叠

Abstract

Orthodontic treatment monitoring involves using current images and previous 3D models to estimate the relative position of individual teeth before and after orthodontic treatment.This process differs from image-based object 6D pose estimation due to the gingiva deformation and varying pose offsets for each tooth during treatment.Motivated by the fact that the poses of molars remain relatively fixed in implicit orthodontics,we design an approach that employs multiview pose evaluation and bidirectional temporal propagation for jaw pose estimation and then employs an iteration-based method for tooth alignment.To handle changes in tooth appearance or location with weak texture across frames,we also introduce an instance propagation module that leverages positional and semantic information to explore instance relations in the temporal domain.We evaluated the performance of our approach using both the Shining3D tooth pose dataset and the Aoralscan3 tooth registration dataset.Our experimental results demonstrate remarkable accuracy improvements compared with existing methods.

Key words

digital dentistry/object 6D pose estimation/deep learning/computer vision

引用本文复制引用

基金项目

National Natural Science Foundation of China(61972351)

National Natural Science Foundation of China(62111530300)

Zhejiang Province R&D Key Project(other categories)(2022C03149)

Special Project for Basic Business Expenses of Zhejiang Provincial Colleges and Universities(JRK22003)

Opening Foundation of State Key Laboratory of Virtual Reality Technology and System of Beihang University(VRLAB2023B02)

出版年

2024

中国科学:信息科学(英文版)

中国科学院

中国科学:信息科学(英文版)

CSTPCDEI

影响因子：0.715

ISSN：1674-733X

参考文献量62

段落导航