目的 构建基于HoloLens的小耳畸形治疗虚实交互辅助系统HE-01,并验证其辅助耳廓再造术的可行性。 方法 以2021年8至9月于中国医学科学院整形外科医院招募的6名健康志愿者(男3名,女3名,平均年龄20.5岁)和6例小耳畸形患者(男3例,女3例,平均年龄7.6岁)为研究对象。运用Mimics Research 21.0和3-matic research软件构建虚拟耳廓三维模型,基于HoloLens和咬合夹板导航标记装置构建HE-01。通过志愿者重复试验评价HE-01的注册精准度、跟踪延迟度及不同颜色(红色、绿色、蓝色和皮肤色)虚拟耳廓导板的显示效果,通过小耳畸形患者重复试验明确操作流程并验证HE-01应用于耳廓再造术的可行性。 结果 成功构建HE-01并明确操作流程。志愿者重复试验显示,HE-01在不同角度下注册精准度均较高,6名志愿者12侧耳廓不同方向(耳廓前-60°、-30°、0°、30°、60°方向)的重合误差率均在2.3%~2.4%[小于正常人双侧耳廓大小的差距(2.7%)];跟踪延迟度低(6名志愿者均小于0.1 s);绿色和红色的虚拟耳廓导板显示效果较佳。小耳畸形患者重复试验显示,HE-01可应用于耳廓再造术,导航标记装置佩戴无明显并发症,具有可重复性和稳固性。 结论 本研究完成了基于导航套装、CT数据与HoloLens的增强现实辅助耳廓再造的概念设计,HE-01具有良好的注册精准度、跟踪速度和显示效果,为进一步的软件开发及临床转化做了良好铺垫。 Objective To construct a virtual-real interactive system HE-01 for the treatment of microtia based on HoloLens and verify the feasibility of applying HE-01 in ear reconstruction. Methods Six volunteers (3 males and 3 females, average age: 20.5 years old) and six patients with microtia(3 males and 3 females, average age: 7.6 years old) were recruited from Plastic Surgery Hospital of Chinese Academy of Medical Sciences from August to September 2021. The Mimics Research 21.0 software and 3-matic research software were used to construct a virtual three-dimensional auricle model. Based on HoloLens and occlusal splint navigation marker device, the virtual-real interactive system HE-01 for the treatment of microtia was constructed. The registration accuracy, tracking delay and display effect of different colors (red, green, blue and skin color) of HE-01 were evaluated through repeated experiments of volunteers. The operation process was defined through repeated experiments of patients and the feasibility of applying HE-01 in auricular reconstruction was verified. Results HE-01 was built successfully and the operation flow was clear. The experiment of six volunteers (12 ears) showed a high registration accuracy (average error rate 2.3%-2.4%, less than 2.7% of the bilateral auricle size difference of normal people), low tracking delay (six volunteers were all less than 0.1 s), and best green and red display effect of virtual auricle guide under different angles (-60°, -30°, 0°, 30°, 60°). Experiments of patients with microtia showed that HE-01 could be applied to auricular reconstruction, and there were no obvious complications in wearing the navigation marker device, which had repeatability and stability. Conclusion This study has completed the conceptual design of augmented-reality assisted auricular reconstruction based on navigation device, CT data and HoloLens. HE-01 has good registration accuracy, tracking speed and display effect, laying a good foundation for further software development and clinical transformation.
Construction of virtual-real interactive system HE-01 for the treatment of microtia and feasibility study of the application of HE-01 in ear reconstruction
Objective To construct a virtual-real interactive system HE-01 for the treatment of microtia based on HoloLens and verify the feasibility of applying HE-01 in ear reconstruction. Methods Six volunteers (3 males and 3 females, average age: 20.5 years old) and six patients with microtia(3 males and 3 females, average age: 7.6 years old) were recruited from Plastic Surgery Hospital of Chinese Academy of Medical Sciences from August to September 2021. The Mimics Research 21.0 software and 3-matic research software were used to construct a virtual three-dimensional auricle model. Based on HoloLens and occlusal splint navigation marker device, the virtual-real interactive system HE-01 for the treatment of microtia was constructed. The registration accuracy, tracking delay and display effect of different colors (red, green, blue and skin color) of HE-01 were evaluated through repeated experiments of volunteers. The operation process was defined through repeated experiments of patients and the feasibility of applying HE-01 in auricular reconstruction was verified. Results HE-01 was built successfully and the operation flow was clear. The experiment of six volunteers (12 ears) showed a high registration accuracy (average error rate 2.3%-2.4%, less than 2.7% of the bilateral auricle size difference of normal people), low tracking delay (six volunteers were all less than 0.1 s), and best green and red display effect of virtual auricle guide under different angles (-60°, -30°, 0°, 30°, 60°). Experiments of patients with microtia showed that HE-01 could be applied to auricular reconstruction, and there were no obvious complications in wearing the navigation marker device, which had repeatability and stability. Conclusion This study has completed the conceptual design of augmented-reality assisted auricular reconstruction based on navigation device, CT data and HoloLens. HE-01 has good registration accuracy, tracking speed and display effect, laying a good foundation for further software development and clinical transformation.