首页|基于Unity3D的数字虚拟人交互技术研究与应用

基于Unity3D的数字虚拟人交互技术研究与应用

Research and Implementation of Digital Virtual Human Interaction Technology Based on Unity3D

扫码查看
目前,数字虚拟人交互技术虽然能够实现与用户的基本交互,但仍然存在着语言理解偏误、缺乏情感表达能力等一系列问题,导致用户的交互体验感不足.在此背景下,本研究首先分析了数字虚拟人技术的发展现状和存在的问题,进而探究了基于Unity3D的数字虚拟人交互技术,并提出了一种由文本直接生成带有情感特征语音的方法.基于此,将其与ChatGPT语言理解与文本生成、文本情感分析和改进后的VITS语音合成技术结合,并使用Kinect 2.0设备模拟全息交互效果,最终构建了一款能够进行准确理解并模拟情感回应的数字虚拟人交互应用.结果表明,该技术可有效提高数字虚拟人的理解与表达能力,为用户提供更好的交互体验,对于数字虚拟人技术的应用和发展具有参考价值.
Currently,digital virtual human interaction technology faces issues like language understanding errors and limited emotional expression,resulting in a negative user experience.In this study,the current status and challenges of the technology were analyzed,a Unity3D-based interaction technology was introduced,and a technique for generating emotional speech directly from text was proposed.The approach combined with ChatGPT text comprehension and generation,text emotion analysis,and improved VITS speech synthesis.A digital virtual human interaction application capable of accurately understanding and modelling emotional responses was developed by simulating holographic interaction effects using a Kinect 2.0 device.The experimental results demonstrated that the technology improves both the interaction and emotional expression abilities of digital virtual human,providing the significant value for application and development.

Digital mediaArtificial intelligenceMedia interactionSpeech synthesis

李光亚、司占军

展开 >

天津科技大学 人工智能学院,天津 300457

数字媒体 人工智能 媒体交互 语音合成

2024

数字印刷
中国印刷科学技术研究所

数字印刷

北大核心
ISSN:2095-9540
年,卷(期):2024.(2)
  • 12