首页|基于CTC与Transformer的普通话单音节发音错误检测

基于CTC与Transformer的普通话单音节发音错误检测

扫码查看
提出CTC与Transformer结合的端到端模型,使用多编码器和字层级一致的方法,降低在复杂录制环境下的识别错误率.该端到端模型在自建数据集PSC_Monosyllable的测试集上的词错误率为5.6%.通过预训练,可以实现发音错误检测的正误分类,且比传统机器学习模型检测结果性能提升了16%,有效地提升了发音错误检出率,得出了较好的结果,检测率为0.589.
Mis-pronunciation detection and diagnosis of mandarin monosyllabic based on CTC and Transformer
At present,in the PSC test,manual scoring is still the main method of scoring the test questions.The development of oral evaluation technology has greatly reduced the manual scoring labor.As the core of spoken language evaluation technology,the end-to-end model combining CTC and Transformer proposed in this paper uses multi-encoder and word-level consistent methods to reduce the recognition error rate in complex recording environments.The word error rate on the test set is 5.6%.Through pre-training,the end-to-end model can achieve correct and incorrect classification of mis-pronunciation detection and diagnosis,and its performance is improved by 16% compared with the detection results of the better traditional machine learning model.Effectively improve the mis-pronunciation detection and diagnosis rate,and get a better result of 0.589.

speech recognitionmis-pronunciation detection and diagnosiscorpus constructiondeep learningTransformer

杨兴耀、卢进堂、肖瑞、张利飞、曾利文

展开 >

新疆大学软件学院,新疆 乌鲁木齐 830008

新疆大学信息科学与工程学院,新疆 乌鲁木齐 830049

语音识别 发音错误检测 语料库建设 深度学习 Transformer

新疆维吾尔自治区自然科学基金资助项目新疆大学博士科研启动基金资助项目新疆维吾尔自治区教育厅项目

2023D01C17BS150257XJEDU2016S035

2024

东北师大学报(自然科学版)
东北师范大学

东北师大学报(自然科学版)

CSTPCD北大核心
影响因子:0.612
ISSN:1000-1832
年,卷(期):2024.56(1)
  • 28