东北师大学报(自然科学版)2024,Vol.56Issue(1) :87-95.DOI:10.16163/j.cnki.dslkxb202207080001

基于CTC与Transformer的普通话单音节发音错误检测

Mis-pronunciation detection and diagnosis of mandarin monosyllabic based on CTC and Transformer

杨兴耀 卢进堂 肖瑞 张利飞 曾利文
东北师大学报(自然科学版)2024,Vol.56Issue(1) :87-95.DOI:10.16163/j.cnki.dslkxb202207080001

基于CTC与Transformer的普通话单音节发音错误检测

Mis-pronunciation detection and diagnosis of mandarin monosyllabic based on CTC and Transformer

杨兴耀 1卢进堂 1肖瑞 1张利飞 2曾利文2
扫码查看

作者信息

  • 1. 新疆大学软件学院,新疆 乌鲁木齐 830008
  • 2. 新疆大学信息科学与工程学院,新疆 乌鲁木齐 830049
  • 折叠

摘要

提出CTC与Transformer结合的端到端模型,使用多编码器和字层级一致的方法,降低在复杂录制环境下的识别错误率.该端到端模型在自建数据集PSC_Monosyllable的测试集上的词错误率为5.6%.通过预训练,可以实现发音错误检测的正误分类,且比传统机器学习模型检测结果性能提升了16%,有效地提升了发音错误检出率,得出了较好的结果,检测率为0.589.

Abstract

At present,in the PSC test,manual scoring is still the main method of scoring the test questions.The development of oral evaluation technology has greatly reduced the manual scoring labor.As the core of spoken language evaluation technology,the end-to-end model combining CTC and Transformer proposed in this paper uses multi-encoder and word-level consistent methods to reduce the recognition error rate in complex recording environments.The word error rate on the test set is 5.6%.Through pre-training,the end-to-end model can achieve correct and incorrect classification of mis-pronunciation detection and diagnosis,and its performance is improved by 16% compared with the detection results of the better traditional machine learning model.Effectively improve the mis-pronunciation detection and diagnosis rate,and get a better result of 0.589.

关键词

语音识别/发音错误检测/语料库建设/深度学习/Transformer

Key words

speech recognition/mis-pronunciation detection and diagnosis/corpus construction/deep learning/Transformer

引用本文复制引用

基金项目

新疆维吾尔自治区自然科学基金资助项目(2023D01C17)

新疆大学博士科研启动基金资助项目(BS150257)

新疆维吾尔自治区教育厅项目(XJEDU2016S035)

出版年

2024
东北师大学报(自然科学版)
东北师范大学

东北师大学报(自然科学版)

CSTPCD北大核心
影响因子:0.612
ISSN:1000-1832
参考文献量28
段落导航相关论文