In order to further improve the teaching environment of higher education and the quality of talent training for deaf-mute students,special translation of speech to sign language has been studied.A new speech-to-sign language translation method is proposed,which directly establishes the end-to-end recognition mode of speech-to-sign language coding,and then matches the sign language coding sequence to output simulated sign language animation composed of basic actions.This method eliminates all inter-mediate steps in the traditional speech-to-sign language translation process and avoids the accumulation of errors during the process,and improves translation efficiency and accuracy.Experiments show that this speech-to-sign language translation method can achieve better translation results.Also,it has achieved the expected effect in practical application of teaching,and has a certain prospect.
end-to-endsign language translationvirtual realitydeep learning
NETL
NSTL
万方数据
