首页|基于混合神经网络的个性化自然语言情感识别系统

基于混合神经网络的个性化自然语言情感识别系统

扫码查看
为在面临输入自然语言信息中存在微小变化或噪声干扰时,提升系统的鲁棒性与泛化能力,设计基于混合神经网络的个性化自然语言情感识别系统.以现场可编程门阵列为核心,设计自然语言采集模块,用于采集个性化自然语言信息;通过预处理模块,处理采集的个性化自然语言信息中的语音信息,得到对数梅尔谱图;情感识别模块利用动态卷积神经网络和长短时记忆网络,组建混合神经网络,其中,通过动态卷积神经网络,在对数梅尔谱图内提取语音信息特征,采用长短时记忆神经网络,在自然语言文本信息内提取文本信息特征,通过全连接神经网络,融合语音与文本信息特征,输出个性化情感识别结果.实验证明,该系统可有效采集个性化自然语言信息,并提取语音信息特征,完成个性化自然语言情感识别;在噪声干扰下,该系统的情感识别精度较高.
Personalized Natural Language Emotion Recognition System Based on Hybrid Neural Network
In order to improve the robustness and generalization ability of the system when there are slight changes or noise interference in the input natural language information,a personalized natural language emotion recognition sys-tem based on hybrid neural network is designed.Taking field programmable gate array as the core,a natural language acquisition module is designed to collect personalized natural language information.Processing the voice information in the collected personalized natural language information through a preprocessing module to obtain a logarithmic Mel spectrogram.Emotion recognition module uses dynamic convolution neural network and long-term and short-term memory network to build a hybrid neural network,in which,through dynamic convolution neural network,voice infor-mation features are extracted from logarithmic Mel spectrogram,and through long-term and short-term memory net-work,text information features are extracted from natural language text information,and through fully connected neural network,voice and text information features are fused to output personalized emotion recognition results.Experiments show that the system can effectively collect personalized natural language information,extract phonetic information fea-tures and complete personalized natural language emotion recognition.Under the interference of noise,the emotion recognition accuracy of the system is high.

hybrid neural networkpersonalizationnatural languageemotion recognitiondynamic convolutionlong-term and short-term memory network

韦灵、卢光云、唐爱龙

展开 >

柳州工学院 信息科学与工程学院,柳州 545616

混合神经网络 个性化 自然语言 情感识别 动态卷积 长短时记忆网络

2021年度柳州工学院科学基金项目2021年中国高校产学研创新基金——新一代信息技术创新项目

2021KXJJO82021ITA02008

2024

自动化与仪表
天津市工业自动化仪表研究所 天津市自动化学会

自动化与仪表

CSTPCD
影响因子:0.548
ISSN:1001-9944
年,卷(期):2024.39(9)