基于Self-Attention与Bi-LSTM的大学生情感倾向研究
Research on Emotional Tendencies of College Students Based on Self-Attention and Bi-LSTM
张颖1
作者信息
- 1. 华东交通大学 网络信息中心,江西 南昌 330013
- 折叠
摘要
针对基于词向量的网络模型性能过分依赖分词准确性的问题,提出基于FastText字向量表示方法结合Self-Attention与BiLSTM的大学生情感分析方法(character-SATT-BiLSTM).使用fasttext模型生成文本字向量,通过双向长短时记忆模型提取上下文语义特征,利用自注意力机制强化关键信息,最后使用Softmax分类器判断情感类别.实验结果显示,字向量文本表示方法比词向量更适合论坛文本情感分类,同时character-SATT-BiLSTM相比character-LSTM、character-BiLSTM等模型的效果更优,分类性能分别提高了6%和3%.
Abstract
The performance of the network model based on the word vector relies heavily on the accuracy of word segmentation,a method of sentiment analysis for college students based on FastText character vector combined with Self-Attention and BiLSTM is proposed.Firstly,character vectors are generated using the fasttext model,then contextual semantic features are extracted by the bidirectional long and short-term memory model and key information is strengthened using the Self-Attention mechanism,finally,the sentiment categories are judged us-ing the Softmax classifier.The experimental results show that character vector is more suitable for short text than word vector,and character-SATT-BiLSTM has achieved better classification results than character-LSTM,character-BiLSTM and other models.The classification perfor-mance can be increased by 6%and 3%,respectively.
关键词
FastText/字向量/双向长短时记忆/自注意力/情感倾向分析Key words
FastText/character vector/bidirectional long short-term memory/self-attention/emotional tendency analysis引用本文复制引用
出版年
2024
国家科技期刊平台
NSTL
万方数据