基于DAN与FastText的藏文短文本分类研究
Study on Tibetan Short Text Classification Based on DAN and FastText
李果 1陈晨 1杨进 2群诺3
作者信息
- 1. 西藏大学信息科学技术学院 拉萨 850000;藏文信息技术教育部工程研究中心 拉萨 850000
- 2. 西藏大学信息科学技术学院 拉萨 850000;四川大学网络空间安全学院 成都 610000
- 3. 西藏大学信息科学技术学院 拉萨 850000
- 折叠
摘要
随着藏文信息不断融入社会生活,越来越多的藏文短文本数据存在网络平台上.针对传统分类方法在藏文短文本上分类性能低的问题,文中提出了一种基于DAN-FastText的藏文短文本分类模型.该模型使用FastText网络在较大规模的藏文语料上进行无监督训练获得预训练的藏文音节向量集,使用预训练的音节向量集将藏文短文本信息转化为音节向量,把音节向量送入DAN(Deep Averaging Networks)网络并在输出阶段融合经过FastText网络训练的句向量特征,最后通过全连接层和softmax层完成分类.在公开的TNCC(Tibetan News Classification Corpus)新闻标题数据集上所提模型的 Macro-F1是64.53％,比目前最好评测结果TiBERT模型的Macro-F1得分高出2.81％,比GCN模型的Macro-F1得分高出6.14％,融合模型具有较好的藏文短文本分类效果.
Abstract
As Tibetan information continues to be integrated into social life,more and more Tibetan short text data is available on online platforms.Aiming at the low classification performance of traditional classification methods on Tibetan short texts,a Ti-betan short text classification model based on DAN-FastText is proposed.The model uses the FastText network to perform un-supervised training on a large-scale Tibetan corpus to obtain the pre-trained Tibetan syllabic vector set,uses the pre-trained sylla-ble vector set to convert the Tibetan short text information into syllable vector,sends the syllable vector into the deep averaging networks(DAN)network and fuses the sentence vector features trained by the FastText network in the output stage,and finally completes the classification through the fully connected layer and the softmax layer.On the publicly available tibetan news classi-fication corpus(TNCC)news headline dataset,Macro-F1 is 64.53％,which is 2.81％higher than that of the TiBERT model and 6.14％higher than that GCN model,and the fusion model has a better Tibetan short text classification effect.
关键词
藏文短文本分类/特征融合/深度平均网络/快速文本Key words
Tibetan short text classification/Feature fusion/Deep averaging networks/Fast text引用本文复制引用
基金项目
国家自然科学基金(61872254)
国家自然科学基金(62162057)
出版年
2024
NETL
NSTL
万方数据