广西科学2024,Vol.31Issue(1) :110-118.DOI:10.13656/j.cnki.gxkx.20240417.011

基于MacBERT和联合注意力增强网络的物业服务投诉分类方法

Classification Method of Property Service Complaints Based on MacBERT and Joint Attention Enhancement Networks

湛志宏 覃开贤 彭凌华 湛铖
广西科学2024,Vol.31Issue(1) :110-118.DOI:10.13656/j.cnki.gxkx.20240417.011

基于MacBERT和联合注意力增强网络的物业服务投诉分类方法

Classification Method of Property Service Complaints Based on MacBERT and Joint Attention Enhancement Networks

湛志宏 1覃开贤 2彭凌华 1湛铖3
扫码查看

作者信息

  • 1. 广西壮族自治区住房和城乡建设信息中心,广西南宁 530028
  • 2. 南宁师范大学计算机与信息工程学院,广西南宁 530001
  • 3. 西交利物浦大学,江苏苏州 215028
  • 折叠

摘要

基于人工的物业投诉文件分类处理方法已经无法满足社会需求,并且已有投诉相关的自动分类方法在物业投诉分类问题上的性能较不足.因此,本研究提出一个基于MacBERT和联合注意力增强网络的物业服务投诉分类方法JAE-BERT4Com.JAE-BERT4Com使用基于近义词替换与合成少数过采样技术结合的样本增强策略解决类不平衡的问题,以及基于MacBERT的分层注意力、Transformers的多头注意力和关键词注意力等多重注意力联合增强的网络进行文本特征学习和分类.实验结果表明,JAE-BERT4Com能够获得比现有模型更高的准确率、F1分数和召回率,比现有较先进模型的性能更优.

Abstract

The manual-based classification method of property complaint documents has been unable to meet the needs of the society,and the existing automatic classification methods related to complaints have insuffi-cient performance in the classification of property complaints.Therefore,this study proposes a property serv-ice complaint classification method JAE-BERT4Com based on MacBERT and joint attention enhancement network.JAE-BERT4Com uses a sample enhancement strategy based on the combination of synonym re-placement and synthetic minority oversampling technology to solve the problem of class imbalance.And a multi-attention joint enhancement network based on MacBERT's hierarchical attention,Transformers'multi-head attention and keyword attention is designed to perform text feature learning and classification.The ex-perimental results show that JAE-BERT4Com can obtain higher accuracy,F1 score and recall rate than the existing models,and has better performance than the existing advanced models.

关键词

物业投诉/投诉分类/文本分类/注意力增强/深度学习

Key words

property complaints/complaint classification/text categorization/attention enhancement/deep learning

引用本文复制引用

基金项目

国家自然科学基金(62366011)

出版年

2024
广西科学
广西科学院 广西壮族自治区科学技术协会

广西科学

CSTPCD北大核心
影响因子:0.516
ISSN:1005-9164
参考文献量24
段落导航相关论文