首页|RIB-NER:基于跨度的中文命名实体识别模型

RIB-NER:基于跨度的中文命名实体识别模型

扫码查看
命名实体识别是自然语言处理领域中诸多下游任务的重要基础.汉语作为重要的国际语言,在许多方面具有独特性.传统上,中文命名实体识别任务模型使用序列标记机制,该机制需要条件随机场捕获标签的依赖性,然而,这种方法容易出现标签的错误分类.针对这个问题,提出基于跨度的命名实体识别模型RIB-NER.首先,以RoBERTa-wwm-ext作为模型嵌入层,提供字符级嵌入,以获得更多的上下文语义信息和词汇信息.其次,利用IDCNN的并行卷积核来增强词之间的位置信息,从而使词与词之间联系更加紧密.同时,在模型中融合BiLSTM网络来获取上下文信息.最后,采用双仿射模型对句子中的开始标记和结束标记评分,使用这些标记探索跨度.在 MSRA和 Weibo 2个语料库上的实验结果表明,RIB-NER能够较为准确地识别实体边界,并分别获得了95.11%和73.94%的F1值.与传统深度学习相比,有更好的识别效果.
RIB-NER:A span-based Chinese named entity recognition model
Named entity recognition serves as an important foundation for many downstream tasks in the field of natural language processing.As an important international language,Chinese is unique in many aspects.Traditionally,models of Chinese named entity recognition tasks use sequence labeling mechanisms that require conditional random fields to capture label dependencies.However,this ap-proach is prone to misclassification of labels.Aiming at this problem,a span-based named entity recog-nition model called RIB-NER is proposed.Firstly,the method provides character-level embedding through RoBERTa as a model embedding layer to obtain more contextual semantic and lexical informa-tion.Secondly,IDCNN is used to increase the position information between words with parallel convo-lution kernels,so that the connection between words is closer.At the same time,a BiLSTM network is integrated in the model to obtain context information.Finally,a Biaffine model is employed to score the start and end tokens in the sentence,and these tokens are used to explore spans.The proposed algo-rithm is tested on MSRA and Weibo corpora,the results show that it can accurately identify entity boundaries,achieving F1 scores of 95.11%and 73.94%respectively.Compared with traditional deep learning approaches,it demonstrates better recognition performance.

Chinese named entity recognitionbiaffine modeliterated dilated convolutional neural networkpre-training modelspan

田红鹏、吴璟玮

展开 >

西安科技大学计算机科学与技术学院,陕西 西安 710600

中文命名实体识别 双仿射模型 迭代膨胀卷积神经网络 预训练模型 跨度

2024

计算机工程与科学
国防科学技术大学计算机学院

计算机工程与科学

CSTPCD北大核心
影响因子:0.787
ISSN:1007-130X
年,卷(期):2024.46(7)
  • 1