针对航空不安全事件领域命名实体识别任务,以航空安全信息周报为数据源,分析并构建航空不安全事件命名实体识别数据集和领域词典.为解决传统命名实体识别模型对于捕获领域实体边界性能较差的问题,基于BERT(bidirectional encoder representations from transformers)预训练语言模型提出融合领域词典嵌入的领域语义信息增强的方法.在自建数据集上进行多次对比实验,结果表明:所提出的方法可以进一步提升实体边界的识别率,相较于传统的双向长短期记忆网络-条件随机场(bi-directional long short term memory-conditional random field,BiLSTM-CRF)命名实体识别模型,性能提升约 5％.
Named Entity Recognition of Aviation Unsafe Events Embedded with Fusion Domain Dictionary
Aiming at the task of named entity recognition in the field of aviation unsafe events,the aviation safety information weekly report was used as the data source to analyze and construct the named entity recognition dataset and domain dictionary of aviation unsafe events.In order to solve the problem of poor performance of the traditional named entity recognition models in capturing domain entity boundaries,based on the bidirectional encoder representations from transformers(BERT)pre-trained language model,a method for enhancing domain semantic information by integrating domain dictionary embedding was proposed.Several comparative experiments were carried out on self-built datasets.The results show that the proposed method can further improve the recognition rate of entity boundaries.Compared with the traditional bi-directional long short term memory-conditional random field(BiLSTM-CRF)named entity recognition model,the performance is improved by about 5％.
aviation unsafe eventsdomain dictionarynamed entity recognitionpre-trained language model
万方数据
维普
