首页|融合知识增强的ERNIE与神经网络的中文医疗关系提取

融合知识增强的ERNIE与神经网络的中文医疗关系提取

扫码查看
基于深度学习的方法在关系提取中通常只侧重于细粒度文本单元的表示,导致学习文本特征不足。提出了一种融合知识增强的ERNIE模型与神经网络相结合的方式去进行关系提取。该方法分为两个部分:首先通过知识增强来对文本向量化,具体是将细粒度文本单元与粗粒度文本单元进行加权平均的操作使其达到知识增强的效果,再将该单元进行预测后的结果进行RTD判断有无替代词产生。最后将文本特征向量输入到BiLSTM网络中,使其得到词的上下文语义信息,并进行句子序列打分,选择分数最高的即可。实验结果表明,该方法在进行关系提取时,得到准确率为95%,精确率为91%,召回率为92%,f1-score为92%,与已有的方法进行对比,均提升了 5%以上,因此提出的方法效果明显。
Fusion of knowledge-enhanced ERNIE and bidirectional RNN for Chinese medical relationship extraction
Deep learning-based methods in relation extraction usually focus only on the representation of fine-grained text units,resulting in insufficient learned text features.A combination of ERNIE model fused with knowledge enhancement and neural net-work was proposed to perform relationship extraction.The method was divided into two parts:firstly,the text was vectorized through knowledge enhancement,specifically,the fine-grained text unit and the coarse-grained text unit they were operated by weighted average to achieve the effect of knowledge enhancement,and then the unit was predicted to be the result of RTD to de-termine whether there was any alternative word generated.Finally,the text feature vectors were fed into the BiLSTM network to get the contextual semantic information of the words,and the sentence sequence was scored and the one with the highest score was selected.The experimental results showed that the method obtained an accuracy rate of 95%,a precision rate of 91%,a re-call rate of 92%,and an f1-score of 92%for relationship extraction,which were all improved by more than5%when compared with the existing methods,so the method proposed in this paper was effective.

knowledge-enhancerelationship extractionneural networknatural language processing

李卫榜、佘文浩、杨茂

展开 >

西南民族大学计算机系统国家民委重点实验室,四川 成都 610041

知识增强 关系提取 神经网络 自然语言处理

西南民族大学中央高校基本科研业务费专项资金国家级项目培育项目四川省社会科学研究规划项目

ZYN2023008SC20B127

2024

西南民族大学学报(自然科学版)
西南民族大学

西南民族大学学报(自然科学版)

CSTPCD
影响因子:0.441
ISSN:2095-4271
年,卷(期):2024.50(1)
  • 18