计算机工程与设计2024,Vol.45Issue(12) :3758-3763.DOI:10.16208/j.issn1000-7024.2024.12.031

基于BERT语义增强的因果关系抽取模型

Causal relationship extraction model based on BERT semantic enhancement

孙争艳 张顺香 陈磊 朱广丽 魏苏波
计算机工程与设计2024,Vol.45Issue(12) :3758-3763.DOI:10.16208/j.issn1000-7024.2024.12.031

基于BERT语义增强的因果关系抽取模型

Causal relationship extraction model based on BERT semantic enhancement

孙争艳 1张顺香 2陈磊 1朱广丽 2魏苏波2
扫码查看

作者信息

  • 1. 淮南师范学院计算机学院,安徽淮南 232038
  • 2. 安徽理工大学计算机科学与工程学院,安徽 淮南 232001;合肥综合性国家科学中心人工智能研究院安徽省人工智能实验室,安徽 合肥 230000
  • 折叠

摘要

在金融领域,由于专业术语的复杂性,以及句子之间的依赖性,导致因果关系抽取的准确率较低.针对这一问题,提出一种基于BERT语义增强的因果抽取模型,建立基本模型和增强模型,以获取丰富的文本特征实现语义深度提取.使用BERT预训练模型得到上下文特征,通过对抗神经网络的对抗学习进一步学习高区分度特征,以此提高因果关系抽取的准确性.实验结果表明,该模型能够提高因果关系抽取的准确性.

Abstract

In the financial field,the complexity of professional terminology and the dependence between sentences lead to a lower accuracy of causality extraction.To address this issue,a causality extraction model based on BERT semantic enhancement was proposed,including a basic model and an enhanced model,to obtain rich text features and achieve semantic deep extraction.The BERT pre-training model was used to obtain contextual features,and the adversarial learning of the adversarial neural network was employed to further learn high-discriminative features,thus improving the accuracy of causality extraction.Experimental results demonstrate that the proposed model can improve the accuracy of causality extraction.

关键词

因果关系抽取/信息抽取/金融领域/对抗神经网络/对抗学习/基本模型/增强模型

Key words

causality extraction/information extraction/financial field/anti-neural network/confrontational learning/basic model/enhanced model

引用本文复制引用

出版年

2024
计算机工程与设计
中国航天科工集团二院706所

计算机工程与设计

CSTPCD北大核心
影响因子:0.617
ISSN:1000-7024
段落导航相关论文