首页|基于多层次信息融合的多跳机器阅读理解

基于多层次信息融合的多跳机器阅读理解

扫码查看
以往机器阅读理解模型中存在文本特征提取单一,文本和问题的交互信息不全面等问题,导致模型不能充分对文本进行理解,本文提出了一种多层次信息融合的机器阅读理解模型.通过在不同位置使用不同方法,对文本信息进行多种层次的获取.使用膨胀卷积网络捕捉文本的全局信息,采用双向注意力机制和自注意力机制融合文本和问题之间的交互信息,通过指针网络预测答案及其对应的支撑句.该模型在CAIL2019 和CAIL2020 阅读理解数据集上训练的联合F1 值分别达到 50.09%和 58.44%,相比于其他基线模型取得了明显的性能提升.
Multi-hop Machine Reading Comprehension Based on Multi-level Information Fusion
In previous machine reading comprehension models,there were some problems,such as single-text feature extraction and incomplete interactive information between text and questions,which led to insufficient text understanding.This study proposes a machine reading understanding model with multi-level information fusion,which can obtain text information at multiple levels by using different methods in different locations.The model uses the dilated convolutional network to capture the global information of the text.Bi-directional attention mechanism and self-attention mechanism are used to fuse the interactive information between text and questions.Finally,the answer and its corresponding supporting sentence are predicted through the pointer network.The joint F1 values of the model trained on the CAIL2019 and CAIL2020 reading comprehension datasets reach 50.09%and 58.44%respectively,which achieves significant performance improvement compared with other baseline models.

multi-hop machine reading comprehensionattention mechanisminformation fusion

朱海飞、段宗涛、王全伟、曹建荣、席铁钧

展开 >

长安大学信息工程学院,西安 710064

豫西工业集团河南北方红阳机电有限公司,南阳 474679

多跳机器阅读理解 注意力机制 信息融合

陕西省重点研发计划陕西省特支计划科技创新领军人才项目

2019ZDLGY17-08TZ0366

2024

计算机系统应用
中国科学院软件研究所

计算机系统应用

CSTPCD
影响因子:0.449
ISSN:1003-3254
年,卷(期):2024.33(7)