首页|基于阅读技巧识别和双通道融合机制的机器阅读理解方法

基于阅读技巧识别和双通道融合机制的机器阅读理解方法

扫码查看
机器阅读理解任务旨在要求系统对给定文章进行理解,然后对给定问题进行回答.先前的工作重点聚焦在问题和文章间的交互信息,忽略了对问题进行更加细粒度的分析(如问题所考察的阅读技巧是什么?).受先前研究的启发,人类对于问题的理解是一个多维度的过程.首先,人类需要理解问题的上下文信息;然后,针对不同类型问题,识别其需要使用的阅读技巧;最后,通过与文章交互回答出问题答案.针对这些问题,提出一种基于阅读技巧识别和双通道融合的机器阅读理解方法,对问题进行更加细致的分析,从而提高模型回答问题的准确性.阅读技巧识别器通过对比学习的方法,能够显式地捕获阅读技巧的语义信息.双通道融合机制将问题与文章的交互信息和阅读技巧的语义信息进行深层次的融合,从而达到辅助系统理解问题和文章的目的.为了验证该模型的效果,在FairytaleQA数据集上进行实验,实验结果表明,该方法实现了在机器阅读理解任务和阅读技巧识别任务上的最好效果.
A Machine Reading Comprehension Approach Based on Reading Skill Recognition and Dual Channel Fusion Mechanism
Machine reading comprehension task aims to require the system to understand a given passage and then answer a question.Previous researches focus on the interaction between questions and passages.However,they neg-lect to make a more granular analysis of the questions,e.g.,what is the reading skill examined by the questions?In-spired by the previous reading comprehension literature,the understanding of questions is a multi-dimensional pro-cess where humans first need to understand the context semantics of the question,then identify the reading skills they need to use for different types of questions,and finally answer the question.In the end,we propose a machine reading comprehension method based on reading skill recognition and dual channel fusion mechanism to make a comprehensive analysis of questions,so as to improve the accuracy of the model in answering questions.Specifically,the reading skill recognizer can capture the semantic representations of reading skills through contrastive learning.The dual channel fusion mechanism deeply integrates the contextual information and the semantic representations of reading skills,so as to help the system understand the question and passage.To verify the effectivenesss of the model,we conduct experiments on the FairytaleQA dataset.The experimental results show that the proposed meth-od achieves the state-of-the-art performance on machine reading comprehension task and reading skill recognition task.

Machine reading comprehensionreading skill recognitioncontrastive learningdual channel fusion machanism

彭伟、胡玥、李运鹏、谢玉强、牛晨旭

展开 >

中国科学院信息工程研究所 北京 100085

中关村实验室 北京 100080

中国科学院大学网络空间安全学院 北京 100085

机器阅读理解 阅读技巧识别 对比学习 双通道融合机制

国家自然科学基金国家自然科学基金中国科学院战略性先导研究计划

62006222U21B2009XDC02030400

2024

自动化学报
中国自动化学会 中国科学院自动化研究所

自动化学报

CSTPCD北大核心
影响因子:1.762
ISSN:0254-4156
年,卷(期):2024.50(5)
  • 43