KHGAS:Keywords Guided Heterogeneous Graph for Abstractive Summarization
Abstractive summarization is a crucial task in natural language processing that aims to generate concise and informa-tive summaries from a given text.Deep learning-based sequence-to-sequence models have become the mainstream approach for generating abstractive summaries,achieving remarkable performance gains.However,existing models still suffer from issues such as semantic ambiguity and low information content due to the lack of attention to the dependency relationships between key con-cepts and sentences in the input text.To address this challenge,the keywords guided heterogeneous graph model for abstractive summarization is proposed.This model leverages extracted keywords and constructs a heterogeneous graph with both keywords and sentences as input to model the dependency relationships between them.A document encoder and a graph encoder are respec-tively used to capture textual information and dependency relationships in the heterogeneous graph.Moreover,a hierarchical graph attention mechanism is introduced in the decoder to improve the model's attention to significant information when genera-ting summaries..Extensive experiments on the CNN/Daily Mail and XSum datasets demonstrate that the proposed model outper-forms existing methods in terms of the ROUGE evaluation metric.Human evaluations also reveal that the generated summaries by the proposed model contain more key information and are more readable compared to the baseline models.
Abstractive summarizationKeywordsHeterogeneous graphGraph attentionSequence to sequence model
NETL
NSTL
万方数据
