中国科学:信息科学(英文版)2024,Vol.67Issue(4) :177-192.DOI:10.1007/s11432-022-3726-0

Memory-enhanced text style transfer with dynamic style learning and calibration

Fuqiang LIN Yiping SONG Zhiliang TIAN Wangqun CHEN Diwen DONG Bo LIU
中国科学:信息科学(英文版)2024,Vol.67Issue(4) :177-192.DOI:10.1007/s11432-022-3726-0

Memory-enhanced text style transfer with dynamic style learning and calibration

Fuqiang LIN 1Yiping SONG 1Zhiliang TIAN 2Wangqun CHEN 1Diwen DONG 1Bo LIU3
扫码查看

作者信息

  • 1. College of Computer Science and Technology,National University of Defense Technology,Changsha 410073,China
  • 2. Department of Computer Science and Engineering,The Hong Kong University of Science and Technology,Hong Kong 999077,China
  • 3. College of Computer Science and Technology,National University of Defense Technology,Changsha 410073,China;Strategic Assessments and Consultation Institute,Academy of Military Sciences,Beijing 100097,China
  • 折叠

Abstract

Text style transfer aims to rephrase a sentence to match the desired style while retaining the original content.As a controllable text generation task,mainstream approaches use content-independent style embedding as control variables to guide stylistic generation.Nonetheless,stylistic properties are context-sensitive even under the same style.For example,"delicious"and"helpful"convey positive sentiments,although they are more likely to describe food and people,respectively.Therefore,desired style signals must vary with the content.To this end,we propose a memory-enhanced transfer method,which learns fine-grained style representation concerning content to assist transfer.Rather than employing static style embedding or latent variables,our method abstracts linguistic characteristics from training corpora and memorizes subdivided content with the corresponding style representations.The style signal is dynamically retrieved from memory using the content as a query,providing a more expressive and flexible latent style space.To address the imbalance between quantity and quality in different content,we further introduce a calibration method to augment memory construction by modeling the relationship between candidate styles.Experimental results obtained using three benchmark datasets confirm the superior performance of our model compared to competitive approaches.The evaluation metrics and case study also indicate that our model can generate diverse stylistic phrases matching context.

Key words

style transfer/memory-enhanced method/text generation/deep learning/text representation

引用本文复制引用

基金项目

国家自然科学基金(62106275)

出版年

2024
中国科学:信息科学(英文版)
中国科学院

中国科学:信息科学(英文版)

CSTPCDEI
影响因子:0.715
ISSN:1674-733X
参考文献量44
段落导航相关论文