中国科学:信息科学(英文版)2024,Vol.67Issue(8) :126-142.DOI:10.1007/s11432-023-3908-6

EmotionIC:emotional inertia and contagion-driven dependency modeling for emotion recognition in conversation

Yingjian LIU Jiang LI Xiaoping WANG Zhigang ZENG
中国科学:信息科学(英文版)2024,Vol.67Issue(8) :126-142.DOI:10.1007/s11432-023-3908-6

EmotionIC:emotional inertia and contagion-driven dependency modeling for emotion recognition in conversation

Yingjian LIU 1Jiang LI 2Xiaoping WANG 1Zhigang ZENG1
扫码查看

作者信息

  • 1. School of Artificial Intelligence and Automation,Huazhong University of Science and Technology,Wuhan 430074,China;Hubei Key Laboratory of Brain-inspired Intelligent Systems,Huazhong University of Science and Technology,Wuhan 430074,China;Key Laboratory of Image Processing and Intelligent Control(Huazhong University of Science and Technology),Ministry of Education,Wuhan 430074,China
  • 2. School of Artificial Intelligence and Automation,Huazhong University of Science and Technology,Wuhan 430074,China;Institute of Artificial Intelligence,Huazhong University of Science and Technology,Wuhan 430074,China;Hubei Key Laboratory of Brain-inspired Intelligent Systems,Huazhong University of Science and Technology,Wuhan 430074,China;Key Laboratory of Image Processing and Intelligent Control(Huazhong University of Science and Technology),Ministry of Education,Wuhan 430074,China
  • 折叠

Abstract

Emotion recognition in conversation(ERC)has attracted growing attention in recent years as a result of the advancement and implementation of human-computer interface technologies.In this paper,we propose an emotional inertia and contagion-driven dependency modeling approach(EmotionIC)for ERC tasks.Our EmotionIC consists of three main components,i.e.,identity masked multi-head attention(IM-MHA),dialogue-based gated recurrent unit(DiaGRU),and skip-chain conditional random field(SkipCRF).Compared to previous ERC models,EmotionIC can model a conversation more thoroughly at both the feature-extraction and classification levels.The proposed model attempts to integrate the advantages of attention-and recurrence-based methods at the feature-extraction level.Specifically,IMMHA is applied to capture identity-based global contextual dependencies,while DiaGRU is utilized to extract speaker-and temporal-aware local contextual information.At the classification level,SkipCRF can explicitly mine com-plex emotional flows from higher-order neighboring utterances in the conversation.Experimental results show that our method can significantly outperform the state-of-the-art models on four benchmark datasets.The ablation studies confirm that our modules can effectively model emotional inertia and contagion.

Key words

emotion recognition in conversation/emotional inertia and contagion/multi-head attention/gated recurrent unit/conditional random field

引用本文复制引用

基金项目

National Natural Science Foundation of China(62236005)

National Natural Science Foundation of China(61936004)

National Natural Science Foundation of China(U1913602)

出版年

2024
中国科学:信息科学(英文版)
中国科学院

中国科学:信息科学(英文版)

CSTPCDEI
影响因子:0.715
ISSN:1674-733X
参考文献量1
段落导航相关论文