基于多层级信息融合网络的微表情识别方法
A Micro-expression Recognition Method Based on Multi-level Information Fusion Network
陈妍 1吴乐晨 2王聪3
作者信息
- 1. 湖南工商大学计算机学院 长沙 410205;湘江实验室 长沙 410205
- 2. 湖南工商大学计算机学院 长沙 410205
- 3. 天津科技大学人工智能学院 天津 300457
- 折叠
摘要
微表情是人类情感表达过程中细微且不自主的表情变化,实现准确和高效的微表情识别,对于心理疾病的早期诊断和治疗有重要意义.现有的微表情识别方法大多未考虑面部产生微表情时各个关键部位间的联系,难以在小样本图像空间上捕捉到微表情的细微变化,导致识别率不高.为此,提出一种基于多层级信息融合网络的微表情识别方法.该方法包括一个基于频率幅值的视频帧选取策略,能从微表情视频中筛选出包含高强度表情信息的图像帧、一个基于自注意力机制和图卷积网络的多层级信息提取网络以及一个引入图像全局信息的融合网络,能从不同层次捕获人脸微表情的细微变化,来提高对特定类别的辨识度.在公开数据集上的实验结果表明,该方法能有效提高微表情识别的准确率,与其他先进方法相比,具有更好的性能.
Abstract
Micro-expressions are subtle and involuntary changes during emotional expression.Accurate and effi-cient recognition of these is crucial for the early diagnosis and treatment of mental illnesses.Most of the existing methods often neglect the connections between key facial areas in micro-expressions,making it difficult to capture the subtle changes in small sample image spaces,resulting in low recognition rates.To address this,a micro-expres-sion recognition method is proposed based on a multi-level information fusion network.This method includes a video frame selection strategy based on frequency amplitude,which can select frames with high-intensity expres-sions from micro-expression videos.Additionally,this method includes a multi-level information extraction network using self-attention mechanisms and graph convolutional networks,and a fusion network that incorporates global image information,which can capture the subtle changes of facial micro-expressions from different levels to improve the recognition of specific categories.Experiments on public datasets show that our method effectively improves the accuracy and outperforms other advanced methods.
关键词
微表情识别/深度学习/图卷积网络/多层级融合Key words
Micro-expression recognition/deep learning/graph convolutional network/multi-level fusion引用本文复制引用
基金项目
国家自然科学基金(62273140)
国家自然科学基金(72342018)
出版年
2024
国家科技期刊平台
NSTL
万方数据