首页|基于Gabor卷积和Transformer的课堂表情识别研究

基于Gabor卷积和Transformer的课堂表情识别研究

扫码查看
为了针对复杂环境变化无法精准识别学生表情问题,本文设计了一个基于Gabor卷积和Transformer的表情识别模型Gabor-Vision-Transformer(GVT).将Gabor卷积和Transformer的思想相结合,设计了一个特征提取块GVT-Block.首先通过Gabor卷积提取富含丰富纹理和边缘信息的面部局部特征,再通过Transformer提取全局数据之间的长距离信息,从而更好地学习面部关键特征,显著提高模型的分类效果.GVT模型在RAF-DB和FER2013Plus数据集上的准确率分别为88.56%和87.38%,并与多个模型进行对比实验和分析,验证了本模型效果的优越性.
Research on Classroom Expression Recognition Based on Gabor Convolutional and Transformer
This article mainly studies student expression recognition in complex environments.In response to the problem of complex environmental changes that cannot accurately recognize person's expressions,a facial expression recognition model GVT(Gabor-Vision-Transformer)based on Gabor convolution and Transformer is designed.A feature extraction block GVT block was designed by combining Gabor convolution with the idea of Transformer.By using Gabor convolution to extract local facial features rich in texture and edge information,and then using Transformer to extract long-distance information between global data,we can better learn facial key features and significantly improve the classification performance of the model.The accuracy of GVT on the RAF-DB and FER2013Plus datasets is 88.56%and 87.38%,respectively.Comparative experiments and analysis with multiple other models have verified the superiority of this model.

expression recognitionGabor convolution networkTransformer

曲大鹏、杨天奇、郭伟嘉、田芳茵

展开 >

辽宁大学信息学部,辽宁沈阳 110036

辽宁大学研究生院,辽宁沈阳 110036

表情识别 Gabor卷积网络 Transformer

2024

辽宁大学学报(自然科学版)
辽宁大学

辽宁大学学报(自然科学版)

影响因子:0.371
ISSN:1000-5846
年,卷(期):2024.51(3)