计算机工程与科学2024,Vol.46Issue(5) :836-845.DOI:10.3969/j.issn.1007-130X.2024.05.009

类别特征约束的多目标域表情识别方法

Multi-target domain facial expression recognition based on class-wise feature constraint

范琪 王善敏 刘成广 刘青山
计算机工程与科学2024,Vol.46Issue(5) :836-845.DOI:10.3969/j.issn.1007-130X.2024.05.009

类别特征约束的多目标域表情识别方法

Multi-target domain facial expression recognition based on class-wise feature constraint

范琪 1王善敏 2刘成广 3刘青山4
扫码查看

作者信息

  • 1. 南京信息工程大学自动化学院,江苏 南京 210044
  • 2. 南京航空航天大学计算机科学与技术学院,江苏 南京 211100
  • 3. 南京信息工程大学计算机学院,江苏 南京 210044
  • 4. 南京邮电大学计算机学院,江苏 南京 210023
  • 折叠

摘要

表情识别FER方法通常会受到采集环境和受试者区域、种族等因素的影响.为了提升 FER方法的泛化性能,无监督的域自适应表情识别方法 UDA-FER 成为了研究热点.现有的 UDA-FER 方法普遍存在 2 个问题:(1)仅关注对目标域的识别率,导致方法从源域迁移至目标域后,对源域的识别率急剧下降;(2)仅研究基于单个目标域的UDA-FER方法,将现有方法直接应用于多个目标域会导致方法识别率骤降.为解决上述问题,提出了一种类别特征约束的多目标域表情识别方法 MTD-FER,实现 FER向多个目标域的连续迁移.为了保持对源域的识别率并提高对多个目标域的识别率,MTD-FER 设计了类别自适应的伪标签标记CAPL模块和类别特征约束 CWFC 模块,挑选目标域高质量的样本标记为伪标签,并对齐各个域同类样本的特征,缓解连续迁移导致的灾难性遗忘问题.以 RAF-DB 为源域,FER-2013 和ExpW为目标域,进行大量的实验,证明了 MTD-FER 的有效性.实验结果表明,与基准方法相比,MTD-FER在多次迁移后,源域识别率提升 6.36%,与迁移之前基本持平;在各个目标域性能均有所提升,其中FER-2013 性能提升了 27.33%,ExpW性能提升了 3.03%.

Abstract

Facial Expression Recognition(FER)is usually affected by the collected environment,re-gions,race,and other factors.In order to improve the generalization of FER methods,Unsupervised Domain Adaption Facial Expression Recognition(UDA-FER)algorithms have attracted more and more attentions.Existing UDA-FER algorithms generally suffer from two issues:(1)they care more about the performance in the target domain,resulting in a sharp drop in the performance of the source domain after transferring from the source to the target domain;(2)They are just appropriate for the case of the single target domain.The UDA-FER methods will show terrible performance when applying it to multi-ple target domains directly.To solve the above issues,a Multi-Target Domain Facial Expression Recog-nition method based on class-wise feature constraint(MTD-FER)is proposed,which supports the FER methods transferring to multiple target domains in succession and ensures the methods retains a better recognition rate on each domain.To this end,MTD-FER designs the Class-Adaptive Pseudo Label methods(CAPL)and Class-Wise Feature Constraint mothods(CWFC),which learn pseudo labels for samples with high quality in target domains and align each class of features from disparate domains,so as to alleviate the issue of catastrophic forgetting resulting from domain transferring.Through extensive experiments using RAF-DB as the source domain and FER-2013 and ExpW as the target domains,the effectiveness of the MTD-FER algorithm is demonstrated.Experimental results show that,compared with the baseline method,MTD-FER improves the performance in the source domain by 6.36%,which is on par with the methods before transferring to target domains,and improves the performance by 27.33%and 3.03%in two target domains,respectively.

关键词

人脸表情识别/无监督域自适应/多目标域/类别自适应的伪标签/类别特征约束

Key words

facial expression recognition/unsupervised domain adaptation/multi-target domain/class-adaptive pseudo label/class-wise feature constraint

引用本文复制引用

出版年

2024
计算机工程与科学
国防科学技术大学计算机学院

计算机工程与科学

CSTPCD北大核心
影响因子:0.787
ISSN:1007-130X
参考文献量33
段落导航相关论文