北京理工大学学报(英文版)2024,Vol.33Issue(3) :175-185.DOI:10.15918/j.jbit1004-0579.2024.051

Video-Based Deception Detection with Non-Contact Heart Rate Monitoring and Multi-Modal Feature Selection

Yanfeng Li Jincheng Bian Yiqun Gao Rencheng Song
北京理工大学学报(英文版)2024,Vol.33Issue(3) :175-185.DOI:10.15918/j.jbit1004-0579.2024.051

Video-Based Deception Detection with Non-Contact Heart Rate Monitoring and Multi-Modal Feature Selection

Yanfeng Li 1Jincheng Bian 1Yiqun Gao 1Rencheng Song1
扫码查看

作者信息

  • 1. Department of Biomedical Engineering,Hefei University of Technology,Hefei 230009,China
  • 折叠

Abstract

Deception detection plays a crucial role in criminal investigation.Videos contain a wealth of information regarding apparent and physiological changes in individuals,and thus can serve as an effective means of deception detection.In this paper,we investigate video-based decep-tion detection considering both apparent visual features such as eye gaze,head pose and facial action unit(AU),and non-contact heart rate detected by remote photoplethysmography(rPPG)technique.Multiple wrapper-based feature selection methods combined with the K-nearest neighbor(KNN)and support vector machine(SVM)classifiers are employed to screen the most effective features for deception detection.We evaluate the performance of the proposed method on both a self-collected physiological-assisted visual deception detection(PV3D)dataset and a public bag-of-lies(BOL)dataset.Experimental results demonstrate that the SVM classifier with symbiotic organisms search(SOS)feature selection yields the best overall performance,with an area under the curve(AUC)of 83.27%and accuracy(ACC)of 83.33%for PV3D,and an AUC of 71.18%and ACC of 70.33%for BOL.This demonstrates the stability and effectiveness of the proposed method in video-based deception detection tasks.

Key words

deception detection/apparent visual features/remote photoplethysmography/non-con-tact heart rate/feature selection

引用本文复制引用

出版年

2024
北京理工大学学报(英文版)
北京理工大学

北京理工大学学报(英文版)

影响因子:0.168
ISSN:1004-0579
段落导航相关论文