首页|表情变换时序特征下的驾驶人情绪识别研究

表情变换时序特征下的驾驶人情绪识别研究

扫码查看
针对现有驾驶人情绪识别方法存在的识别实时性不足、识别精度较低等问题,提出一种表情识别及其时序情绪表达的驾驶人情绪识别方法.首先,建立VGG Lite驾驶人表情识别模型,在传统VGG Net模型结构上,通过改变卷积层堆叠结构以大幅减少模型的参数量,修改激活函数以增强模型对人脸表情中细节特征的表达能力,并在模型中增加性能优化层来提升模型的收敛性和泛化性.其次,分析表情时序变化与情绪状态之间的关系,研究时间序列演变的情绪表达方式,设计了包含表情时序转化、表情-情绪量化映射和时序情绪表达的驾驶人时序情绪识别方法.然后,采用Fer2013数据集,将所提出的VGG Lite驾驶人表情识别模型与其他模型进行比较验证,证明了该模型不仅可以保持高识别准确率,还有效降低了模型参数量,从而提高了识别速度,此外,采用自制数据集识别表情获得了98.8%的高准确率,证明了该模型能有效识别不同驾驶情境中的驾驶人表情.最后,以公交车驾驶人情绪识别为例对提出的时序情绪识别方法进行试验验证,结果表明,该方法能够准确识别驾驶人各种表情转换下的复杂情绪状态,平均识别率高于95%,比单帧情绪识别方法提升5%以上,每帧图像的情绪识别耗时平均低于0.03 s,每秒平均识别超过10帧,满足交通驾驶情绪识别的实时性要求.所提方法能够及时、准确地评估驾驶人的情绪状态,为提高交通系统整体安全性和效率提供了更有效的手段.
Research on Driver Emotion Recognition Based on Temporal Features of Expression Transformation
Aiming at the issues of insufficient real-time recognition and low accuracy in existing driver emotion recognition methods,a driver emotion recognition method based on facial expression recognition and temporal emotion representation is proposed.Firstly,a VGG Lite driver expression recognition model is established.On the traditional VGG Net model structure,the parameters of the model are greatly reduced by modifying the convolutional layer stacking structure,and the activation function is adjusted to enhance the model's expression capability of detailed facial features,and the performance optimization layer is added to the model to improve the convergence and generalization.Secondly,the relationship between temporal transformation in facial expression and emotional states is analyzed,and the emotional expression mode of time series evolution is studied.A driver's temporal emotion recognition method including facial expression temporal transformation,expression-emotion quantization mapping and temporal emotion expression is designed.Then,the proposed VGG Lite driver expression recognition model is compared with other models by using the Fer2013 dataset.The results demonstrate that the proposed model not only maintains high recognition accuracy but also effectively reduces the number of model parameters,thereby improving the recognition speed.In addition,a high accuracy of 98.8%is achieved in recognizing facial expression using a self-made dataset,proving the effectiveness of the model in recognizing driver expression in different driving scenarios.Finally,the proposed temporal emotion recognition method is experimentally validated using the example of bus driver's emotion recognition.The results show that the method can accurately identify the complex emotional state of the driver under various facial expression transformation,with an average recognition accuracy of over 95%,surpassing single-frame emotion recognition methods by more than 5%.The emotion recognition time per frame is averaged at less than 0.03 seconds,with an average recognition rate of over 10 frames 0per second,meeting the real-time requirements of traffic driving emotion recognition.This method can timely and accurately assess the driver's emotional state,providing a more effective means to improve the overall safety and efficiency of the transportation system.

traffic engineeringdriving emotiontemporal emotion recognitiondriver emotional statedriver safety

董红召、林少轩、佘翊妮

展开 >

浙江工业大学智能交通系统联合研究所,浙江杭州 310023

交通工程 驾驶情绪 时序情绪识别 驾驶人情绪状态 驾驶安全

国家自然科学基金浙江省"尖兵领雁"研发攻关计划

617733472024C01180

2024

中国公路学报
中国公路学会

中国公路学报

CSTPCD北大核心
影响因子:1.607
ISSN:1001-7372
年,卷(期):2024.37(5)
  • 39