基于双分支时空步态特征融合的深度学习步态识别
Deep learning gait recognition based on two branch spatiotemporal gait feature fusion
张云佐 1董旭1
作者信息
- 1. 石家庄铁道大学信息科学与技术学院,石家庄 050043
- 折叠
摘要
针对现有步态识别方法易受拍摄视角、着装变化影响的问题,提出一种融合二维无肩姿态拓扑能量图(shoulderless pose topological energy maps,SPTEM)和三维局部骨骼步态特征(local skeleton gait features,LSGF)的深度学习步态识别方法.首先,利用轻量级BlazePose姿态估计算法提取步态视频序列中的人体姿态拓扑图以生成SPTEM,在提高检测速度的同时减弱衣物变化带来的影响;然后,引入LSGF以弥补单一能量图特征在多变视角情况下识别准确率较低的不足;最后,提出结合注意力机制的时空特征提取网络模型,并在全连接层将双流特征进行一致融合.在CASIA-B数据集上对所提出方法进行验证,并与当前主流的步态识别方法进行比较,结果表明,所提出方法在跨视角和穿大衣/棉衣条件下的步态识别率都有明显提升.
Abstract
Aiming at the problem that the existing gait recognition methods are easily affected by shooting angle and clothing changes,this paper proposes a deep learning gait recognition method that fuses 2D shoulderless pose topological energy maps(SPTEMs)and 3D local skeleton gait features(LSGFs).Firstly,the lightweight BlazePose pose estimation algorithm is used to extract the human posture topology in the gait video sequence to generate the SPTEM,which improves the detection speed and reduces the impact of clothing changes.Then,the LSGF is introduced to make up for the low recognition accuracy deficiency of a single energy map feature in the case of variable viewing angles.Finally,a spatio-temporal feature extraction network model fused with an attention mechanism is proposed,and the two-stream features are fused uniformly in the fully connected layer.The proposed algorithm is validated on the CASIA-B dataset and compared with the current mainstream gait recognition methods.The results show that the gait recognition rate of the proposed method is significantly improved under cross-view and cl conditions.
关键词
无肩姿态拓扑能量图/局部骨骼步态特征/BlazePose/双流网络/深度学习/步态识别Key words
shoulderless pose topological energy map(SPTEM)/local skeleton gait features(LSGF)/BlazePose/dual-stream network/deep learning/gait recognition引用本文复制引用
基金项目
国家自然科学基金项目(61702347)
国家自然科学基金项目(62027801)
河北省自然科学基金项目(F2017210161)
河北省自然科学基金项目(F2022210007)
河北省高等学校科学技术研究项目(ZD2022100)
中央引导地方科技发展资金项目(226Z0501G)
出版年
2024
NETL
NSTL
万方数据