首页|Video-based body geometric aware network for 3D hu-man pose estimation

Video-based body geometric aware network for 3D hu-man pose estimation

扫码查看
Three-dimensional human pose estimation(3D HPE)has broad application prospects in the fields of trajectory predic-tion,posture tracking and action analysis.However,the frequent self-occlusions and the substantial depth ambiguity in two-dimensional(2D)representations hinder the further improvement of accuracy.In this paper,we propose a novel video-based human body geometric aware network to mitigate the above problems.Our network can implicitly be aware of the geometric constraints of the human body by capturing spatial and temporal context information from 2D skeleton data.Specifically,a novel skeleton attention(SA)mechanism is proposed to model geometric context de-pendencies among different body joints,thereby improving the spatial feature representation ability of the network.To enhance the temporal consistency,a novel multilayer perceptron(MLP)-Mixer based structure is exploited to compre-hensively learn temporal context information from input sequences.We conduct experiments on publicly available challenging datasets to evaluate the proposed approach.The results outperform the previous best approach by 0.5 mm in the Human3.6m dataset.It also demonstrates significant improvements in HumanEva-I dataset.

LI Chaonan、LIU Sheng、YAO Lu、ZOU Siyu

展开 >

College of Computer Science and Technology,Zhejiang University of Technology,Hangzhou 310023,China

国家重点研发计划

2018YFB1305200

2022

光电子快报(英文版)
天津理工大学

光电子快报(英文版)

EI
影响因子:0.641
ISSN:1673-1905
年,卷(期):2022.18(5)
  • 32