Fusing Rotation Angle Coding in Spherical Space for Human Action Recognition
The existing human action recognition methods focus more on the translation information such as the coordinates and displacements of skeleton structure,and pay less attention to the motion trend of skeleton structure and the rotation information representing the motion direction of joints and bones.A spatio-temporal convolutional neural network method combining the rotation angle coding in spherical space is introduced.The angle information with scale invariance is obtained by mapping the human action in three-dimensional spherical space,and the dynamic angular velocity information is extracted as the angle code to represent the rotation information of joints and bones in the action trajectory.A spatio-temporal feature extraction and co-occurrence module(STCN)is constructed to better capture the spatio-temporal features of data.A suitable fusion strategy is utilized to fuse the translation features and rotation features.The experimental results show that the rotation angle coding benefits the accuracy improvement of motion representation and the effectiveness of the spatio-temporal feature extraction and co-occurrence module.
human action recognitionskeleton datarotation angle encoding3D spherical spacespatial-temporal feature
NETL
NSTL
万方数据
