计算机工程与设计2024,Vol.45Issue(10) :3059-3065.DOI:10.16208/j.issn1000-7024.2024.10.023

基于多尺度特征融合的双分支手部姿态估计算法

Multi-scale feature fusion based dual branch algorithm for hand pose estimation

陈征 李晋江
计算机工程与设计2024,Vol.45Issue(10) :3059-3065.DOI:10.16208/j.issn1000-7024.2024.10.023

基于多尺度特征融合的双分支手部姿态估计算法

Multi-scale feature fusion based dual branch algorithm for hand pose estimation

陈征 1李晋江1
扫码查看

作者信息

  • 1. 山东工商学院计算机科学与技术学院,山东烟台 264000
  • 折叠

摘要

由于RGB图像的深度歧义性,关节点的深度坐标相对于关节点的二维图像坐标来说更难预测.提出一种基于手部多尺度特征融合的双分支手部姿态估计算法,将手部关节点的二维图像坐标和深度坐标进行分组预测.采用FPN提取手部多尺度特征,提出特征融合模块,对手部多尺度特征进行融合增强,得到手部高层特征和低层特征;提出双分支网络结构,利用融合之后的手部高层特征和低层特征分别预测手部关节点的深度坐标和二维图像坐标.在两个公开的手势数据集上进行了充分实验,与当前最好方法相比,所提方法在平均关节误差指标上取得了当前最好结果.

Abstract

Due to the depth ambiguity of RGB images,the hand joint depth coordinates are usually more difficult to estimate com-pared to the hand joint 2D image coordinates.A dual branch hand pose estimation algorithm based on multi-scale feature fusion was proposed.The FPN was used to extract multi-scale features of the hand.A feature fusion module was proposed to fuse and enhance the hand features,obtaining high-level and low-level features of the hand.A dual branch network structure was pro-posed,in which the high-level features and low-level features were used to estimate the depth coordinates and two-dimensional image coordinates of the hand joints,respectively.Sufficient experiments were conducted on two publicly available hand pose datasets.The proposed method achieves the best results in terms of the mean joint error metric compared with state-of-the-art methods.

关键词

手部姿态估计/多尺度特征融合/特征提取/平均关节误差/人机交互/分组预测/双分支网络

Key words

hand pose estimation/multi-scale feature fusion/feature extraction/mean joint error/human-computer interaction/group prediction/dual branch network

引用本文复制引用

基金项目

国家自然科学基金项目(62002200)

国家自然科学基金项目(62202268)

国家自然科学基金项目(61972235)

出版年

2024
计算机工程与设计
中国航天科工集团二院706所

计算机工程与设计

CSTPCD北大核心
影响因子:0.617
ISSN:1000-7024
段落导航相关论文