首页|Challenges and solutions for vision-based hand gesture interpretation: A review

Challenges and solutions for vision-based hand gesture interpretation: A review

扫码查看
原文链接
  • NETL
  • NSTL
  • Elsevier
Hand gesture is one of the most efficient and natural interfaces in current human-computer interaction (HCI) systems。 Despite the great progress achieved in hand gesture-based HCI， perceiving or tracking the hand pose from images remains challenging。 In the past decade， several challenges have been indicated and explored， such as incomplete data issue， the requirement of large-scale annotated dataset， and 3D hand pose estimation from monocular RGB image; however， there is a lack of surveys to provide comprehensive collection and analysis for these challenges and corresponding solutions。 To this end， this paper devotes effort to the general challenges of hand gesture interpretation techniques in HCI systems based on visual sensors and elaborates on the corresponding solutions in current state-of-the-arts， which can provide a systematic reminder for practical problems of hand gesture interpretation。 Moreover， this paper provides informative cues for recent datasets to further point out the inherent differences and connections among them， such as the annotation of objects and the number of hands， which is important for conducting research yet ignored by previous reviews。 In retrospect of recent developments， this paper also conjectures what the future work will concentrate on， from the perspectives of both hand gesture interpretation and dataset construction。

Hand gesture interpretationHand pose estimationHuman-computer interactionVisual sensor

Kun Gao、Haoyang Zhang、Xiaolong Liu、Xinyi Wang、Liang Xie、Bowen Ji、Ye Yan、Erwei Yin

展开 >

College of Engineering, Peking University, Beijing 100871, China||Defense Innovation Institute, Academy of Military Sciences (AMS), Beijing, 100071, China||Intelligent Game and Decision Laboratory, Beijing, 100071, China||Tianjin Artificial Intelligence Innovation Center (TAIIC), Tianjin, 300450, China

Defense Innovation Institute, Academy of Military Sciences (AMS), Beijing, 100071, China||Intelligent Game and Decision Laboratory, Beijing, 100071, China||Tianjin Artificial Intelligence Innovation Center (TAIIC), Tianjin, 300450, China

Defense Innovation Institute, Academy of Military Sciences (AMS), Beijing, 100071, China||Intelligent Game and Decision Laboratory, Beijing, 100071, China||Tianjin Artificial Intelligence Innovation Center (TAIIC), Tianjin, 300450, China||School of Information Science and Engineering, East China University of Science and Technology, Shanghai 200237, China

Unmanned System Research Institute, Northwestern Polytechnical University, Xi'an 710072, China||Ministry of Education Key Laboratory of Micro and Nano Systems for Aerospace, Northwestern Polytechnical University, Xi'an 710072, China

展开 >

2024

10.1016/j.cviu.2024.104095

Computer vision and image understanding

Computer vision and image understanding

EISCI
ISSN：1077-3142
年,卷(期)：2024.248(Nov.)
  • 288