Robotics & Machine Learning Daily News2024,Issue(Feb.8) :40-41.DOI:10.1038/s42256-023-00780-9

Researchers from University of British Columbia Describe Findings in Telemedicine (Capturing Complex Hand Movements and Object Interactions Using Machine Learning-powered Stretchable Smart Textile Gloves)

Robotics & Machine Learning Daily News2024,Issue(Feb.8) :40-41.DOI:10.1038/s42256-023-00780-9

Researchers from University of British Columbia Describe Findings in Telemedicine (Capturing Complex Hand Movements and Object Interactions Using Machine Learning-powered Stretchable Smart Textile Gloves)

扫码查看

Abstract

Investigators publish new report on Telemedicine. According to news reporting originating from Vancouver, Canada, by NewsRx correspondents, research stated, “Accurate real-time tracking of dexterous hand movements has numerous applications in human-computer interaction, the metaverse, robotics and tele-health. Capturing realistic hand movements is challenging because of the large number of articulations and degrees of freedom.” Funders for this research include Natural Sciences and Engineering Research Council of Canada (NSERC), Canadian Institutes of Health Research (CIHR), NSERC Discovery (NSERC), Natural Sciences and Engineering Research Council of Canada (NSERC), Mitacs, Canada Foundation for Innovation. Our news editors obtained a quote from the research from the University of British Columbia, “Here we report accurate and dynamic tracking of articulated hand and finger movements using stretchable, washable smart gloves with embedded helical sensor yarns and inertial measurement units. The sensor yarns have a high dynamic range, responding to strains as low as 0.005% and as high as 155%, and show stability during extensive use and washing cycles. We use multi-stage machine learning to report average joint-angle estimation root mean square errors of 1.21 degrees and 1.45 degrees for intra- and interparticipant cross-validation, respectively, matching the accuracy of costly motion-capture cameras without occlusion or field-of-view limitations. We report a data augmentation technique that enhances robustness to noise and variations of sensors. We demonstrate accurate tracking of dexterous hand movements during object interactions, opening new avenues of applications, including accurate typing on a mock paper keyboard, recognition of complex dynamic and static gestures adapted from American Sign Language, and object identification. Accurate real-time tracking of dexterous hand movements and interactions has applications in human-computer interaction, the metaverse, robotics and tele-health. Capturing realistic hand movements is challenging due to the large number of articulations and degrees of freedom.”

Key words

Vancouver/Canada/North and Central America/Cyborgs/Emerging Technologies/Machine Learning/Telemedicine/University of British Columbia

引用本文复制引用

出版年

2024
Robotics & Machine Learning Daily News

Robotics & Machine Learning Daily News

ISSN:
被引量2
参考文献量52
段落导航相关论文