材料科学技术(英文版)2024,Vol.181Issue(14) :91-103.DOI:10.1016/j.jmst.2023.10.008

Wearable multifunctional organohydrogel-based electronic skin for sign language recognition under complex environments

Bin Song Xudong Dai Xin Fan Haibin Gu
材料科学技术(英文版)2024,Vol.181Issue(14) :91-103.DOI:10.1016/j.jmst.2023.10.008

Wearable multifunctional organohydrogel-based electronic skin for sign language recognition under complex environments

Bin Song 1Xudong Dai 2Xin Fan 1Haibin Gu1
扫码查看

作者信息

  • 1. Key Laboratory of Leather Chemistry and Engineering of Ministry of Education,Sichuan University,Chengdu,610065,China;National Engineering Laboratory for Clean Technology of Leather Manufacture,Sichuan University,Chengdu,610065,China
  • 2. Univ Elect Sci & Technol China,Sch Comp Sci & Engn,Chengdu,611731,China
  • 折叠

Abstract

Language barrier is the main cause of disagreement.Sign language,which is a common language in all the worldwide language families,is difficult to be entirely popularized due to the high cost of learning as well as the technical barrier in real-time translation.To solve these problems,here,we constructed a wearable organohydrogel-based electronic skin(e-skin)with fast self-healing,strong adhesion,extraor-dinary anti-freezing and moisturizing properties for sign language recognition under complex environ-ments.The e-skin was obtained by using an acrylic network as the main body,aluminum(Ⅲ)and bay-berry tannin as the crosslinking agent,water/ethylene glycol as the solvent system,and a polyvinyl al-cohol network to optimize the network performance.Using this e-skin,a smart glove was further built,which could carry out the large-scale data collection of common gestures and sign languages.With the help of the deep learning method,specific recognition and translation for various gestures and sign lan-guages could be achieved.The accuracy was 93.5%,showing the ultra-high classification accuracy of a sign language interpreter.In short,by integrating multiple characteristics and combining deep learning technology with hydrogel materials,the e-skin achieved an important breakthrough in human-computer interaction and artificial intelligence,and provided a feasible strategy for solving the dilemma of mutual exclusion between flexible electronic devices and human bodies.

Key words

Sign language recognition/Conductive organohydrogel/Electronic skin/Strain sensor/Self-healing/Freezing resistance

引用本文复制引用

基金项目

国家自然科学基金(21978180)

出版年

2024
材料科学技术(英文版)
中国金属学会 中国材料研究学会 中国科学院金属研究所

材料科学技术(英文版)

CSTPCDCSCD
影响因子:0.657
ISSN:1005-0302
参考文献量62
段落导航相关论文