基于DSConvBiGRU网络和热电堆阵列的动态手势识别方法

Dynamic Gesture Recognition Method Based on DSConvBiGRU Network and Thermopile Array

扫码查看

原文链接

国家科技期刊平台
NETL
NSTL
万方数据

中文摘要：提出了适用于嵌入式系统并融合深度可分离卷积神经网络与双向门控循环单元的DSConvBiGRU网络模型,将其用于动态手势序列的分类,设计并实现了一种使用低分辨率热电堆阵列传感器的动态手势识别解决方案,构建了动态手势数据集并在公开网站发布,完成了预训练网络模型在Raspberry Pi边缘端的部署.系统对传感器输出的连续20个温度矩阵进行区间映射、背景减除、Lanczos插值和Otsu二值化预处理得到单个动态手势序列,再由预训练的DSConvBiGRU网络进行分类.实验结果表明:网络模型在测试集上识别准确率为99.291％,在边缘端预处理耗时5.513 ms,推理耗时8.231 ms,该系统满足低功耗、高精度和实时性的设计需求.

外文摘要：The DSConvBiGRU network model which is suitable for embedded systems and combines depthwise separable convolutional neural networks and bidirectional gated recurrent units for the classification of dynamic gesture sequences is proposed.A dynamic gesture recognition solution which utilizes a low-resolution thermopile array sensor is designed and implemented.An experimental dataset comprising various dynamic gestures has been constructed and publicated on open website.The deployment of the pre-trained network model on the Raspberry Pi edge device has been accomplished.The system preprocesses 20 consecutive temperature matrices exported by the sensor through interval mapping,background subtraction,Lanczos interpolation,and Otsu thresholding to obtain a single dynamic gesture sequence.Subsequently,the pre-trained DSConvBiGRU network is employed for the classification.Experimental results demonstrate that the network model achieves an accuracy of 99.291％on test dataset.The time comsunption of preprocess and inference on the edge device is 5.513 ms and 8.231 ms respectively.The system meets the design requirements for low-power consumption,high precision,and real-time performance.

外文关键词：

machine visionphotoelectic detectiondynamic gesture recognitionthermopile arraydepthwise separable convolutional neural networksbidirectional gated recurrent unit

作者：

顾亮、于莲芝

展开 >

作者单位：

上海理工大学光电信息与计算机工程学院,上海 200093

关键词：

机器视觉光电检测动态手势识别热电堆阵列深度可分离卷积神经网络双向门控循环单元

基金：

国家自然科学基金

项目编号：

61603257

出版年：

2024

DOI：

10.3969/j.issn.1000-1158.2024.06.04

计量学报

中国计量测试学会

计量学报

CSTPCD北大核心

影响因子：0.303

ISSN：1000-1158

年,卷(期)：2024.45(6)