电子与信息学报2024,Vol.46Issue(3) :967-976.DOI:10.11999/JEIT230165

基于DenseNet和卷积注意力模块的高精度手势识别

High-precision Gesture Recognition Based on DenseNet and Convolutional Block Attention Module

赵雅琴 宋雨晴 吴晗 何胜阳 刘璞秋 吴龙文
电子与信息学报2024,Vol.46Issue(3) :967-976.DOI:10.11999/JEIT230165

基于DenseNet和卷积注意力模块的高精度手势识别

High-precision Gesture Recognition Based on DenseNet and Convolutional Block Attention Module

赵雅琴 1宋雨晴 1吴晗 1何胜阳 1刘璞秋 2吴龙文1
扫码查看

作者信息

  • 1. 哈尔滨工业大学电子与信息工程学院 哈尔滨 150001
  • 2. 中国航天科工集团八五一一研究所 南京 211100
  • 折叠

摘要

非接触的手势识别是一种新型人机交互方式,在增强现实(AR)/虚拟现实(VR)、智能家居、智能医疗等方面有着广阔的应用前景,近年来成为一个研究热点.由于需要利用毫米波雷达进行更精确的微动手势识别,该文提出一种新型的基于MIMO毫米波雷达的微动手势识别方法.采用4片AWR1243雷达板级联而成的毫米波级联(MMWCAS)雷达采集手势回波,对手势回波进行时频分析,基于距离-多普勒(RD)图和3D点云检测出人手目标.通过数据预处理,提取手势目标的距离-时间谱图(RTM)、多普勒-时间谱图(DTM)、方位角-时间谱图(ATM)和俯仰角-时间谱图(ETM),更加全面地表征手势的运动特征,并形成混合特征谱图(FTM),对12种微动手势进行识别.设计了基于DenseNet和卷积注意力模块的手势识别网络,将混合特征谱图作为网络的输入,创新性地融合了卷积注意力模块(CBAM),实验表明,识别准确率达到99.03%,且该网络将注意力放在手势动作的前半段,实现了高精度的手势识别.

Abstract

Non-contact gesture recognition is a new type of human-computer interaction method with broad application prospects. It can be used in Augmented Reality (AR)/Virtual Reality (VR), smart homes, smart medical, etc., and has recently become a research hotspot. Motivated by the need for more precise micro-motion gesture recognition using mm-wave radar in recent years, a novel micro-motion gesture recognition method based on MIMO millimeter wave radar is proposed in this paper. The MilliMeter Wave CAScaded (MMWCAS) radar cascaded with four AWR1243 radar boards is used to collect gesture echoes. Time-frequency analysis is performed on gesture echoes, and the hand target is detected based on the Range-Doppler (RD) map and 3D point cloud. Through data pre-processing, the Range-Time Map (RTM), Doppler-Time Map (DTM), Azimuth-Time Map (ATM) and Elevation-Time Map (ETM) of the gestures are extracted to more comprehensively characterize the motion of the hand gesture. The mixed Feature-Time Maps (FTM) are formed and adopted for the recognition of 12 types of micro-motion gestures. An innovative gesture recognition network based on DenseNet and Convolutional Block Attention Module (CBAM) is designed, and the mixed FTM is used as the input of the network. Experimental results show that the recognition accuracy reaches 99.03%, achieving high-accuracy gesture recognition. It is discovered that the network focuses on the first half of the gesture movement, which improves the recognition accuracy.

关键词

手势识别/毫米波雷达/卷积神经网络/卷积注意力模块

Key words

Gesture recognition/Millimeter wave radar/Convolutional Neural Network(CNN)/Convolutional Block Attention Module(CBAM)

引用本文复制引用

基金项目

国家自然科学基金(61671185)

国家自然科学基金(62071153)

出版年

2024
电子与信息学报
中国科学院电子学研究所 国家自然科学基金委员会信息科学部

电子与信息学报

CSTPCDCSCD北大核心
影响因子:1.302
ISSN:1009-5896
被引量2
参考文献量30
段落导航相关论文