首页|Gesture recognition system based on ultrasonic FMCW and ConvLSTM model

Gesture recognition system based on ultrasonic FMCW and ConvLSTM model

扫码查看
? 2022 Elsevier LtdUltrasonic-based technologies could provide light-independent and high-resolution solutions in no-contact human–machine interaction. This paper proposed a gesture recognition system on the basis of ultrasonic frequency modulated continuous wave (FMCW) and ConvLSTM model. It employed a hardware layout of one transmitter and three receivers spatially installed at different directions. An FMCW signal emitted by the transmitter would be detected by the receivers after reflecting from the hand. Then, the range-Doppler maps (RDMs) of the received signal were obtained by processing 2D fast Fourier transform. The spatio-temporal features of the hand were extracted from RDMs by the ConvLSTM model, to facilitate the gesture classification. Experiments showed that a fine resolution of 0.005 m in distance and 0.03 m/s in velocity for hand movement, and an accuracy of 85.7% with a small size of 50 samples training for finger-movement gestures can be achieved, which verified the feasibility of the proposed system.

BroadbandDeep learning networksFrequency modulated continuous waveHand gesture recognitionUltrasonic wave

Kong F.、Deng J.、Fan Z.

展开 >

School of Computer and Information Science Southwest University

2022

Measurement

Measurement

SCI
ISSN:0263-2241
年,卷(期):2022.190
  • 2
  • 32