计算机仿真2024,Vol.41Issue(12) :73-80,136.

面向舰载无人机转运的在线动态手势识别算法

Online Dynamic Gesture Recognition Algorithm for Shipborne UAV Transfer

赵康 黎向锋 李高扬 易志东
计算机仿真2024,Vol.41Issue(12) :73-80,136.

面向舰载无人机转运的在线动态手势识别算法

Online Dynamic Gesture Recognition Algorithm for Shipborne UAV Transfer

赵康 1黎向锋 1李高扬 1易志东1
扫码查看

作者信息

  • 1. 南京航空航天大学机电学院,江苏 南京 210016
  • 折叠

摘要

针对舰载无人机实时手势引导和自动转运,基于卷积神经网络的动态手势识别方法存在手势起始位置界限模糊和一个手势多次响应等亟待解决的问题.为此,提出一种基于单模型结构的在线动态手势识别算法.利用轻量级(2+1)D卷积神经网络提取手势特征,将输出的类别分数向量添加到固定长度的缓冲队列中,求取类别分数平均向量,并通过阈值判决检测手势起始位置,过滤掉识别网络偶尔的错检;当检测到手势开始时,将类别分数平均向量添加到决策队列,并通过一个标志位来控制手势识别结果的输出,以达到单次响应输出目的.实验结果表明,上述算法能够检测手势起始位置,解决一个手势多次响应的问题,在自建的舰载无人机转运手势数据集上取得了86.91%的Levenshtein精度,实时检测速度为每秒60 帧.

Abstract

Aiming at real-time gesture guidance and automatic transfer of shipborne UAV,the dynamic gesture recognition method based on convolutional neural network has some problems that need to be solved urgently,such as boundary indistinction of start position of gestures and many times responses of a gesture.Therefore,an online dynamic gesture recognition algorithm based on single-model architecture is proposed.The lightweight(2+1)D conv-olutional neural network is used to extract features of dynamic gestures.The class score vector which is output by net-work is added to the fixed length cache queue,and the average vector of class score is calculated.Then the start posi-tion of gestures is detected through threshold judgment,and the occasional false detection of the recognition network is filtered out.When gesture start is detected,the average vector of class score is added to the decision queue,and the output of gesture recognition result is controlled by a flag to achieve the purpose of single response.The experimental results show that the algorithm can detect the start position of gestures and solve the problem of many times responses of a gesture.The Levenshtein accuracy of 86.91%is achieved on the self-built shipborne UAV transfer gesture data-set,and the speed of real-time detection is 60 frames per second.

关键词

舰载无人机转运/动态手势识别/实时/手势起始位置检测/单次响应

Key words

Shipborne UAV transfer/Dynamic gesture recognition/Real time/Detection of start position of gestures/Single response

引用本文复制引用

出版年

2024
计算机仿真
中国航天科工集团公司第十七研究所

计算机仿真

CSTPCD
影响因子:0.518
ISSN:1006-9348
段落导航相关论文