首页|基于深度学习的增强装配智能人机交互方法

基于深度学习的增强装配智能人机交互方法

扫码查看
针对增强装配系统智能化水平低、系统与用户交互性差的问题,提出一种基于深度学习的零件拾取感知方法。采用目标检测算法提取手部和零件的类别与位置信息,并通过区域相交判定方法获取图像感兴趣区域。搭建分类网络以识别单帧深度图像中零件的拾取状态,以此为基础,提出连续帧状态识别方法消除单帧识别结果误差。实验结果表明,在航空发动机零件装配过程中,所提方法单帧感知速度在0。031 s内,连续帧下准确率可达100%,满足现场识别准确率和速度要求。
INTELLIGENT HUMAN-COMPUTER INTERACTION METHOD FOR AUGMENTED ASSEMBLY BASED ON DEEP LEARNING
Aimed at the problem of low level of intelligence of the augmented assembly system and poor interaction between the system and the user,a deep learning-based intelligent parts picking perception method is proposed.The target detection algorithm was used to extract the category and position information of the hand and the parts to be assembled,and the region intersection determination method was used to obtain the region-of-interest.A classification network was built to identify the pickup status of parts in a single frame depth image.Based on this,a continuous frame status recognition method was proposed to eliminate errors of single frame recognition result.The experimental results show that:in the assembly process of aero-engine parts,the proposed method has a single-frame sensing speed within 0.031 s,and the accuracy of continuous frames can reach 100%,which meets the accuracy and speed requirements of on-site recognition.

Augmented assemblyHuman-computer interactionDeep learningPickup perception

李晗、郭宇、汤鹏洲、吴鹏兴、魏禛、郑冠冠

展开 >

南京航空航天大学机电学院 江苏南京 210016

增强装配 人机交互 深度学习 拾取感知

国防基础科研资助项目国防基础科研资助项目国防基础科研资助项目

JCKY2018605C003JCKY2018203A001JCKY2017203B071

2024

计算机应用与软件
上海市计算技术研究所 上海计算机软件技术开发中心

计算机应用与软件

CSTPCD北大核心
影响因子:0.615
ISSN:1000-386X
年,卷(期):2024.41(1)
  • 4