起重运输机械2024,Issue(23) :45-51.

基于深度强化学习的机器人高自由度抓取分析

宋远航 贺辉腾 胡楷雄
起重运输机械2024,Issue(23) :45-51.

基于深度强化学习的机器人高自由度抓取分析

宋远航 1贺辉腾 1胡楷雄1
扫码查看

作者信息

  • 1. 武汉理工大学交通与物流工程学院 武汉 430063
  • 折叠

摘要

机器人抓取搬运在工业生产中发挥着至关重要的作用,利用基于机器学习和视觉信息相结合的机器人抓取搬运方法能够自动配置给定的任务,无需任何人工干预,显著减少了编程工作的需求.文中提出了一种基于深度确定性策略梯度算法的机器人高自由度抓取策略.该策略基于PointNet++/PointNet构建了Actor和Critic网络,并利用多视角下获取的点云数据作为状态输入,以缓解遮挡以及二维图像信息缺失对高自由度抓取成功率的影响.针对算法训练中收敛时间过长的问题,采用了基于专家策略的模型预训练以及优先经验重放等优化方法进行改进,仿真结果表明,改进后的深度确定性策略梯度算法在训练速度和最终效果上都有显著提升.

Abstract

Robot grasping and handling plays a vital role in industrial production.The robot grasping and handling based on the combination of machine learning and visual information can automatically configure the given task without any manual intervention,which significantly reduces the programming work.In this paper,a robot high-degree-of-freedom grasping strategy based on depth deterministic strategy gradient algorithm is proposed.Actor and Critic networks are constructed based on pointnet++/pointnet,and the point cloud data obtained from multiple perspectives are used as state data input to alleviate the influence of occlusion and the lack of two-dimensional image information on the success rate of high-degree-of-freedom grasping.Considering long convergence time in algorithm training,optimization methods such as model pre-training based on expert strategy and priority experience replay were adopted.The simulation results show that the improved depth deterministic strategy gradient algorithm can significantly improve the training speed and final results.

关键词

深度强化学习/机器人抓取搬运/高自由度/多视角点云

Key words

deep reinforcement learning/robot grabbing and handling/high degree of freedom/multi-view point cloud

引用本文复制引用

出版年

2024
起重运输机械
北京起重运输机械设计研究院

起重运输机械

影响因子:0.214
ISSN:1001-0785
段落导航相关论文