首页|基于虚拟空间三维体素—语义地图的机械臂任务规划

基于虚拟空间三维体素—语义地图的机械臂任务规划

扫码查看
任务规划算法是机械臂在未知环境下具备抓取能力的基础,为此提出一种基于三维体素—语义地图的机械臂虚拟空间任务规划方法.在获取完整点云场景的基础上,利用基于掩码区域的卷积神经网络实现目标检测与实例分割,构建由三维点云、语义信息、三维计算机辅助设计模型组成的体素-语义混合地图;优化A*算法完成机械臂末端执行器最优路径规划,利用贝塞尔曲线完成轨迹优化;探究抓取不同几何体时的机械臂末端位姿,分解抓取、放置等复杂任务,形成基于语义驱动的空间任务规划.在虚拟空间通过仿真试验,表明了所提算法的有效性和快速性,同时该算法可支撑机械臂执行各种复杂的抓取任务,并提升机械臂的智能水平.
Task Planning of Robot Arm Based on 3D Voxel-semantic Map of Virtual Space
Task planning algorithm is the basis of robot arm's grasping ability in unknown environment.A virtual space task planning method based on 3D voxel-semantic map is proposed.First of all,the complete point cloud scene is obtained and spliced.The Mask RCNN network is used for the object detection and instance segmentation.A voxel-semantic hybrid map composed of 3D point cloud,semantic information and 3D CAD model is constructed.Secondly,the A*algorithm is optimized to complete the optimal path planning of the robot arm effector,and the trajectory optimization is completed through the Bessel curve.Thirdly,the pose of robot arm corresponding to grasping different geometers is explored,and the complex task planning of grasping and placing is decomposed to form a semantic-driven spatial task planning.The effectiveness and rapidity of the proposed algorithm are verified by simulation experiments in virtual space.Meanwhile,the proposed algorithm can support the robot arm to perform various complex grasping tasks and improve the intelligence level of the robot arm.

robot armvirtual spacetask planningvoxelsemantic

王立鹏、王小晨、刘梦杰、孟浩

展开 >

哈尔滨工程大学智能科学与工程学院,哈尔滨 150001

机械臂 虚拟空间 任务规划 体素 语义

国家自然科学基金黑龙江省教育科学规划课题重点项目(2023)中央高校基本科研业务费专项

62173103GJB14230593072022JC0402

2024

实验室研究与探索
上海交通大学

实验室研究与探索

CSTPCD北大核心
影响因子:1.69
ISSN:1006-7167
年,卷(期):2024.43(3)
  • 2