首页|基于自适应特征融合的抓取检测方法研究

基于自适应特征融合的抓取检测方法研究

扫码查看
针对因角度训练标签冲突和可抓取区域与物体区域间的非一致性导致的现有抓取检测方法在复杂的非结构化抓取场景中抓取检测准确性不足的问题,本文提出了一种自适应特征融合抓取检测网络AFFGD-Net.该网络首先采用基于分区法的角度预测方法,将角度值编码为角度类别和偏移量两部分进行学习预测,冲突的角度值划分到同一类别,减少角度训练标签的冲突,偏移量用于补偿分类部分的精度损失,提升网络对抓取角度的预测准确率.其次,引入自适应感受野模块(ARFB)和注意力跳跃连接模块ASCM,ARFB增强网络对多尺度可抓取区域特征的表征能力,并通过自适应融合不同尺度特征,提升对多尺度物体的抓取检测能力,ASCM通过自适应融合低层空间特征和高层语义特征以恢复可抓取区域的边缘特征,提高网络的抓取角度和抓取宽度预测准确率.最后,通过实验验证了所提网络的有效性.在Cornell数据集的图像划分和对象划分测试模式下,AFFGD-Net的准确率分别达到98.9%和97.7%,在Jacquard数据集中准确率达到95.2%.网络检测速度达到111 FPS,显示出良好的实时性.实验结果表明,AFFGD-Net在抓取检测的准确性和实时性方面均优于现有方法,验证了所提方法的有效性.
Research on grasp detection method based on adaptive feature fusion
To address the problem of insufficient grasp detection accuracy of existing grasp detection methods in complex unstructured grasping scenarios due to the conflict of angle training labels and the non-consistency between graspable regions and object regions,this paper proposed an adaptive feature fusion grasp detection network,AFFGD-Net.The network firstly adopted the angle prediction method based on the partition method,which encoded the angle values into two parts,namely,angle category and offset for learning and prediction.The conflict angle values were divided into the same category to reduce the conflict of angle training labels,and the offset was used to compensate for the loss of accuracy in the classification part to improve the prediction accuracy of the network for grasp angle.Secondly,the adaptive receptive field block ARFB and attention skip connection module ASCM are introduced.ARFB enhanced the network's ability to characterise the features of multi-scale graspable regions,and improved the grasp detection ability of multi-scale objects by adaptively fusing features of different scales.ASCM recovered the edge features of the graspable regions by adaptively fusing the low-level spatial features and the high-level semantic features,which improved the network's grasp angle and grasp width prediction accuracy.Finally,the effectiveness of the proposed network was verified by experiments.The accuracy of AFFGD-Net reached 98.9%and 97.7%in the image segmentation and object segmentation test modes in the Cornell dataset,respectively,and 95.2%in the Jacquard dataset.The detection speed of the network reached 111 FPS,which showed good real-time performance.The experimental results showed that AFFGD-Net outperformed the existing methods in terms of both accuracy and real-time crawl detection,confirming the effectiveness of the proposed method.

grasp detectionreceptive field blockfeature fusionattention mechanism

熊焕、俞建峰、钱陈豪、蒋毅、化春键

展开 >

江南大学机械工程学院 无锡 214122

江苏省食品先进制造装备技术重点实验室 无锡 214122

抓取检测 感受野模块 特征融合 注意力机制

2024

电子测量与仪器学报
中国电子学会

电子测量与仪器学报

CSTPCD北大核心
影响因子:2.52
ISSN:1000-7105
年,卷(期):2024.38(10)