首页|基于视觉语义与激光点云交融构建的SLAM算法

基于视觉语义与激光点云交融构建的SLAM算法

扫码查看
激光雷达作为同时定位与地图构建(SLAM)传感器之一,因精度高、性能稳定等特点而被广泛研究使用。但其获得的点云数据较稀疏,包含特征信息少,会导致误匹配、位姿估计误差大等问题,影响SLAM的定位和建图精度。对此,提出一种将视觉语义信息与激光点云数据融合的SLAM算法(VSIL-SLAM)。首先,基于投影思想将聚类后的点云映射到语义检测框内,生成语义物体,解决原始激光点云特征稀缺问题;然后,在形状特征的基础上引入拓扑特征对语义物体进行表述,提出基于匹配的拓扑相似性度量方法,解决单一特征造成的误匹配问题,提高匹配准确度;最后,加入语义物体点到点的几何约束,基于几何特征和语义物体构建前端里程计,并完成后端回环检测和位姿图优化设计。实验结果表明,所提出算法在定位和建图效果上都有显著提高,改善了激光SLAM算法的性能。
SLAM algorithm based on fusion of visual semantics and laser point cloud
Lidar,as one of SLAM(simultaneous localization and mapping)sensors,has been widely studied and used due to its high precision and stable performance.However,the obtained point cloud data is sparse and contains little feature information,which could lead to some problems such as mismatching and pose estimation error,and affect the localization and mapping accuracy of SLAM.In view of the above problems,an SLAM algorithm(VSIL-SLAM)that integrates visual semantic information and laser point cloud data is proposed.Firstly,based on the projection idea,the post-clustering point cloud is mapped to the semantic detection frame to generate semantic objects and solve the problem of scarce features of the original laser point cloud.Then,on the basis of shape features,topological features are introduced to describe semantic objects,and a topological similarity measurement method based on matching is proposed to solve the problem of mismatching caused by single features and improve the matching accuracy.Finally,the front-end odometer is constructed based on geometric features and semantic objects by adding the geometric constraints of semantic objects point-to-point,and the back-end loopback detection and pose map optimization design are completed.Experimental results demonstrate that the proposed algorithm improves the performance of the laser SLAM algorithm in both localization and mapping.

visual semanticspoint cloud clusteringfusion algorithmtopological similarity measurementfront-end odometerlaser SLAM

佟国峰、杨宇航、彭浩、孟祥政、殷旗君

展开 >

东北大学信息科学与工程学院,沈阳 110004

视觉语义信息 点云聚类 融合算法 拓扑相似性度量 前端里程计 激光SLAM

国家重点研发计划项目国家重点研发计划项目

2019YFB13099052020YFB1712802

2024

控制与决策
东北大学

控制与决策

CSTPCD北大核心
影响因子:1.227
ISSN:1001-0920
年,卷(期):2024.39(1)
  • 24