首页|一种基于双目立体视觉的虚拟轨道列车路径识别方法

一种基于双目立体视觉的虚拟轨道列车路径识别方法

扫码查看
为了克服单目视觉的局限性和提高虚拟轨道列车的路径感知能力,文章提出一种基于双目立体视觉的虚拟轨道列车路径识别方法.针对虚拟轨道列车车道块明显、外形完整、形状独特等特点,提出了基于MaskR-CNN的车道检测模型.同时,针对通用的双目匹配算法计算量大和对重复物体匹配较难的缺点,提出了融合多目标跟踪的双目匹配算法.该方法通过左右相机各自检测车道块,进行多 目标跟踪来分配ID,对左右图像中的各车道块实现有序、定向的双目匹配,并重建出车辆坐标系下路径的三维坐标,有效提升了车辆系统路径感知能力,为其循迹控制、自主定位、相对位姿估计等提供了更加直接准确的输入信息.试验结果表明,本文方法对路径的三维重建具有较高的准确性,并且在不同路况场景下具有较强的适应性.
A virtual rail train path recognition method based on binocular stereo vision
This paper presents a path recognition method based on binocular stereo vision for virtual rail train,to overcome the limi-tations of monocular vision and improve the path perception ability of virtual rail train.To achieve this,a lane detection model based on Mask R-CNN was developed,incorporating their characteristics such as obvious lane blocks,contour integrity,and unique shape.Mean-while,a binocular matching algorithm based on multi-target tracking was proposed,addressing the drawbacks of general binocular matching algorithms including substantial computations and deficient ability to match repeated objects.The proposed method incorporat-ed both left and right cameras to detect lane blocks respectively,and enabled the assignment of IDs through multi-target tracking.There features allowed for an orderly and directional binocular matching of lane blocks in the left and right images,and the reconstruction of three-dimensional coordinates of the path in the tram coordinate system.This method was demonstrated effective in improving the path perception ability of trams and providing more direct and accurate input information to enable various functions such as tracking control,autonomous positioning and relative pose estimation of trams.Additionally,experimental results show the high accuracy of the proposed method in 3D path reconstruction and its strong adaptability to different road conditions.

virtual rail trainlane recognitionbinocular stereo visiontarget detectionmulti-target trackingbinocular matching3D reconstruction

曾俊玮、耿力、卢晨旸、任利惠

展开 >

同济大学铁道与城市轨道交通研究院,上海 201804

虚拟轨道列车 路径识别 双目立体视觉 目标检测 多目标跟踪 双目匹配 三维重建

国家重点研发计划

2018YFB1201603-07

2024

机车电传动
中国南车集团株洲电力机车厂

机车电传动

CSTPCD
影响因子:0.347
ISSN:1000-128X
年,卷(期):2024.(1)
  • 14