首页|基于MaxViT和改进几何特征点法的车载单目视觉测速方法研究

基于MaxViT和改进几何特征点法的车载单目视觉测速方法研究

扫码查看
车载视觉测速技术作为自动驾驶车辆组合测速技术的重要组成,具有硬件成本低、算法拓展性强、低速下测量准确等特点,应用前景广阔.为进一步提高视觉测速算法在各类工况下的精度和鲁棒性,将几何特征点法在特征点充足时测速精度高和深度学习方法在多场景下测速稳定的优势进行结合,提出一种基于MaxViT和改进几何特征点法的车载单目视觉测速算法.该算法构建基于双输入MaxViT网络和改进几何特征点法的双通道,并行处理车载前视相机获取的连续3帧输入图像序列,滚动估计车辆当前速度,其中双输入MaxViT网络差异化提取图像不同区域的光流特征,估计当前速度所在的置信度为90%的速度区间,改进特征点法基于特征点运动计算当前速度估计值.当速度估计值落在双输入MaxViT网络估计的速度区间时,以该估计值作为实时车速测量值,否则以速度区间中值作为实时车速测量值.当算法迭代运行多帧后,将速度区间中值作为本帧速度输出以减小累积误差.使用6个车速小于40 km/h且包括加减速等工况与直弯道等场景的自建数据集进行实验验证,以理论测速精度0.1 m/s的GPS速度信号为参考速度,本文方法平均相对测速误差少于1.37%,最大相对测速误差少于6.13%.实验结果表明,提出的新方法有效提高了车载视觉测速精度与鲁棒性,可为多元车载视觉测速方法融合提供理论支撑.
Vehicle-mounted monocular visual velocity measurement method based on MaxViT and improved geometric feature point method
Vehicle-mounted visual speed measurement technology,as an important component of composite speed measurement technology for autonomous vehicles,is characterized by low hardware costs,strong algorithm scalability,and accurate measurements at low speeds,offering broad application prospects. To further improve the accuracy and robustness of visual speed measurement algorithms under various working conditions,this article combined the advantages of geometric feature point methods for high accuracy when sufficient feature points were available and deep learning methods for stable speed measurement in multiple scenarios. A vehicle-mounted monocular visual speed measurement algorithm was propose based on MaxViT and an improved geometric feature point method. This algorithm constructed a dual-channel,parallel processing system based on a dual-input MaxViT network and an improved geometric feature point method. This could continuously process a sequence of three input images obtained from the forward-facing camera of the vehicle. It estimated the current vehicle speed in a rolling manner. The dual-input MaxViT network differentially extracted optical flow features from different regions of the images,and estimated the velocity interval with a confidence level of 90% where the current velocity lied. The improved feature point method could calculate the current velocity estimate based on the motion of feature points. If the velocity estimate falls within the velocity interval estimated by the dual-input MaxViT network,it was used as the real-time vehicle velocity measurement value. Otherwise,the midpoint of the velocity interval was used as the real-time vehicle velocity measurement value. After running the algorithm for multiple frames,the midpoint of the velocity interval was used as the velocity output for the current frame to reduce cumulative errors. Experimental verification was conducted using a self-built dataset containing six different vehicle velocity,including velocity below 40 kilometers per hour and various driving scenarios such as acceleration,deceleration,and straight and curved roads. The theoretical velocity accuracy of GPS velocity signals was used as a reference velocity with an accuracy of 0.1 m/s. The proposed method can achieve an average relative velocity measurement error of less than 1.37% and a maximum relative velocity measurement error of less than 6.13%. The experimental results demonstrate that the proposed approach effectively enhances the accuracy and robustness of vehicle-mounted visual velocity measurement,providing theoretical support for the integration of diverse vehicle-mounted visual velocity measurement methods.

vehicle velocity measurementvisual velocity measurementdual-input-MaxViT networkcharacteristic point methodverification output

韩锟、田文涛、李蔚、樊运新、张浩波

展开 >

中南大学 交通运输工程学院,湖南 长沙 410075

重载快捷大功率电力机车全国重点实验室,湖南 株洲 412000

车载车辆测速 视觉测速 双输入MaxViT网络 特征点法 验证输出

重载快捷大功率电力机车全国重点实验室开放基金

QZKFKT2023-012

2024

铁道科学与工程学报
中南大学 中国铁道学会

铁道科学与工程学报

CSTPCD北大核心EI
影响因子:0.837
ISSN:1672-7029
年,卷(期):2024.21(5)
  • 16