激光与红外2024,Vol.54Issue(9) :1373-1379.DOI:10.3969/j.issn.1001-5078.2024.09.006

图像与稀疏激光点融合的单目深度估计

Monocular depth estimation based on image and sparse laser point fusion

蔡文靖 刘鑫 王礼贺 纪宇航
激光与红外2024,Vol.54Issue(9) :1373-1379.DOI:10.3969/j.issn.1001-5078.2024.09.006

图像与稀疏激光点融合的单目深度估计

Monocular depth estimation based on image and sparse laser point fusion

蔡文靖 1刘鑫 1王礼贺 1纪宇航1
扫码查看

作者信息

  • 1. 华北光电技术研究所,北京 100015
  • 折叠

摘要

近年来,随着深度学习的快速发展,涌现出大量单目深度估计算法.但由于缺乏视差等几何约束,限制了算法深度预测精度的进一步提升,无法满足实际应用的需求.因此本文提出了 一个二维图像与稀疏激光点融合的深度估计网络,通过实时输入少量激光点的高精度测距结果,提高深度预测精度;其次,为解决自采集数据激光雷达点分布不均匀问题,在有监督网络基础上,加入相对位姿估计网络与深度估计网络联合训练,同时增加光度一致性、深度重投影两个损失函数;最终,利用自采集数据进行实验分析,实验结果表明,当使用160个激光点时,即可将深度预测绝对相对误差由10.1%降至7.6%,当使用1280个激光点时,深度预测绝对相对误差变化趋于平稳,降至4.1%.

Abstract

In recent years,with the rapid development of deep learning,a large number of monocular depth estimation algorithms have emerged.However,the lack of geometric constraints such as disparity,the depth prediction accuracy limits the further improvement of the depth prediction accuracy of the algorithm and fails to meet the needs of practical applications,soa depth estimation network that integrates images with sparse laser points is proposed in this paper.Firstly,the depth prediction accuracy is improved by inputting the high-precision ranging results of a small number of laser points in real time.Secondly,in order to solve the problem of uneven distribution of LiDAR points from self-col-lected data,on the basis of the supervised network,the relative position estimation network is added to be trained joint-ly with the depth estimation network.And two loss functions of luminance consistency and depth reprojection are add-ed at the same time.Finally,the self-collected data are utilized to conduct the experimental analysis,and the experi-mental results show that when 160 laser points areused,the absolute relative error of depth prediction can be reduced from 10.1%to 7.6%,and when 1280 laser points are used,the change of the absolute relative error of depth predic-tion tends to stabilize to 4.1%.

关键词

单目深度估计/稀疏激光点/残差神经网络

Key words

monocular depth estimation/sparse laser points/residual neural network

引用本文复制引用

出版年

2024
激光与红外
华北光电技术研究所

激光与红外

CSTPCDCSCD北大核心
影响因子:0.723
ISSN:1001-5078
参考文献量14
段落导航相关论文