首页|基于多模态数据融合的物资识别及定位方法分析

基于多模态数据融合的物资识别及定位方法分析

扫码查看
阐述针对电力大型仓库室内外场景下物资盘点的需求,提出一种基于激光雷达与相机融合的物资检测定位方法.采用激光雷达对物资堆场区域采集三维点云,利用深度神经网络算法识别图像中物资区域,通过坐标系之间转换和预先标定的内外参数将点云与图像进行映射,准确得到物资空间位置信息.在仓储场景下对算法进行融合检测,结果表明,基于激光雷达与相机的融合检测方法能够实时识别并定位物资的精确位置.
Analysis of Material Identification and Localization Method Based on Multimodal Data Fusion
This paper describes a material detection and localization method based on the fusion of LiDAR and camera data in response to the demands of material inventory in large-scale indoor and outdoor power warehouses.The method utilizes a LiDAR to collect three-dimensional point clouds of the material storage area and employs a deep instance segmentation algorithm to identify material regions in the images.By mapping the point clouds to the images through coordinate system transformation and pre-calibrated intrinsic and extrinsic parameters,precise spatial location information of the materials is obtained.The algorithm is evaluated in indoor and outdoor scenarios,and the results indicate that the fusion detection method based on LiDAR and camera can accurately identify and localize materials in real time.

multimodalLiDARidentification and localization

王骊、翁慧颖、孙小江、张莹

展开 >

国网浙江省电力有限公司物资分公司,浙江 310003

多模态 激光雷达 识别与定位

2024

电子技术
上海市电子学会,上海市通信学会

电子技术

影响因子:0.296
ISSN:1000-0755
年,卷(期):2024.53(11)