首页|基于扩散模型的条件聚合三维点云重建方法

基于扩散模型的条件聚合三维点云重建方法

扫码查看
随着计算机视觉技术的发展,利用图像进行三维点云重建已成为连接现实世界与数字世界的关键技术,现有的研究更多地应用全局图像特征推断物体的合理形状和外观,导致重建的三维点云细节缺失.为解决这一问题,在扩散模型基础上,引入条件聚合方法融合图像信息作为扩散条件,构建条件扩散的三维点云重建网络模型,利用图像特征提取模块捕捉图像特征,充分挖掘图像信息,采用投影变换聚合点云与对应的局部图像信息,使扩散模型关注点云中每一个点的重建过程,提高三维点云重建的精度和细节表现.在ShapeNet数据集上的对比和消融实验表明,该模型能够充分利用图像信息,增强重建结果的细节表现力,提高重建性能.
A Conditional Aggregation 3D Point Cloud ReconstructionMethod Based on Diffusion Model
With the development of computer vision,the use of images for 3D point cloud reconstruction has become a key technology to connect the real physical world and the digital world.Existing research often applies more global im-age features to infer objects with reasonable shapes and appearances,resulting in reconstruction The 3D point cloud has the problem of missing details.In order to solve this problem,based on the diffusion model,aconditional aggregation method is introduced to fuse image information as diffusion conditions,and a conditional diffusion three-dimensional point cloud reconstruction network model(CDPRN)is constructed,and the image feature extraction module is used to capture Image features,fully mining image information,using projection transformation to aggregate point clouds and corresponding local image information,allowing the diffusion model to focus on the reconstruction process of each point in the point cloud,improving the accuracy and detail performance of three-dimensional point cloud reconstruction.Comparison and ablation experiments on the ShapeNet data set show that CDPRN can make full use of image informa-tion,enhance the detail expression of the reconstruction results,and improve reconstruction performance.

diffusion model3D point cloud reconstructionconditional aggregation

冯泽、章建峰、韩光照、王兴梅

展开 >

哈尔滨工程大学计算机科学与技术学院,哈尔滨 150001

上海船舶设备研究所,上海 200031

哈尔滨电气集团海洋智能装备有限公司,哈尔滨 150028

扩散模型 三维点云重建 条件聚合

2024

航空电子技术
中国航空无线电电子研究所

航空电子技术

影响因子:0.349
ISSN:1006-141X
年,卷(期):2024.55(2)