黑龙江科学2024,Vol.15Issue(20) :1-6.

基于三向量网格的多视图表面重建研究

Multi-view Surface Reconstruction Based on Trivector Grid

赵凯 南海 韩雪飞 赵冬杰 李戴薪 郑颖
黑龙江科学2024,Vol.15Issue(20) :1-6.

基于三向量网格的多视图表面重建研究

Multi-view Surface Reconstruction Based on Trivector Grid

赵凯 1南海 1韩雪飞 1赵冬杰 1李戴薪 1郑颖2
扫码查看

作者信息

  • 1. 重庆理工大学计算机科学与工程学院,重庆 400054
  • 2. 水又繁芯(重庆)科技有限公司,重庆 400000
  • 折叠

摘要

利用符号距离场(SDF)进行表面重建是3D重建的一种常见策略.针对当前基于显示网格的表面重建存在的分辨率难以提高、重建表面精确度受到限制的问题,提出三向量网格和多层感知机(MLP)共同重建符号距离场(SDF)的方法.三向量网格的分辨率与内存增长呈线性关系,分辨率容易提高到更高水平,相比纯粹使用MLP具有更好的拟合能力.该方法使用自注意力卷积生成不同频带上的特征,以减少网格离散性并增加非线性表示能力.对三向量特征嵌入位置编码,通过引入归纳偏差,对抗表面重建过程中的噪声.针对复杂曲面难以拟合的问题,提出一种数据采样的优化方法,在复杂曲面附近提高采样频率.实验结果表明,该方法在DTU数据集上的表面重建精度优于最先进的方法4%.

Abstract

Surface reconstruction using Signed Distance Fields(SDF)is a prevalent strategy in 3D reconstruction.The study proposes a method that jointly reconstructs SDF with a Trivector grid and a Multilayer Perceptron(MLP),the limitations of achieving a higher resolution and precisely reconstructing surfaces encountered with the existing display grid-based surface reconstruction.The resolution of the Trivector grid exhibits a linear relationship with memory growth,allowing easy scaling to higher levels.This method outperforms singular MLP with enhanced fitting capabilities.The self-attention convolution is used to generate features on different frequency bands,reducing grid discretization and increasing non-linear representation capacity.Moreover,location encoding is embedded into the Trivector feature vectors to combat noise during the surface reconstruction process by introducing inductive bias.Finally,an optimized data sampling method is proposed for dealing with the challenges of fitting complex surfaces,by increasing the sampling frequency around complex surfaces.Experimental results demonstrate that the proposed method surpasses the most advanced ones by 4%in terms of surface reconstruction accuracy on the DTU dataset.

关键词

深度学习/计算机视觉/表面重建

Key words

Deep learning/Computer vision/Surface reconstruction

引用本文复制引用

出版年

2024
黑龙江科学
黑龙江省科学院

黑龙江科学

影响因子:1.014
ISSN:1674-8646
段落导航相关论文