基于混合结构的多视图三维场景重建
Hybrid-structure based multi-view 3D scene reconstruction
周婧怡 1张栖桐 1冯结青1
作者信息
- 1. 浙江大学计算机辅助设计与图形系统全国重点实验室,浙江 杭州 310058
- 折叠
摘要
基于PatchMatch的多视图高效和高精度三维重建一直是一个挑战性问题.红黑棋盘格模式的传播方式并行计算效率高,但对应的视图选择策略精度较差;基于马尔可夫链的视图选择策略能获取更为准确的匹配结果,但算法并行度较低.为了达成场景重建质量与重建时间的平衡,本文提出了一种基于混合结构的多视图三维重建算法,在第一阶段采用沿行/列并行的传播策略和马尔可夫链式的视图选择策略,得到质量较高的初始深度图,并通过引入多层次处理提升弱纹理区域的重建质量;在第二阶段采用棋盘格式传播方式和基于投票的视图选择策略提高计算效率,缩短重建所需时间.通过在Strecha和ETH3D数据集上进行了大量实验和对比表明,本文算法在不降低计算精度的前提下,计算效率提高 2.5 倍以上.
Abstract
Achieving accurate and efficient 3D reconstruction through PatchMatch-based multi-view stereo(MVS)algorithms remains a challenging task.The red-black checkerboard propagation method offers high computational efficiency,yet its corresponding view selection strategy lacks accuracy.The view selection strategy based on Markov chain can obtain more accurate matching results,but lacks parallelism.To balance reconstruction quality and runtime,a hybrid-structure based multi-view 3D scene reconstruction algorithm was proposed.In the first stage,the algorithm employed a parallel row/col propagation strategy and a Markov chain-based view selection strategy to produce high-quality initial depth maps.Meanwhile,multi-level processing was utilized to improve the reconstruction quality of weak texture regions.In the second stage,checkerboard propagation and a voting-based view selection strategy were used to increase computational efficiency and reduce reconstruction time.Extensive experiments and comparisons on the Strecha and ETH3D datasets demonstrated that the proposed algorithm can generate results 2.5 times faster without accuracy reduction.
关键词
三维重建/多视图立体匹配/视图选择/传播策略/多层次处理Key words
3D reconstruction/multi-view stereo matching/view selection/propagation strategy/multi-level processing引用本文复制引用
基金项目
国家自然科学基金项目(61932018)
国家自然科学基金项目(62272408)
出版年
2024
NETL
NSTL
万方数据