首页|基于NeRF的城市实景高精度三维建模技术

基于NeRF的城市实景高精度三维建模技术

扫码查看
为了更好地将NeRF高精度三维建模应用于城市实景三维数字化重建,本文基于NeRF技术将大型场景划分为子NeRF,通过在场景内构造多个正八面体初始化多边形网格,并在训练过程中不断优化多边形面的顶点.训练完成后,得到编码器-解码器网络的权重,通过顶点优化对每个独立块进行不同层次的多边形网格细化.从视图范围捕获城市概览的卫星级图像到显示建筑复杂细节的地面级图像变化,构建面向城市细节层级(level-of-detail)和空间覆盖范围的多尺度数据,通过渐进式学习(progressive learning)神经网络体素渲染模型,使用多层感知器(MLP)实现体积密度和颜色的参数化,采用分层抽样方法实现预定义视角近平面和远平面之间光线的排序距离向量,实现大规模场景的实时交互式渲染.然后将GIS与NeRF相融合,为多数据融合、查询、分析、测量、标注和共享等任务提供了全新的解决方案,实现即时、流畅地拖拽、缩放和360°无死角地浏览和观看场景,这种融合可以轻松地将各种数据源整合,应用于城市规划、土地管理和环境监测等三维场景中,以进行空间分析.
High-precision 3D modeling technology of urban real scene based on NeRF
In order to better apply NeRF high-precision 3D modeling in the 3D digital reconstruction of urban real scenes,this paper divides the large scene into sub-NeRF based on NeRF technology,and initializes the polygon mesh by constructing multiple octahedral bodies in the scene.And the vertices of the polygon faces are continuously optimized during the training process.After the training is completed,the weights of the encoder-decoder network are obtained,and different levels of polygon mesh refinement are performed on each independent block through vertex optimization.From satellite-level images that capture city overviews to ground-level images that show complex details of buildings,multi-scale data for urban detail and spatial coverage are constructed through progressive learning.The neural network voxel rendering model uses a multilayer perceptron(MLP)to realize the parameterization of volume density and color,and uses a hierarchical sampling method to realize the sorting distance vector of rays between the near plane and the far plane of a predefined viewing angle,so as to realize real-time interactive rendering of large-scale scenes.Then,GIS and NeRF are fused to provide a new solution for tasks such as multi-data fusion,query,analysis,measurement,annotation and sharing,so as to achieve instant and smooth dragging,zooming and 360° browsing and viewing of scenes without dead ends.This fusion makes it easy to integrate various data sources for spatial analysis in 3D scenarios such as urban planning,land management and environmental monitoring.

3D modelingNeRF neural radiance fieldtrainingrendering

孙建华、李巍、袁伟哲、王峰、谷佳铭

展开 >

杭州市规划和自然资源调查监测中心 ,浙江 杭州 310012

上海德程数据技术有限公司,上海 200040

浙江数维科技有限公司,浙江杭州 310005

三维建模 NeRF神经辐射场 训练 渲染

2024

测绘通报
测绘出版社

测绘通报

CSTPCD北大核心
影响因子:1.027
ISSN:0494-0911
年,卷(期):2024.(4)
  • 16