Implementation of data storage architecture and unified metadata for geological data lake
Geological data has the charactertistics of multiple-source heterogeneous and massive,and the effective management and rapid retrieval of data have always been the main technical challenges for geological technicians.Taking the construction of geological data lake system for Hubei Geolocical Bureau as an example,this paper proposes a framework scheme for geological data lake under massive multi-source heterogeneous data environment,which depends on the principle of separate computing from storage.By building a hybrid storage as data pedestal,this paper realizes various types of geological data collected and stored in its raw form.In condition of physical isomerism and unified service,this paper establishes a unified metadata service management model for geological data lake,develops the unified view management function of hybrid physical storage data and completes the construction of a basic platform supporting various geological data management and analysis service applications.
geological data lakebig datahybrid storage architectureunified metadata
万方数据
维普
