Standardized development and practical implementation of real-time data services for intelligent oilfields based on a data lake platform
Intelligent oilfield application development involves a wide variety of data with large amount,from diverse sources and different standards.The Exploration and Production(E&P)data lake platform is positioned to build a bridge between data sources and data applications.The collected raw data is standardized,aggregated and processed in the data lake and encapsulated into standardized services for application systems to call,thereby realizing the separation from data resources to data applications.This paper summarizes the work related to the migration of real-time data services into data lake and the standardized transformation during one intelligent oilfield project.Then a standardized approach for real-time data services development in intelligent oilfield based on the data lake platform is proposed,which has been implemented and verified by using data lake real-time development tool to standardize the real-time data services and then migrate into data lake.This research provides new method and tool support for the digital and intelligent transformation of oil and gas enterprises to improve the efficiency and quality of industrial big data ap-plication development.
data lakeintelligent oilfieldreal-time data servicestandardized developmentdata governance