Research on Heterogeneous Data Hybrid Collection System Model for Power Big Data
Traditional data warehouses have a lot of redundant data during construction,and IoT systems have duplicate deployments,forming logical islands between data,thereby reducing data operational efficiency.For this purpose,a power data warehouse system based on a hybrid collection scheme for heterogeneous data of power big data was studied.A unified management of power data warehouse was built to provide unified data services for all relevant application software within the jurisdiction of power enterprises;using real data from 25 substations over the past year for data simulation on the Simu Works platform,it was found that the new solution can save over 85％of data warehouse hardware facilities,improve data analysis accuracy by approximately 82.7％,and achieve energy savings of over 50％in IDC unit rooms.Using the scheme,the data management algorithm has been fully simplified,and the data read and write response time has also been significantly improved.The results indicate that using the heterogeneous data mixed collection system model designed in this article can improve data management efficiency and read/write response time,thereby improving the effectiveness of data usage.
power big datadata warehouseheterogeneous datahybrid collectioninformation management
NETL
NSTL
万方数据
