Design of Heterogeneous Data Storage for Poloidal Field Power Supply System Based on HBase
The polar field power supply system is an important component of the EAST device.The operation of the EAST device and the daily operation and maintenance of the power system can not only generate massive structured tem-poral data,but also produce unstructured data files such as documents,tables,audio,and video.Since traditional rela-tional databases and MDSplus databases in the fusion field cannot meet the unified storage and management of heteroge-neous data,this paper build a distributed cluster,and select Distributed database HBase.A row key design based on time series is proposed to achieve balanced data distribution and improve the reading efficiency of parallel access nodes.A file consolidation strategy design based on BFD algorithm is also proposed to achieve efficient consolidation of small files,and make full use of data block storage space.The experimental results indicate that this heterogeneous data storage design scheme meets the storage requirements.
poloidal power supplydistributed storagerow key designfile compacting
万方数据
维普
