Distributed Storage and Access Optimization Framework for Big Data
This article proposes a distributed storage and access optimization framework for big data,addressing the challenges of storage and access in the era of big data.The overall framework design is proposed,clarifying the overall architecture and functional modules of the distributed storage and access system.In response to the issue of data storage,optimization methods for data compression and storage technology were studied to improve storage efficiency and data reliability.A data access optimization method based on load balancing was studied to address the issue of distributed access,in order to improve the overall performance and throughput of the system.Through analysis and discussion,the characteristics and improvement space of the method were explored,providing a reference for further research on distributed storage and access technology.
big datadistributed storagewavelet transformload balancing
NETL
NSTL
万方数据
