首页|分布式存储中基于动态局部修复码的负载均衡研究

分布式存储中基于动态局部修复码的负载均衡研究

扫码查看
分布式存储系统中数据的访问存在不均衡性,大多数访问聚集在少部分数据上,便会引起系统的负载不均衡,导致部分高负载节点成为整个系统的性能瓶颈.针对此问题提出一种负载均衡的动态局部修复码(ALRC),该编码方案通过历史热度对冷热数据进行优先级确立,再对冷热数据进行动态编码,使其具备(r,t)-availability性质,让数据能够拥有额外的访问路径,借此提高热数据的并行访问性能和系统的负载均衡性,同时兼顾一定的存储效率.实验结果表明,ALRC在系统负载较不均衡时只需要相较于编码前少量的额外存储开销,便可拥有相较于原方案53%以上负载均衡度的提升,从而确保节点间的负载分布均匀,提高整个系统的性能和可靠性.
Study on Load Balancing Based on Dynamic Local Repair Codes in Distributed Storage
In distributed storage systems,there is often an imbalance in data access.Most access is concentrated on a small portion of the da-ta,which can cause the system's load to be unbalanced,leading to some high load nodes becoming the performance bottleneck of the entire system.In response to the system load imbalance caused by this issue,this article proposes a dynamic local repair code(ALRC)for load bal-ancing.This encoding scheme establishes the priority of hot and cold data through historical heat,and dynamically adjusts the layout of hot and cold data through(r,t)-availability properties,allowing the data to have additional access paths,thereby improving the parallel access performance of hot data,system load balancing,and taking into account certain storage efficiency.According to the simulation experiment re-sults,it is shown that when the system load is relatively unbalanced,ALRC only needs a small amount of additional storage overhead com-pared to before encoding,which can improve the load balance by more than 53%compared to the original scheme,thereby helping to ensure uniform load distribution between nodes and improving the performance and reliability of the entire system.

distributed storagehot and cold dataload balancinglocal repair codeparallel access

邓文杰、唐聃

展开 >

成都信息工程大学软件工程学院

四川省信息化应用支撑软件工程技术研究中心,四川成都 610225

分布式存储 冷热数据 负载均衡 局部修复码 并行访问

四川省科技厅重点研发项目四川省科技厅重点研发项目

2022YFG00372022YFG0033

2024

软件导刊
湖北省信息学会

软件导刊

影响因子:0.524
ISSN:1672-7800
年,卷(期):2024.23(3)
  • 22