首页|Learning to schedule multi-NUMA virtual machines via reinforcement learning

Learning to schedule multi-NUMA virtual machines via reinforcement learning

扫码查看
With the rapid development of cloud computing, the importance of dynamic virtual machine scheduling is increasing. Existing works formulate the VM scheduling as a bin-packing problem and design greedy methods to solve it. However, cloud service providers widely adopt multi-NUMA architecture servers in recent years, and existing methods do not consider the architecture. This paper formulates the multiNUMA VM scheduling into a novel structured combinatorial optimization and transforms it into a reinforcement learning problem. We propose a reinforcement learning algorithm called SchedRL with a delta reward scheme and an episodic guided sampling strategy to solve the problem efficiently. Evaluating on a public dataset of Azure under two different scenarios, our SchedRL outperforms FirstFit and BestFit on the fulfill number and allocation rate. (c) 2021 Elsevier Ltd. All rights reserved.

Dynamic virtual machine schedulingMulti-NUMAReinforcement learningCloud computingRESOURCE-ALLOCATION

Jin, Bo、Wang, Jun、Wang, Xiangfeng、Zhu, Lei、Sheng, Junjie、Hu, Yiqiu、Zhou, Wenli

展开 >

East China Normal Univ

Huawei Cloud Huawei Technol Co Ltd

2022

Pattern Recognition

Pattern Recognition

EISCI
ISSN:0031-3203
年,卷(期):2022.121
  • 7
  • 45