分布式数据中心制冷控制的深度强化学习算法
Deep reinforcement learning algorithm for cooling control in distributed data center
张立 1陈丁 2万剑雄 2李雷孝2
作者信息
- 1. 内蒙古气象局 内蒙古自治区气象信息中心,内蒙古呼和浩特 010051
- 2. 内蒙古自治区基于大数据的软件服务工程技术研究中心数据科学与应用学院,内蒙古呼和浩特 100080
- 折叠
摘要
为对数据中心空调送风温度与送风速度进行智能控制,降低数据中心制冷能耗,提出一种基于多智能体强化学习的数据中心空调制冷控制方法.所有空调智能体的制冷策略联合训练使其能合作制冷,设置温度约束保证设备在安全温度下运行.在不断与环境模型交互的过程中获得经验,通过经验优化控制方法,以更加节能的方式保证数据中心的正常工作.仿真结果表明,与单智能体强化学习的CCA方法相比,所提方法在分布式数据中心环境中,降低了 14.1％的空调功耗与18.09％的温度违约惩罚.
Abstract
To reduce the cooling energy consumption of the data center,a multi-agent reinforcement learning based air conditio-ning and cooling control method was proposed.The cooling strategies of all air conditioning agents were jointly trained for efficient cooperative cooling,and temperature constraints were set to ensure that the equipment operated at a safe temperature.The experience was gained from continuous interactions with environmental models and the control policy was optimized through experience to ensure the normal operation of the data center in a more energy-saving manner.The simulation results show that the proposed method reduces the air-conditioning power consumption by 14.1％and the temperature penalty by 18.09％in the distributed data center cooling control environment compared with the single agent CCA method.
关键词
数据中心/送风速度/送风温度/强化学习/多智能体环境/合作制冷/温度约束Key words
data center/air supply speed/air supply temperature/reinforcement learning/multi-agent environment/cooperative cooling/temperature constraint引用本文复制引用
基金项目
国家自然科学基金(61862048)
内蒙古自治区重点研发与成果转化计划(2021CG0033)
内蒙古自治区重点研发与成果转化计划(2022YFSJ0013)
内蒙古自治区高等学校青年科技英才支持计划(NJYT22084)
内蒙古自治区直属高校基本科研业务费基金(JY20220078)
出版年
2024
NETL
NSTL
维普
万方数据