首页|基于DQN算法的泵站供水系统节能控制优化

基于DQN算法的泵站供水系统节能控制优化

扫码查看
针对手动调节泵站中水泵运行的转速和启停会造成严重的能量浪费问题,引入基于深度Q网络(deep Q-learning network,DQN)的强化学习算法,通过获取当前泵组运行的状态,自动优化水泵组工作时各个水泵的运行参数,在各个水泵均处于高效区的前提下,提高水泵组的整体效率。对水泵组状态优化问题分别进行了数学描述和马尔可夫决策过程描述。同时定义了水泵组运行时的状态空间、动作空间和即时奖励值,构建DQN网络,并以深圳市M水厂为算例,在由Gym构建的自定义仿真环境中进行验证。相较于人工调控,DQN算法调控降低了 8。84%的损失能耗,一年可节省吨水电耗达 1。27×10-2 kW·h/t,实现了节能减排,具有良好的经济效能。同时,DQN算法可通过在线学习的方式适应供水环境的变化,具有自主性、实时性、可推广性等优点。
Optimization of Energy-Saving Control for Pumping Station Water Supply System Based on DQN Algorithm
To address the issue of significant energy waste caused by manually adjusting the running speed and start-stop of the pumps in the pump station,the deep Q-learning network(DQN)algorithm was introduced to automatically optimize the operation of each pump during the operation of the pump unit by obtaining the current operating status.Operating parameters,on the premise that each pump was in the high-efficiency area,improved the overall efficiency of the pump unit.The state optimization problem of the pump unit was described mathematically and using the Markov decision process.At the same time,the state,action and reward value of the pump unit were defined,and a DQN network was established.As an example,Shenzhen M WTP was validated verified in a custom simulation environment built by Gym.Compared to manual regulation,DQN algorithm regulation reduced the loss of energy consumption by 8.84%,and could save electricity consumption per tons of water by 1.27×10-2 kW·h/t a year,which contributing to energy saving,emission reduction,and good economic.At the same time,the DQN algorithm,which had the advantages of autonomy,real-time,and generalizability,could adapt to changes in the water supply conditions through online learning.

pumping station water supplyoptimal controlingDQN algorithmMarkov decision processenergy saving and emission reduction

陈财会、张天、黄健康、金典、王卓悦、张小磊

展开 >

哈尔滨工业大学<深圳>土木与环境工程学院,深圳 518055

泵站供水 优化调度 DQN算法 马尔可夫决策过程 节能减排

深圳市可持续发展科技专项哈尔滨工业大学(深圳)课程教学项目

KCXFZ20201221173602008HITSZERP21003

2024

净水技术
上海市净水技术学会,上海市城乡建设和交通委员会科学技术委员会办公室

净水技术

CSTPCD
影响因子:0.643
ISSN:1009-0177
年,卷(期):2024.43(4)
  • 12