The air source heat pumps(ASHP)exhibits good adjustability,and the accuracy of its modeling and the design of control strategies are key to fully exploiting its regulation potential.This paper considers the thermal storage characteristics of air source heat pump heating systems and proposes a temperature control strategy based on deep reinforcement learning(RL)for ASHP heating systems.First,a mathematical model of the ASHP heating system is established based on parameter identification.Then,a Markov decision process(MDP)model for the ASHP heating system is developed,and a temperature control strategy based on deep reinforcement learning is designed using the Q-learning algorithm.Simulation results based on real operating data demonstrate that the proposed heating system mathematical model,which accounts for heating delays,can accurately predict the variations in supply and return water temperatures as well as indoor temperatures.Furthermore,the proposed deep reinforcement learning-based temperature control strategy effectively reduces electricity costs while maintaining the indoor temperature at the set value.
关键词
空气源热泵/分时电价/强化学习/水温控制策略
Key words
air source heat pump/time of use pricing/reinforcement learning/water temperature control strategy
维普
万方数据