At present,the research on distributed energy cluster scheduling is mostly limited to a single scenario and lacks efficient and accurate algorithms.Aiming at these problems,this paper proposed a multi-scenario scheduling method for distributed energy clusters based on evolutionary algorithm experience-guided deep reinforcement learning(EA-RL).The individual models of power supply,energy storage and load in distributed energy cluster were estab-lished,respectively.Based on the individual scheduling model,a multi-scenario distributed energy cluster optimal scheduling model including auxiliary peak regulation and frequency modulation was established.Based on the frame-work of evolutionary reinforcement learning algorithm,an EA-RL algorithm was proposed.The algorithm combines ge-netic algorithm(GA)and deep deterministic policy gradient(DDPG)algorithm.The empirical sequence was used as the individual of genetic algorithm for crossover,mutation and selection.The high-quality experience was selected to join the DDPG algorithm experience pool to guide the training of the agent to improve the search efficiency and conver-gence of the algorithm.According to the multi-scenario scheduling model,the state space and action space of the multi-scenario scheduling problem of distributed energy cluster were constructed.Then,the reward function was con-structed by minimizing the scheduling cost,the deviation of the auxiliary service scheduling instruction,the over-limit power of the tie line and the power difference between the source and the load,and the reinforcement learning model was established.To validate the effectiveness of the proposed algorithm and model,offline training of scheduling agents was conducted based on multi-scenario simulation cases,resulting in agents capable of adapting to various grid scenarios.Verification was carried out through online decision-making,and their scheduling decision-making capa-bilities were assessed based on decision outcomes.The validity of the algorithm was further verified through compari-son with the DDPG algorithm.Finally,the trained agents undergo 60 consecutive days of online decision-making tests incorporating varying degrees of disturbances to validate their posterior effectiveness and robustness.
distributed energy clusterdeep reinforcement learningevolutionary reinforcement learning algorithmintegrated scheduling for multiple scenarios
维普
万方数据
