首页|Hierarchical Task Planning for Power Line Flow Regulation

Hierarchical Task Planning for Power Line Flow Regulation

扫码查看
The complexity and uncertainty in power systems cause great challenges to controlling power grids.As a popu-lar data-driven technique,deep reinforcement learning(DRL)attracts attention in the control of power grids.However,DRL has some inherent drawbacks in terms of data efficiency and explainability.This paper presents a novel hierarchical task planning(HTP)approach,bridging planning and DRL,to the task of power line flow regulation.First,we introduce a three-level task hierarchy to model the task and model the sequence of task units on each level as a task planning-Markov decision processes(TP-MDPs).Second,we model the task as a sequential decision-making problem and introduce a higher planner and a lower planner in HTP to handle different levels of task units.In addition,we introduce a two-layer knowledge graph that can update dynamically during the planning procedure to assist HTP.Experimental results conducted on the IEEE 118-bus and IEEE 300-bus systems demonstrate our HTP approach outperforms proximal policy optimization,a state-of-the-art deep reinforcement learning(DRL)approach,improving efficiency by 26.16%and 6.86%on both systems.

Knowledge graphpower line flow regulation reinforcement learningtask planning

Chenxi Wang、Youtian Du、Yanhao Huang、Yuanlin Chang、Zihao Guo

展开 >

Ministry of Education Key Lab for Intelligent Networks and Network Security,Xi'an Jiaotong University,Xi'an 713599,China

State Key Laboratory of Power Grid Safety and Energy Conservation,China Electric Power Research Institute,Beijing 100192,China

National Key R&D Programscience and technology project of SGCC(State Grid Corporation of China)

2018AAA0101501

2024

中国电机工程学会电力与能源系统学报(英文版)
中国电机工程学会

中国电机工程学会电力与能源系统学报(英文版)

CSTPCDEI
ISSN:2096-0042
年,卷(期):2024.10(1)
  • 30