首页|Deep reinforcement learning based active surge control for aeroengine compressors

Deep reinforcement learning based active surge control for aeroengine compressors

扫码查看
原文链接
  • NETL
  • NSTL
  • 万方数据
This study proposes an active surge control method based on deep reinforcement learn-ing to ensure the stability of compressors when adhering to the pressure rise command across the wide operating range of an aeroengine.Initially,the study establishes the compressor dynamic model with uncertainties,disturbances,and Close-Coupled Valve(CCV)actuator delay.Building upon this foundation,a Partially Observable Markov Decision Process(POMDP)is defined to facilitate active surge control.To address the issue of unobservability,a nonlinear state observer is designed using a finite-time high-order sliding mode.Furthermore,an Improved Soft Actor-Critic(ISAC)algorithm is developed,incorporating prioritized experience replay and adaptive tem-perature parameter techniques,to strike a balance between exploration and convergence during training.In addition,reasonable observation variables,error-segmented reward functions,and ran-dom initialization of model parameters are employed to enhance the robustness and generalization capability.Finally,to assess the effectiveness of the proposed method,numerical simulations are conducted,and it is compared with the fuzzy adaptive backstepping method and Second-Order Sliding Mode Control(SOSMC)method.The simulation results demonstrate that the deep rein-forcement learning based controller outperforms other methods in both tracking accuracy and robustness.Consequently,the proposed active surge controller can effectively ensure stable opera-tion of compressors in the high-pressure-ratio and high-efficiency region.

Aeroengine surgeActive surge controlMoore-Greitzer modelDeep reinforcement learningSoft actor-criticNonlinear observer

Xinglong ZHANG、Zhonglin LIN、Runmin JI、Tianhong ZHANG

展开 >

College of Energy and Power Engineering,Nanjing University of Aeronautics and Astronautics,Nanjing 210016,China

School of Mechanical Engineering and Automation,Fuzhou University,Fuzhou 350108,China

National Natural Science Foundation of ChinaScience Center for Gas Turbine Project,ChinaChina Scholarship Council

51976089P2023-B-V-001-001202306830092

2024

10.1016/j.cja.2024.03.028

中国航空学报(英文版)
中国航空学会

中国航空学报(英文版)

CSTPCDEI
影响因子：0.847
ISSN：1000-9361
年,卷(期)：2024.37(7)
  • 1