Neural Networks2022,Vol.15212.DOI:10.1016/j.neunet.2022.04.013

Event-triggered integral reinforcement learning for nonzero-sum games with asymmetric input saturation

Xue, Shan Luo, Biao Liu, Derong Gao, Ying
Neural Networks2022,Vol.15212.DOI:10.1016/j.neunet.2022.04.013

Event-triggered integral reinforcement learning for nonzero-sum games with asymmetric input saturation

Xue, Shan 1Luo, Biao 2Liu, Derong 3Gao, Ying1
扫码查看

作者信息

  • 1. Sch Comp Sci & Engn,South China Univ Technol
  • 2. Sch Automat,Cent South Univ
  • 3. Dept Elect & Comp Engn,Univ Illinois
  • 折叠

Abstract

In this paper, an event-triggered integral reinforcement learning (IRL) algorithm is developed for the nonzero-sum game problem with asymmetric input saturation. First, for each player, a novel non quadratic value function with a discount factor is designed, and the coupled Hamilton-Jacobi equation that does not require a complete knowledge of the game is derived by using the idea of IRL. Second, the execution of each player is based on the event-triggered mechanism. In the implementation, an adaptive dynamic programming based learning scheme using a single critic neural network (NN) is developed. Experience replay technique is introduced into the classical gradient descent method to tune the weights of the critic NN. The stability of the system and the elimination of Zeno behavior are proved. Finally, simulation experiments verify the effectiveness of the event-triggered IRL algorithm. (C) 2022 Elsevier Ltd. All rights reserved.

Key words

Adaptive dynamic programming/Reinforcement learning/Event-triggered mechanism/Asymmetric input saturation/Experience replay/UNCERTAIN NONLINEAR-SYSTEMS/EXPERIENCE REPLAY/TRACKING CONTROL/FEEDBACK-CONTROL/APPROXIMATION/OPTIMIZATION/DESIGN

引用本文复制引用

出版年

2022
Neural Networks

Neural Networks

EISCI
ISSN:0893-6080
被引量11
参考文献量52
段落导航相关论文