首页|Constrained reinforcement learning with statewise projection:a control barrier function approach

Constrained reinforcement learning with statewise projection:a control barrier function approach

扫码查看
Safety is a critical issue for reinforcement learning(RL),as it may be risky for some actual appli-cations if the learning process involves unsafe exploration.Instead of formulating constraints as expectation-based in constrained RL,considering statewise safety in constrained RL is more meaningful.This work aims to address the issue of safe projection in RL by introducing a control barrier function that inherently learns a safe policy through a set certificate.We seek to analyze some theoretical properties of safe projection in the learning process,including convergence and performance bound,and extend the discussion into ensembles and guided controllers.Moreover,we approach analytical solutions for deterministic and stochastic system dynamics.Experimental results in different tasks show that the proposed method achieves better effects in terms of both performance and safety.

reinforcement learningsafe projectioncontrol barrier function

Xinze JIN、Kuo LI、Qingshan JIA

展开 >

Department of Automation,Tsinghua University,Beijing 100084,China

国家重点研发计划国家自然科学基金国家自然科学基金国家自然科学基金清华大学自主科研项目

2022YFA1004600621253046207318262192751

2024

中国科学:信息科学(英文版)
中国科学院

中国科学:信息科学(英文版)

CSTPCDEI
影响因子:0.715
ISSN:1674-733X
年,卷(期):2024.67(3)
  • 32