首页|Deep Reinforcement Learning design of safe, stable and robust control for sloshing-affected space launch vehicles
Deep Reinforcement Learning design of safe, stable and robust control for sloshing-affected space launch vehicles
扫码查看
点击上方二维码区域，可以放大扫码查看
原文链接
NETL
NSTL
Elsevier
New challenges in spatial missions and the design of new launchers entail a focus on innovative control strategies. Recent developments in Machine Learning (ML) for optimization processes shed light on the possibilities offered for controlling complex nonlinear partially unknown systems. This work focuses on the use of these methods to design control laws stabilizing the sloshing of propellants in tanks during launcher flight. A major hurdle in applying control laws designed by Artificial Intelligence (AI) to safety-critical systems lies in certifying stability and safety. Using Control Lyapunov Function (CLF) and Control Barrier Function (CBF) developed in Control Theory approaches, closed-loop stability and safety in terms of state constraints can be verified. Considering a Deep Reinforcement Learning (DRL) framework, an algorithm is developed to learn a control policy along with stability and safety certificates. The CLF and CBF conditions are integrated in the DRL algorithm, bridging the gap between Control Theory and Machine Learning techniques. A safe and stable DRL controller is then learned on a simulated launcher subject to sloshing with uncertainties and perturbations due to sloshing. A robustness study with Monte Carlo simulations is conducted to evaluate performance under various conditions. Finally, the developed controller is validated on an industrial simulator that more accurately models the real behavior of the launcher. Despite not being trained on this industrial simulator, the controller matches control objectives, demonstrating robustness and performance.
Launch vehicles controlReinforcement learning
Pericles Cocaul、Sylvain Bertrand、Helene Piet-Lahanier、Lori Lemazurier、Martine Ganet
展开 >
Universite Paris-Saclay, ONERA, Departement Traitement de l'Information et Systemes, Av. de la Vauve aux Granges, 91123, Palaiseau, France
ArianeGroup SAS, 66 Route de Verneuil, 78130, Les Mureaux, France
Formerly ArianeGroup SAS, now Maiaspace, 92400, Courbevoie, France
NETL
NSTL
Elsevier
