Multi-stage Rocket Mission Decision Based on Approximate Dynamic Programming
A multistage mission decision method based on approximate dynamic programming is proposed to solve the problem of mission decision in the case of launch vehicle thrust drop faults.Firstly,a hierarchical reinforcement learning model for launch vehicle mission decision is established by setting the initial state set,decision options,reward function,Q-function iteration,etc.,and an"evaluation network"is obtained to evaluate the subsequent flight of the rocket.Then,an online capability evaluation and trajectory planning method based on convex optimization is used to obtain the"decision generation"module in the frame structure of approximate dynamic programming.Finally,the decision of continuous trajectory and discrete orbital parameters at all levels of each flight stage under launch vehicle failure is completed by combining the two parts.Numerical simulation results show that the multistage launch vehicle mission decision is effectively in the event of launch vehicle thrust failures by the proposed method.