A Trajectory Planning Method Based on DQN Variable Dynamic Intelligent Decision
The aerospace craft faces difficulty in maintaining emergency lateral maneuver to avoid obstacle due to aerodynamic deficiency.Therefore,a trajectory planning method based on DQN variable dynamic intelligent decision is proposed.According to the kinematics equations for variable dynamic aerospace craft,the longitudinal guidance law based on range error and the lateral guidance law based on line-of-sight angle deviation are designed to respectively correct the heeling angle amplitude and symbol in real time,which ensures the terminal guidance accuracy and safety.In consideration of variable dynamic intelligent decision,the dynamic gear switching problem of aerospace craft is transformed into a Markov decision process.Then,the angle of attack,Mach,and relative distance from the aerospace craft to obstacle are taken as the state space,and the power gear position of aerospace craft is used as the action space.A reward function,considering the lowest collision probability and the smallest terminal error,is designed.and a DQN network is constructed to train the agent to obtain the best power gear.The simulated results show that the proposed algorithm can enable the aerospace craft to improve the lateral maneuverability during moving under the terminal constraints.