基于MDP的无人机避撞航迹规划研究
Research on UAV Collision Avoidance Path Planning Based on MDP
阚煌 1辛长范 1谭哲卿 1高鑫 1史铭姗 1张谦2
作者信息
- 1. 中北大学机电工程学院,太原 030051
- 2. 滨州魏桥国科高等技术研究院,山东滨州 256606
- 折叠
摘要
无人机(UAV)进行避撞前提下的目标搜索航迹规划是指在复杂且众多的环境障碍约束中通过合理规划飞行路径,以更快、更高效的形式找到目标;研究了无障碍环境条件下有限位置马尔科夫移动的规律,构建了相应的马尔科夫移动分布模型;在借鉴搜索系统航迹规划的前沿研究成果之上,结合马尔科夫决策过程理论(MDP),引入了负奖励机制对Q-Learning策略算法迭代;类比"风险井"的可视化方式将障碍威胁区域对无人机的负奖励作用直观地呈现出来,构建了复杂障碍约束环境下单无人机目标搜索航迹规划模型,并进行仿真实验证明该算法可行,对航迹规划算法的设计具有一定的参考意义.
Abstract
Target search path planning of UAVon the premise of collision avoidanceis to find the target in the faster and more effi-cient form by reasonable flight path planning in the complex and numerous environmental obstacles.Discussed the law of finite posi-tion Markov movement under barrier-free environment and constructed the corresponding Markov movement distribution model.Based on the cutting-edge research results of search system trajectory planning,combined with the MDP theory,the negative reward mechanism was innovatively introduced to iterate the Q-Learning strategy algorithm,and the single UAV target search model was constructed.By analogy with the"risk well"visualization method,the negative reward effect of the obstacle threat area on the UAV was intuitively presented,and the single UAV target search path planning model under complex obstacle constraint environment was constructed.and the simulation experiment showed that the algorithm is feasible,Which has certain reference significance for the de-sign of the route planning algorithm.
关键词
无人机/航迹规划/避撞/静态目标搜索/马尔科夫决策过程(MDP)/风险井Key words
UAV/path planning/collision avoidance/static target search/MDP(Markov decision process)/risk well引用本文复制引用
基金项目
教育部产学合作协同育人项目(231106429103427)
出版年
2024
NETL
NSTL
万方数据