防务技术2024,Vol.35Issue(5) :187-197.DOI:10.1016/j.dt.2023.11.013

Multi-UAV cooperative maneuver decision-making for pursuit-evasion using improved MADRL

Delin Luo Zihao Fan Ziyi Yang Yang Xu
防务技术2024,Vol.35Issue(5) :187-197.DOI:10.1016/j.dt.2023.11.013

Multi-UAV cooperative maneuver decision-making for pursuit-evasion using improved MADRL

Delin Luo 1Zihao Fan 1Ziyi Yang 1Yang Xu2
扫码查看

作者信息

  • 1. School of Aerospace Engineering,Xiamen University,Xiamen 361102,China
  • 2. School of Civil Aviation,Northwestern Polytechnical University,Xi'an 710072,China
  • 折叠

Abstract

Aiming at the problem of multi-UAV pursuit-evasion confrontation,a UAV cooperative maneuver method based on an improved multi-agent deep reinforcement learning(MADRL)is proposed.In this method,an improved CommNet network based on a communication mechanism is introduced into a deep rein-forcement learning algorithm to solve the multi-agent problem.A layer of gated recurrent unit(GRU)is added to the actor-network structure to remember historical environmental states.Subsequently,another GRU is designed as a communication channel in the CommNet core network layer to refine communication information between UAVs.Finally,the simulation results of the algorithm in two sets of scenarios are given,and the results show that the method has good effectiveness and applicability.

Key words

Reinforcement learning/UAV/Maneuver decision/GRU/Cooperative control

引用本文复制引用

基金项目

National Key Laboratory of Airbased Information Perception and Fusion()

航空科学基金(20220001068001)

国家自然科学基金(61673327)

Natural Science Basic Research Plan in Shaanxi Province,China(2023-JC-QN-0733)

China Industry-University-Research Innovation Foundation(2022IT188)

出版年

2024
防务技术
中国兵工学会

防务技术

CSTPCD
影响因子:0.358
ISSN:2214-9147
参考文献量20
段落导航相关论文