哈尔滨工程大学学报2024,Vol.45Issue(8) :1576-1589,1598.DOI:10.11990/jheu.202205010

基于强化学习的无人机智能组网技术及应用综述

Review of unmanned aerial vehicle intelligent networking technology and applications based on reinforcement learning

邱修林 宋博 殷俊 徐雷 柯亚琪 廖振强 杨余旺
哈尔滨工程大学学报2024,Vol.45Issue(8) :1576-1589,1598.DOI:10.11990/jheu.202205010

基于强化学习的无人机智能组网技术及应用综述

Review of unmanned aerial vehicle intelligent networking technology and applications based on reinforcement learning

邱修林 1宋博 2殷俊 3徐雷 2柯亚琪 2廖振强 4杨余旺2
扫码查看

作者信息

  • 1. 江苏科技大学 自动化学院,江苏 镇江 212100
  • 2. 南京理工大学 计算机科学与工程学院,江苏 南京 210094
  • 3. 南京邮电大学 江苏省宽带无线通信重点实验室,江苏 南京 210003
  • 4. 苏州高博软件技术职业学院 机电工程学院,江苏 苏州 215163
  • 折叠

摘要

针对无人机在民用和军事等领域中的研究热度及应用需求日益增长,传统 Mode1-Based 的网络部署、设计、操作方法无法应对动态变化的无人机场景的问题,本文综述了灵活性高、适应性强的 AI-Based 的智能组网技术,并引入强化学习这一人工智能领域的重要分支.对现有利用强化学习技术解决无人机组网难题的研究进行了概述,结合无人机组网的特性梳理了此领域应用强化学习技术的主要思路.从几个应用场景,以及组网关键技术的角度进行了归纳,给出了基于强化学习的无人机智能组网技术所面临的机遇与挑战,并进行了总结.探究了无人机通信的感知能力与决策能力,适应了其动态变化且需要高度自治的环境需求.为未来无人机智能组网技术的发展提供了有价值的理论基础和实践指导.

Abstract

With the increasing research interest and application demand for unmanned aerial vehicles in both civil and military fields,traditional model-based network deployment,design,and operation methods can hardly cope with dynamically changing unmanned aerial vehicles scenarios.This paper reviews AI-based intelligent networking technology,which offers high flexibility and adaptability and introduces reinforcement learning as an important branch of artificial intelligence.It briefly describes the current research status on the use of reinforcement learning techniques,addresses the difficulties in unmanned aerial vehicles networking,and outlines the main ideas for ap-plying reinforcement learning techniques in this field by combining them with the characteristics of unmanned aerial vehicles networking.The paper reviews several application scenarios and key networking technologies,highlighting the opportunities and challenges encountered by intelligent unmanned aerial vehicles networking technology based on reinforcement learning.The paper concludes that the research enhances unmanned aerial vehicles communica-tion by improving perception and decision-making capabilities,meeting the needs of dynamically changing environ-ments that demand a high degree of autonomy.Additionally,it provides valuable theoretical foundations and practi-cal guidance for the future development of intelligent unmanned aerial vehicles networking technology.

关键词

飞行自组网/强化学习/深度Q网络算法/多智能体/无人机集群/智能路由/资源分配/跨层优化

Key words

flying Ad Hoc network/reinforcement learning/deep Q-network algorithm/multiagent/unmanned aeri-al vehicles swarm/intelligent routing/resource allocation/cross-layer optimization

引用本文复制引用

基金项目

国家自然科学基金项目(61973161)

国家自然科学基金项目(61991404)

国家自然科学基金项目(61773206)

苏州市重点产业技术创新项目(SYG201826)

出版年

2024
哈尔滨工程大学学报
哈尔滨工程大学

哈尔滨工程大学学报

CSTPCD北大核心
影响因子:0.655
ISSN:1006-7043
段落导航相关论文