西南交通大学学报2024,Vol.59Issue(4) :933-941.DOI:10.3969/j.issn.0258-2724.20230539

基于编-解码器结构的无人机群多任务联邦学习

Multi-Task Federated Learning for Unmanned Aerial Vehicle Swarms Based on Encoder-Decoder Architecture

周敬轩 包卫东 王吉 张大宇
西南交通大学学报2024,Vol.59Issue(4) :933-941.DOI:10.3969/j.issn.0258-2724.20230539

基于编-解码器结构的无人机群多任务联邦学习

Multi-Task Federated Learning for Unmanned Aerial Vehicle Swarms Based on Encoder-Decoder Architecture

周敬轩 1包卫东 1王吉 1张大宇1
扫码查看

作者信息

  • 1. 国防科技大学大数据与决策实验室,湖南长沙 410073
  • 折叠

摘要

针对传统联邦学习在无人机群应用中的局限性——要求所有参与者执行相同任务并拥有相同的模型结构,本文探索一种适用于无人机群的多任务联邦学习方法,设计一种新的编-解码器架构,以加强执行不同任务的无人机之间的知识共享.首先,为执行相同任务的无人机建立直接的知识分享机制,通过直接聚合方式实现同任务知识的有效融合;其次,对于执行不同任务的无人机,从所有无人机的编-解码器架构中提取编码器部分,构建一个全局编码器;最后,在训练环节,将本地编码器和全局编码器的信息整合到损失函数中,并通过迭代更新使本地解码器逐步逼近全局解码器,从而实现跨任务间的知识高效共享.实验结果表明:相较于传统方法,所提出的方法使无人机群在3个单任务上的性能分别提升1.79%、0.37%和2.78%,仅在1个任务上性能略微下降0.38%,但整体性能仍提升2.38%.

Abstract

Traditional federated learning has limitations in unmanned aerial vehicle(UAV)swarm applications,which require all participants to perform the same tasks and have the same model structure.Therefore,a multi-task federated learning(M-Fed)method suitable for UAV swarms was explored,and an innovative encoder-decoder architecture was designed to enhance knowledge sharing among UAVs performing different tasks.Firstly,a direct knowledge-sharing mechanism was established for UAVs performing the same tasks,enabling effective knowledge fusion of the same tasks through direct aggregation.Secondly,for UAVs performing different tasks,the encoder parts were extracted from the encoder-decoder architectures of all UAVs to construct a global encoder.Finally,during the training process,the information from both the local encoder and the global encoder was integrated into the loss function.Iterative updates were then performed to gradually align the local decoder with the global decoder,achieving efficient cross-task knowledge sharing.Experimental results demonstrate that compared to traditional methods,the proposed method improves the performance of UAV swarms by 1.79%,0.37%,and 2.78%on three single tasks,respectively.Although there is a slight decrease of 0.38%in performance on one task,the overall performance is still significantly increased by 2.38%.

关键词

多任务学习/无人机群/联邦学习/编-解码器结构

Key words

multi-task learning/unmanned aerial vehicle(UAV)swarm/federated learning/encoder-decoder architecture

引用本文复制引用

基金项目

国家自然科学基金(62002369)

湖南省研究生科研创新项目(XJCX2023013)

出版年

2024
西南交通大学学报
西南交通大学

西南交通大学学报

CSTPCD北大核心
影响因子:0.973
ISSN:0258-2724
参考文献量4
段落导航相关论文