计算机工程与设计2024,Vol.45Issue(9) :2569-2576.DOI:10.16208/j.issn1000-7024.2024.09.002

基于异构设备的自适应分配编码器的联邦学习

Adaptive encoders in federated learning based on heterogeneous device

刘乐 武淑红 于丹 马垚 陈永乐
计算机工程与设计2024,Vol.45Issue(9) :2569-2576.DOI:10.16208/j.issn1000-7024.2024.09.002

基于异构设备的自适应分配编码器的联邦学习

Adaptive encoders in federated learning based on heterogeneous device

刘乐 1武淑红 1于丹 1马垚 1陈永乐1
扫码查看

作者信息

  • 1. 太原理工大学信息与计算机学院,山西晋中 030600
  • 折叠

摘要

在联邦学习中,不同用户的设备计算、通信、储存能力存在很大差别,容易产生掉队等不公平问题,对现有的联邦学习提出重大挑战.为解决这一问题,提出一种自适应编码器分配模型(federated learning adaptive encoders,FedAE),根据设备的性能将不同编码器组合发送给用户进行本地更新,在服务器端对相应的编码器进行参数聚合.通过这样按需分配,使得所有设备充分发挥设备性能,保证公平.FedAE通过级联分类器进行分类处理,提高模型整体的准确性,节省计算资源.通过实验对比准确度、收敛性快慢等方面,FedAE在解决设备异构问题上提供了更好的方案.

Abstract

In federation learning,different users'devices have very different computing,communication,and storage capabili-ties,which are prone to unfair problems such as dropouts,posing a major challenge to the existing federation learning.To solve this problem,federated learning adaptive encoders(FedAE)was proposed,in which different combinations of encoders were sent to users for local updates according to the performance of their devices,and the corresponding encoders were parameter aggrega-ted on the server side.By such allocation on demand,all users'devices were enabled to give full play to their own device per-formance,the fairness was ensured.FedAE performed classification processing by cascading classifiers,which improved the overall accuracy of the model,and enabled high-performance users to get satisfactory accuracy results early and exit early,saving computational resources.By experimentally comparing accuracy and convergence,FedAE provides a more suitable solution for the device heterogeneity problem.

关键词

联邦学习/数据异质性/设备异构/自适应分配/异构框架/编码器/计算资源

Key words

federated learning/data heterogeneity/device heterogeneity/adaptive allocation/heterogeneous framework/encoder/computational resources

引用本文复制引用

基金项目

山西省基础研究计划基金项目(20210302123131)

山西省基础研究计划基金项目(20210302124395)

出版年

2024
计算机工程与设计
中国航天科工集团二院706所

计算机工程与设计

CSTPCD北大核心
影响因子:0.617
ISSN:1000-7024
段落导航相关论文