首页|平衡信息与动态更新的原型表示联邦学习

平衡信息与动态更新的原型表示联邦学习

扫码查看
联邦学习(FL)是一种分布式机器学习方法,旨在通过训练模型而不共享客户之间的原始数据来解决隐私问题.然而,跨客户端数据的异构性会阻碍FL中的优化收敛性和泛化性能.为了解决这个问题,本文提出了平衡信息与动态更新的联邦原型学习(BD-FedProto)框架,它由两个组件组成:原型调度的动态聚合(DA)和对比原型聚合(CPA).前者动态地调整局部学习和全局学习之间的比例,以平衡局部知识和全局知识的有效性;后者利用缺失的类作为负样本,通过统一的原型集群来学习未知的分布.在CIFAR-10和MNIST数据集上的实验结果表明,BD-FedProto能有效提高FL的分类性能和稳定性.
Balance Information and Dynamic Update in Prototype-Based Federated Learning
Federated Learning(FL)is a distributed machine learning approach that aims to solve privacy issues by training models without sharing the original data among clients.However,the heterogeneity of client data across FL can hinder the convergence and generalization performance of optimization.To address this issue,this paper proposes a balanced information and dynamic updating federated prototype learning(BD-FedProto)framework consisting of two components:dynamic aggregation(DA)of prototype scheduling and contrastive prototype aggregation(CPA).The former dynamically adjusts the proportion between local learning and global learning to balance the effectiveness of local knowledge and global knowledge.The latter utilizes missing classes as negative samples by learning unknown distributions through a unified prototype clustering.The experimental results on the CIFAR-10 and MNIST datasets show that BDFedProto is effective in improving the classification performance and stability of FL.

federated learningfeature space aggregationprototype representationcontrast learningdata heterogeneous

徐炜钦、肖婷、王喆

展开 >

华东理工大学信息科学与工程学院,上海 200237

联邦学习 特征空间聚合 原型表示 对比学习 数据异构

2024

华东理工大学学报(自然科学版)
华东理工大学

华东理工大学学报(自然科学版)

CHSSCD北大核心
影响因子:0.289
ISSN:1006-3080
年,卷(期):2024.50(6)