首页|可实现双向自适应差分隐私的联邦学习方案

可实现双向自适应差分隐私的联邦学习方案

扫码查看
随着个人数据的爆发式增长,基于差分隐私的联邦学习模型可用于解决数据孤岛问题和保护用户数据隐私,参与者通过训练本地数据,将添加噪声后的参数共享到中心服务器进行聚合,实现分布式机器学习训练.此过程中存在两方面问题:① 中心服务器广播参数的过程中数据信息仍未受到保护,有泄露用户隐私的风险;② 对参数过度添加噪声会导致参数聚合质量降低,影响最终联邦学习的模型精度.为解决以上问题,提出了一种可实现双向自适应差分隐私的联邦学习方案(FedBADP),对客户端和中心服务器之间传输的梯度进行自适应加噪,在保护数据安全的同时不影响模型准确率.考虑到参与者硬件设备的性能限制,文中对其梯度进行采样以减少通信开销,并在客户端和中心服务器使用均方根传递加速模型的收敛提高模型精度.实验结果证明,文中提出的模型框架在保持较好准确率的同时,也增强了用户的隐私保护能力.
Bidirectional adaptive differential privacy federated learning scheme
With the explosive growth of personal data,the federated learning based on differential privacy can be used to solve the problem of data islands and preserve user data privacy.Participants share the parameters with noise to the central server for aggregation by training local data,and realize distributed machine learning training.However,there are two defects in this model:on the one hand,the data information in the process of parameters broadcasting by the central server is still compromised,with the risk of user privacy leakage;on the other hand,adding too much noise to parameters will reduce the quality of parameter aggregation and affect the model accuracy of federated learning.In order to solve the above problems,a bidirectional adaptive differential privacy federated learning scheme(Federated Learning Approach with Bidirectional Adaptive Differential Privacy,FedBADP)is proposed,which can adaptively add noise to the gradients transmitted by participants and central servers,and keep data security without affecting the model accuracy.Meanwhile,considering the performance limitations of the participants hardware devices,this model samples their gradients to reduce the communication overhead,and uses the RMSprop to accelerate the convergence of the model on the participants and central server to improve the accuracy of the model.Experiments show that our novel model can enhance the user privacy preserving while maintaining a good accuracy.

bidirectional adaptive noiseRMSpropsamplingdifferential privacyfederated learning

李洋、徐进、朱建明、王友卫

展开 >

中央财经大学 信息学院,北京 100081

中央财经大学 国家金融安全教育部工程研究中心,北京 100081

双向自适应噪声 均方根传递 采样 差分隐私 联邦学习

国家重点研发计划教育部人文社科项目中央财经大学教育教学改革基金2022年度课题中央财经大学新兴交叉学科建设项目

2017YFB140070019YJCZH1782022ZXJG35

2024

西安电子科技大学学报(自然科学版)
西安电子科技大学

西安电子科技大学学报(自然科学版)

CSTPCD北大核心
影响因子:0.837
ISSN:1001-2400
年,卷(期):2024.51(3)