A Federated Learning Method Based on Blockchain and Cluster Training
Federated learning (FL) is an emerging machine learning method in which all participants can collaboratively train a model without sharing their raw data, thereby breaking down data silos and avoiding privacy issues caused by centralized data storage. In practical applications, client data are non-i...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2023-09-01
|
Series: | Electronics |
Subjects: | |
Online Access: | https://www.mdpi.com/2079-9292/12/19/4014 |
_version_ | 1797576007029358592 |
---|---|
author | Yue Li Yiting Yan Zengjin Liu Chang Yin Jiale Zhang Zhaohui Zhang |
author_facet | Yue Li Yiting Yan Zengjin Liu Chang Yin Jiale Zhang Zhaohui Zhang |
author_sort | Yue Li |
collection | DOAJ |
description | Federated learning (FL) is an emerging machine learning method in which all participants can collaboratively train a model without sharing their raw data, thereby breaking down data silos and avoiding privacy issues caused by centralized data storage. In practical applications, client data are non-independent and identically distributed, resulting in FL requiring multiple rounds of communication to converge, which entails high communication costs. Moreover, the centralized architecture of traditional FL remains susceptible to privacy breaches, network congestion, and single-point failures. In order to solve these problems, this paper proposes an FL framework based on blockchain technology and a cluster training algorithm, called BCFL. We first improved an FL algorithm based on odd–even round cluster training, which accelerates model convergence by dividing clients into clusters and adopting serialized training within each cluster. Meanwhile, compression operations were applied to model parameters before transmission to reduce communication costs and improve communication efficiency. Then, a decentralized FL architecture was designed and developed based on blockchain and Inter-Planetary File System (IPFS), where the blockchain records the FL process and IPFS optimizes the high storage costs associated with the blockchain. The experimental results demonstrate the superiority of the framework in terms of accuracy and communication efficiency. |
first_indexed | 2024-03-10T21:46:22Z |
format | Article |
id | doaj.art-207bca07f96240a19ef253fc21e56383 |
institution | Directory Open Access Journal |
issn | 2079-9292 |
language | English |
last_indexed | 2024-03-10T21:46:22Z |
publishDate | 2023-09-01 |
publisher | MDPI AG |
record_format | Article |
series | Electronics |
spelling | doaj.art-207bca07f96240a19ef253fc21e563832023-11-19T14:16:01ZengMDPI AGElectronics2079-92922023-09-011219401410.3390/electronics12194014A Federated Learning Method Based on Blockchain and Cluster TrainingYue Li0Yiting Yan1Zengjin Liu2Chang Yin3Jiale Zhang4Zhaohui Zhang5School of Computer Science and Technology, Donghua University, Shanghai 201620, ChinaSchool of Computer Science and Technology, Donghua University, Shanghai 201620, ChinaSchool of Computer Science and Technology, Donghua University, Shanghai 201620, ChinaSchool of Computer Science and Technology, Donghua University, Shanghai 201620, ChinaSchool of Computer Science and Technology, Donghua University, Shanghai 201620, ChinaSchool of Computer Science and Technology, Donghua University, Shanghai 201620, ChinaFederated learning (FL) is an emerging machine learning method in which all participants can collaboratively train a model without sharing their raw data, thereby breaking down data silos and avoiding privacy issues caused by centralized data storage. In practical applications, client data are non-independent and identically distributed, resulting in FL requiring multiple rounds of communication to converge, which entails high communication costs. Moreover, the centralized architecture of traditional FL remains susceptible to privacy breaches, network congestion, and single-point failures. In order to solve these problems, this paper proposes an FL framework based on blockchain technology and a cluster training algorithm, called BCFL. We first improved an FL algorithm based on odd–even round cluster training, which accelerates model convergence by dividing clients into clusters and adopting serialized training within each cluster. Meanwhile, compression operations were applied to model parameters before transmission to reduce communication costs and improve communication efficiency. Then, a decentralized FL architecture was designed and developed based on blockchain and Inter-Planetary File System (IPFS), where the blockchain records the FL process and IPFS optimizes the high storage costs associated with the blockchain. The experimental results demonstrate the superiority of the framework in terms of accuracy and communication efficiency.https://www.mdpi.com/2079-9292/12/19/4014federated learningcommunication efficiencycluster trainingblockchain |
spellingShingle | Yue Li Yiting Yan Zengjin Liu Chang Yin Jiale Zhang Zhaohui Zhang A Federated Learning Method Based on Blockchain and Cluster Training Electronics federated learning communication efficiency cluster training blockchain |
title | A Federated Learning Method Based on Blockchain and Cluster Training |
title_full | A Federated Learning Method Based on Blockchain and Cluster Training |
title_fullStr | A Federated Learning Method Based on Blockchain and Cluster Training |
title_full_unstemmed | A Federated Learning Method Based on Blockchain and Cluster Training |
title_short | A Federated Learning Method Based on Blockchain and Cluster Training |
title_sort | federated learning method based on blockchain and cluster training |
topic | federated learning communication efficiency cluster training blockchain |
url | https://www.mdpi.com/2079-9292/12/19/4014 |
work_keys_str_mv | AT yueli afederatedlearningmethodbasedonblockchainandclustertraining AT yitingyan afederatedlearningmethodbasedonblockchainandclustertraining AT zengjinliu afederatedlearningmethodbasedonblockchainandclustertraining AT changyin afederatedlearningmethodbasedonblockchainandclustertraining AT jialezhang afederatedlearningmethodbasedonblockchainandclustertraining AT zhaohuizhang afederatedlearningmethodbasedonblockchainandclustertraining AT yueli federatedlearningmethodbasedonblockchainandclustertraining AT yitingyan federatedlearningmethodbasedonblockchainandclustertraining AT zengjinliu federatedlearningmethodbasedonblockchainandclustertraining AT changyin federatedlearningmethodbasedonblockchainandclustertraining AT jialezhang federatedlearningmethodbasedonblockchainandclustertraining AT zhaohuizhang federatedlearningmethodbasedonblockchainandclustertraining |