Privacy-preserving weighted federated learning within the secret sharing framework

This paper studies privacy-preserving weighted federated learning within the secret sharing framework, where individual private data is split into random shares which are distributed among a set of pre-defined computing servers. The contribution of this paper mainly comprises the following four-fold...

Full description

Bibliographic Details
Main Authors: Zhu, Huafei, Goh, Rick Siow Mong, Ng, Wee Keong
Other Authors: School of Computer Science and Engineering
Format: Journal Article
Language:English
Published: 2021
Subjects:
Online Access:https://hdl.handle.net/10356/145818
_version_ 1826119347310952448
author Zhu, Huafei
Goh, Rick Siow Mong
Ng, Wee Keong
author2 School of Computer Science and Engineering
author_facet School of Computer Science and Engineering
Zhu, Huafei
Goh, Rick Siow Mong
Ng, Wee Keong
author_sort Zhu, Huafei
collection NTU
description This paper studies privacy-preserving weighted federated learning within the secret sharing framework, where individual private data is split into random shares which are distributed among a set of pre-defined computing servers. The contribution of this paper mainly comprises the following four-fold: · In the first fold, the relationship between federated learning (FL) and multi-party computation (MPC) as well as that of secure federated learning (SFL) and secure multi-party computation (SMPC) is investigated. We show that FL is a subset of MPC from the m-ary functionality point of view. Furthermore, if the underlying FL instance privately computes the defined m-ary functionality in the simulation-based framework, then the simulation-based FL solution is an instance of SMPC. · In the second fold, a new notion which we call weighted federated learning (wFL) is introduced and formalized. Then an oracle-aided SMPC for computing wFL is presented and analysed by decoupling the security of FL from that of MPC. Our decoupling formulation of wFL benefits FL developers selecting their best security practices from the state-of-the-art security tools. · In the third-fold, a concrete implementation of wFL leveraging the random splitting technique in the framework of the 3-party computation is presented and analysed. The security of our implementation is guaranteed by the security composition theorem within the secret share framework. · In the fourth-fold, a complement to MASCOT is introduced and formalized in the framework of SPDZ, where a novel solution to the Beaver triple generator is constructed from the standard El Gamal encryption. Our solution is formalized as a three-party computation and a generation of the Beaver triple requires roughly 5 invocations of the El Gamal encryptions. We are able to show that the proposed implementation is secure against honest-but-curious adversary assuming that the underlying El Gamal encryption is semantically secure.
first_indexed 2024-10-01T04:58:49Z
format Journal Article
id ntu-10356/145818
institution Nanyang Technological University
language English
last_indexed 2024-10-01T04:58:49Z
publishDate 2021
record_format dspace
spelling ntu-10356/1458182021-01-08T08:43:31Z Privacy-preserving weighted federated learning within the secret sharing framework Zhu, Huafei Goh, Rick Siow Mong Ng, Wee Keong School of Computer Science and Engineering Engineering::Computer science and engineering Beaver-triple El Gamal Encryption This paper studies privacy-preserving weighted federated learning within the secret sharing framework, where individual private data is split into random shares which are distributed among a set of pre-defined computing servers. The contribution of this paper mainly comprises the following four-fold: · In the first fold, the relationship between federated learning (FL) and multi-party computation (MPC) as well as that of secure federated learning (SFL) and secure multi-party computation (SMPC) is investigated. We show that FL is a subset of MPC from the m-ary functionality point of view. Furthermore, if the underlying FL instance privately computes the defined m-ary functionality in the simulation-based framework, then the simulation-based FL solution is an instance of SMPC. · In the second fold, a new notion which we call weighted federated learning (wFL) is introduced and formalized. Then an oracle-aided SMPC for computing wFL is presented and analysed by decoupling the security of FL from that of MPC. Our decoupling formulation of wFL benefits FL developers selecting their best security practices from the state-of-the-art security tools. · In the third-fold, a concrete implementation of wFL leveraging the random splitting technique in the framework of the 3-party computation is presented and analysed. The security of our implementation is guaranteed by the security composition theorem within the secret share framework. · In the fourth-fold, a complement to MASCOT is introduced and formalized in the framework of SPDZ, where a novel solution to the Beaver triple generator is constructed from the standard El Gamal encryption. Our solution is formalized as a three-party computation and a generation of the Beaver triple requires roughly 5 invocations of the El Gamal encryptions. We are able to show that the proposed implementation is secure against honest-but-curious adversary assuming that the underlying El Gamal encryption is semantically secure. Published version 2021-01-08T08:43:31Z 2021-01-08T08:43:31Z 2020 Journal Article Zhu, H., Goh, R. S. M., & Ng, W. K. (2020). Privacy-preserving weighted federated learning within the secret sharing framework. IEEE Access, 8, 198275-198284. doi:10.1109/ACCESS.2020.3034602 2169-3536 https://hdl.handle.net/10356/145818 10.1109/ACCESS.2020.3034602 8 198275 198284 en IEEE Access © 2020 IEEE. This journal is 100% open access, which means that all content is freely available without charge to users or their institutions. All articles accepted after 12 June 2019 are published under a CC BY 4.0 license, and the author retains copyright. Users are allowed to read, download, copy, distribute, print, search, or link to the full texts of the articles, or use them for any other lawful purpose, as long as proper attribution is given. application/pdf
spellingShingle Engineering::Computer science and engineering
Beaver-triple
El Gamal Encryption
Zhu, Huafei
Goh, Rick Siow Mong
Ng, Wee Keong
Privacy-preserving weighted federated learning within the secret sharing framework
title Privacy-preserving weighted federated learning within the secret sharing framework
title_full Privacy-preserving weighted federated learning within the secret sharing framework
title_fullStr Privacy-preserving weighted federated learning within the secret sharing framework
title_full_unstemmed Privacy-preserving weighted federated learning within the secret sharing framework
title_short Privacy-preserving weighted federated learning within the secret sharing framework
title_sort privacy preserving weighted federated learning within the secret sharing framework
topic Engineering::Computer science and engineering
Beaver-triple
El Gamal Encryption
url https://hdl.handle.net/10356/145818
work_keys_str_mv AT zhuhuafei privacypreservingweightedfederatedlearningwithinthesecretsharingframework
AT gohricksiowmong privacypreservingweightedfederatedlearningwithinthesecretsharingframework
AT ngweekeong privacypreservingweightedfederatedlearningwithinthesecretsharingframework