Local Differential Privacy Based Membership-Privacy-Preserving Federated Learning for Deep-Learning-Driven Remote Sensing

With the development of deep learning, image recognition based on deep learning is now widely used in remote sensing. As we know, the effectiveness of deep learning models significantly benefits from the size and quality of the dataset. However, remote sensing data are often distributed in different...

Full description

Bibliographic Details
Main Authors: Zheng Zhang, Xindi Ma, Jianfeng Ma
Format: Article
Language:English
Published: MDPI AG 2023-10-01
Series:Remote Sensing
Subjects:
Online Access:https://www.mdpi.com/2072-4292/15/20/5050
_version_ 1797572350157258752
author Zheng Zhang
Xindi Ma
Jianfeng Ma
author_facet Zheng Zhang
Xindi Ma
Jianfeng Ma
author_sort Zheng Zhang
collection DOAJ
description With the development of deep learning, image recognition based on deep learning is now widely used in remote sensing. As we know, the effectiveness of deep learning models significantly benefits from the size and quality of the dataset. However, remote sensing data are often distributed in different parts. They cannot be shared directly for privacy and security reasons, and this has motivated some scholars to apply federated learning (FL) to remote sensing. However, research has found that federated learning is usually vulnerable to white-box membership inference attacks (MIAs), which aim to infer whether a piece of data was participating in model training. In remote sensing, the MIA can lead to the disclosure of sensitive information about the model trainers, such as their location and type, as well as time information about the remote sensing equipment. To solve this issue, we consider embedding local differential privacy (LDP) into FL and propose LDP-Fed. LDP-Fed performs local differential privacy perturbation after properly pruning the uploaded parameters, preventing the central server from obtaining the original local models from the participants. To achieve a trade-off between privacy and model performance, LDP-Fed adds different noise levels to the parameters for various layers of the local models. This paper conducted comprehensive experiments to evaluate the framework’s effectiveness on two remote sensing image datasets and two machine learning benchmark datasets. The results demonstrate that remote sensing image classification models are susceptible to MIAs, and our framework can successfully defend against white-box MIA while achieving an excellent global model.
first_indexed 2024-03-10T20:55:59Z
format Article
id doaj.art-bd778f4c51c84daeaad939101c4c7ef0
institution Directory Open Access Journal
issn 2072-4292
language English
last_indexed 2024-03-10T20:55:59Z
publishDate 2023-10-01
publisher MDPI AG
record_format Article
series Remote Sensing
spelling doaj.art-bd778f4c51c84daeaad939101c4c7ef02023-11-19T18:00:10ZengMDPI AGRemote Sensing2072-42922023-10-011520505010.3390/rs15205050Local Differential Privacy Based Membership-Privacy-Preserving Federated Learning for Deep-Learning-Driven Remote SensingZheng Zhang0Xindi Ma1Jianfeng Ma2The School of Cyber Engineering, Xidian University, Xi’an 710071, ChinaThe School of Cyber Engineering, Xidian University, Xi’an 710071, ChinaThe School of Cyber Engineering, Xidian University, Xi’an 710071, ChinaWith the development of deep learning, image recognition based on deep learning is now widely used in remote sensing. As we know, the effectiveness of deep learning models significantly benefits from the size and quality of the dataset. However, remote sensing data are often distributed in different parts. They cannot be shared directly for privacy and security reasons, and this has motivated some scholars to apply federated learning (FL) to remote sensing. However, research has found that federated learning is usually vulnerable to white-box membership inference attacks (MIAs), which aim to infer whether a piece of data was participating in model training. In remote sensing, the MIA can lead to the disclosure of sensitive information about the model trainers, such as their location and type, as well as time information about the remote sensing equipment. To solve this issue, we consider embedding local differential privacy (LDP) into FL and propose LDP-Fed. LDP-Fed performs local differential privacy perturbation after properly pruning the uploaded parameters, preventing the central server from obtaining the original local models from the participants. To achieve a trade-off between privacy and model performance, LDP-Fed adds different noise levels to the parameters for various layers of the local models. This paper conducted comprehensive experiments to evaluate the framework’s effectiveness on two remote sensing image datasets and two machine learning benchmark datasets. The results demonstrate that remote sensing image classification models are susceptible to MIAs, and our framework can successfully defend against white-box MIA while achieving an excellent global model.https://www.mdpi.com/2072-4292/15/20/5050remote sensing image classificationlocal differential privacydeep learningfederated learningmembership inference attack
spellingShingle Zheng Zhang
Xindi Ma
Jianfeng Ma
Local Differential Privacy Based Membership-Privacy-Preserving Federated Learning for Deep-Learning-Driven Remote Sensing
Remote Sensing
remote sensing image classification
local differential privacy
deep learning
federated learning
membership inference attack
title Local Differential Privacy Based Membership-Privacy-Preserving Federated Learning for Deep-Learning-Driven Remote Sensing
title_full Local Differential Privacy Based Membership-Privacy-Preserving Federated Learning for Deep-Learning-Driven Remote Sensing
title_fullStr Local Differential Privacy Based Membership-Privacy-Preserving Federated Learning for Deep-Learning-Driven Remote Sensing
title_full_unstemmed Local Differential Privacy Based Membership-Privacy-Preserving Federated Learning for Deep-Learning-Driven Remote Sensing
title_short Local Differential Privacy Based Membership-Privacy-Preserving Federated Learning for Deep-Learning-Driven Remote Sensing
title_sort local differential privacy based membership privacy preserving federated learning for deep learning driven remote sensing
topic remote sensing image classification
local differential privacy
deep learning
federated learning
membership inference attack
url https://www.mdpi.com/2072-4292/15/20/5050
work_keys_str_mv AT zhengzhang localdifferentialprivacybasedmembershipprivacypreservingfederatedlearningfordeeplearningdrivenremotesensing
AT xindima localdifferentialprivacybasedmembershipprivacypreservingfederatedlearningfordeeplearningdrivenremotesensing
AT jianfengma localdifferentialprivacybasedmembershipprivacypreservingfederatedlearningfordeeplearningdrivenremotesensing