Personalized Federated Learning for Heterogeneous Residential Load Forecasting

Accurate load forecasting is critical for electricity production, transmission, and maintenance. Deep learning (DL) model has replaced other classical models as the most popular prediction models. However, the deep prediction model requires users to provide a large amount of private electricity cons...

Full description

Bibliographic Details
Main Authors: Xiaodong Qu, Chengcheng Guan, Gang Xie, Zhiyi Tian, Keshav Sood, Chaoli Sun, Lei Cui
Format: Article
Language:English
Published: Tsinghua University Press 2023-12-01
Series:Big Data Mining and Analytics
Subjects:
Online Access:https://www.sciopen.com/article/10.26599/BDMA.2022.9020043
_version_ 1797384841840295936
author Xiaodong Qu
Chengcheng Guan
Gang Xie
Zhiyi Tian
Keshav Sood
Chaoli Sun
Lei Cui
author_facet Xiaodong Qu
Chengcheng Guan
Gang Xie
Zhiyi Tian
Keshav Sood
Chaoli Sun
Lei Cui
author_sort Xiaodong Qu
collection DOAJ
description Accurate load forecasting is critical for electricity production, transmission, and maintenance. Deep learning (DL) model has replaced other classical models as the most popular prediction models. However, the deep prediction model requires users to provide a large amount of private electricity consumption data, which has potential privacy risks. Edge nodes can federally train a global model through aggregation using federated learning (FL). As a novel distributed machine learning (ML) technique, it only exchanges model parameters without sharing raw data. However, existing forecasting methods based on FL still face challenges from data heterogeneity and privacy disclosure. Accordingly, we propose a user-level load forecasting system based on personalized federated learning (PFL) to address these issues. The obtained personalized model outperforms the global model on local data. Further, we introduce a novel differential privacy (DP) algorithm in the proposed system to provide an additional privacy guarantee. Based on the principle of generative adversarial network (GAN), the algorithm achieves the balance between privacy and prediction accuracy throughout the game. We perform simulation experiments on the real-world dataset and the experimental results show that the proposed system can comply with the requirement for accuracy and privacy in real load forecasting scenarios.
first_indexed 2024-03-08T21:45:28Z
format Article
id doaj.art-e96d12cc43804385bff4752aa540d08a
institution Directory Open Access Journal
issn 2096-0654
language English
last_indexed 2024-03-08T21:45:28Z
publishDate 2023-12-01
publisher Tsinghua University Press
record_format Article
series Big Data Mining and Analytics
spelling doaj.art-e96d12cc43804385bff4752aa540d08a2023-12-20T09:32:32ZengTsinghua University PressBig Data Mining and Analytics2096-06542023-12-016442143210.26599/BDMA.2022.9020043Personalized Federated Learning for Heterogeneous Residential Load ForecastingXiaodong Qu0Chengcheng Guan1Gang Xie2Zhiyi Tian3Keshav Sood4Chaoli Sun5Lei Cui6Shanxi Key Laboratory of Advanced Control and Equipment Intelligence, Taiyuan University of Science and Technology, Taiyuan 030024, ChinaShanxi Key Laboratory of Advanced Control and Equipment Intelligence, Taiyuan University of Science and Technology, Taiyuan 030024, ChinaShanxi Key Laboratory of Advanced Control and Equipment Intelligence, Taiyuan University of Science and Technology, Taiyuan 030024, ChinaFaculty of Engineering and Information Technology, University of Technology Sydney, Ultimo 2007, AustraliaCentre for Cyber Security Research and Innovation, Deakin University, Melbourne 3125, AustraliaSchool of Computer Science and Technology, Taiyuan University of Science and Technology, Taiyuan 030024, ChinaShanxi Key Laboratory of Advanced Control and Equipment Intelligence, Taiyuan University of Science and Technology, Taiyuan 030024, ChinaAccurate load forecasting is critical for electricity production, transmission, and maintenance. Deep learning (DL) model has replaced other classical models as the most popular prediction models. However, the deep prediction model requires users to provide a large amount of private electricity consumption data, which has potential privacy risks. Edge nodes can federally train a global model through aggregation using federated learning (FL). As a novel distributed machine learning (ML) technique, it only exchanges model parameters without sharing raw data. However, existing forecasting methods based on FL still face challenges from data heterogeneity and privacy disclosure. Accordingly, we propose a user-level load forecasting system based on personalized federated learning (PFL) to address these issues. The obtained personalized model outperforms the global model on local data. Further, we introduce a novel differential privacy (DP) algorithm in the proposed system to provide an additional privacy guarantee. Based on the principle of generative adversarial network (GAN), the algorithm achieves the balance between privacy and prediction accuracy throughout the game. We perform simulation experiments on the real-world dataset and the experimental results show that the proposed system can comply with the requirement for accuracy and privacy in real load forecasting scenarios.https://www.sciopen.com/article/10.26599/BDMA.2022.9020043load forecastingpersonalized federated learningdifferential privacy
spellingShingle Xiaodong Qu
Chengcheng Guan
Gang Xie
Zhiyi Tian
Keshav Sood
Chaoli Sun
Lei Cui
Personalized Federated Learning for Heterogeneous Residential Load Forecasting
Big Data Mining and Analytics
load forecasting
personalized federated learning
differential privacy
title Personalized Federated Learning for Heterogeneous Residential Load Forecasting
title_full Personalized Federated Learning for Heterogeneous Residential Load Forecasting
title_fullStr Personalized Federated Learning for Heterogeneous Residential Load Forecasting
title_full_unstemmed Personalized Federated Learning for Heterogeneous Residential Load Forecasting
title_short Personalized Federated Learning for Heterogeneous Residential Load Forecasting
title_sort personalized federated learning for heterogeneous residential load forecasting
topic load forecasting
personalized federated learning
differential privacy
url https://www.sciopen.com/article/10.26599/BDMA.2022.9020043
work_keys_str_mv AT xiaodongqu personalizedfederatedlearningforheterogeneousresidentialloadforecasting
AT chengchengguan personalizedfederatedlearningforheterogeneousresidentialloadforecasting
AT gangxie personalizedfederatedlearningforheterogeneousresidentialloadforecasting
AT zhiyitian personalizedfederatedlearningforheterogeneousresidentialloadforecasting
AT keshavsood personalizedfederatedlearningforheterogeneousresidentialloadforecasting
AT chaolisun personalizedfederatedlearningforheterogeneousresidentialloadforecasting
AT leicui personalizedfederatedlearningforheterogeneousresidentialloadforecasting