AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
PDF (385.2 KB)
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Open Access

Personalized Federated Learning for Heterogeneous Residential Load Forecasting

Shanxi Key Laboratory of Advanced Control and Equipment Intelligence, Taiyuan University of Science and Technology, Taiyuan 030024, China
Faculty of Engineering and Information Technology, University of Technology Sydney, Ultimo 2007, Australia
Centre for Cyber Security Research and Innovation, Deakin University, Melbourne 3125, Australia
School of Computer Science and Technology, Taiyuan University of Science and Technology, Taiyuan 030024, China
Show Author Information

Abstract

Accurate load forecasting is critical for electricity production, transmission, and maintenance. Deep learning (DL) model has replaced other classical models as the most popular prediction models. However, the deep prediction model requires users to provide a large amount of private electricity consumption data, which has potential privacy risks. Edge nodes can federally train a global model through aggregation using federated learning (FL). As a novel distributed machine learning (ML) technique, it only exchanges model parameters without sharing raw data. However, existing forecasting methods based on FL still face challenges from data heterogeneity and privacy disclosure. Accordingly, we propose a user-level load forecasting system based on personalized federated learning (PFL) to address these issues. The obtained personalized model outperforms the global model on local data. Further, we introduce a novel differential privacy (DP) algorithm in the proposed system to provide an additional privacy guarantee. Based on the principle of generative adversarial network (GAN), the algorithm achieves the balance between privacy and prediction accuracy throughout the game. We perform simulation experiments on the real-world dataset and the experimental results show that the proposed system can comply with the requirement for accuracy and privacy in real load forecasting scenarios.

References

[1]
S. Haben, S. Arora, G. Giasemidis, M. Voss, and D. V. Greetham, Review of low voltage load forecasting: Methods, applications, and recommendations, Applied Energy, vol. 304, p. 117798, 2021.
[2]
S. Dong, P. Wang, and K. Abbas, A survey on deep learning and its applications, Computer Science Review, vol. 40, p. 100379, 2021.
[3]
M. Injadat, A. Moubayed, A. B. Nassif, and A. Shami, Machine learning towards intelligent systems: Applications, challenges, and opportunities, Artificial Intelligence Review, vol. 54, no. 5, pp. 32993348, 2021.
[4]
M. Faheem, S. B. H. Shah, R. A. Butt, B. Raza, M. Anwar, M. W. Ashraf, M. A. Ngadi, and V. C. Gungor, Smart grid communication and information technologies in the perspective of industry 4.0: Opportunities and challenges, Computer Science Review, vol. 30, pp. 130, 2018.
[5]
H. Shi, M. Xu, and R. Li, Deep learning for household load forecasting—A novel pooling deep RNN, IEEE Transactions on Smart Grid, vol. 9, no. 5, pp. 52715280, 2017.
[6]
W. Kong, Z. Y. Dong, Y. Jia, D. J. Hill, Y. Xu, and Y. Zhang, Short-term residential load forecasting based on LSTM recurrent neural network, IEEE Transactions on Smart Grid, vol. 10, no. 1, pp. 841851, 2017.
[7]
M. Alhussein, K. Aurangzeb, and S. I. Haider, Hybrid CNN-LSTM model for short-term individual household load forecasting, IEEE Access, vol. 8, pp. 180544180557, 2020.
[8]
N. Balta-Ozkan, O. Amerighi, and B. Boteler, A comparison of consumer perceptions towards smart homes in the UK, Germany and Italy: Reflections for policy and future research, Technology Analysis & Strategic Management, vol. 26, no. 10, pp. 11761195, 2014.
[9]
A. Jindal, A. Dua, K. Kaur, M. Singh, N. Kumar, and S. Mishra, Decision tree and SVM-based data analytics for theft detection in smart grid, IEEE Transactions on Industrial Informatics, vol. 12, no. 3, pp. 10051016, 2016.
[10]
M. G. Chuwa and F. Wang, A review of non-technical loss attack models and detection methods in the smart grid, Electric Power Systems Research, vol. 199, p. 107415, 2021.
[11]
L. Cui, Y. Qu, L. Gao, G. Xie, and S. Yu, Detecting false data attacks using machine learning techniques in smart grid: A survey, Journal of Network and Computer Applications, vol. 170, p. 102808, 2020.
[12]
P. Kairouz, H. B. McMahan, B. Avent, A. Bellet, M. Bennis, A. N. Bhagoji, K. Bonawitz, Z. Charles, G. Cormode, R. Cummings, et al., Advances and open problems in federated learning, arXiv preprint arXiv: 1912.04977, 2019.
[13]
H. Lee, J. Kim, R. Hussain, S. Cho, and J. Son, On defensive neural networks against inference attack in federated learning, in Proc. 2021 IEEE International Conference on Communications, Montreal, Canada, 2021, pp. 16.
[14]
H. Zhu, J. Xu, S. Liu, and Y. Jin, Federated learning on non-IID data: A survey, Neurocomputing, vol. 465, pp. 371390, 2021.
[15]
C. Li, Y. Yuan, and F. Y. Wang, Blockchain-enabled federated learning: A survey, in Proc. 2021 IEEE 1st International Conference on Digital Twins and Parallel Intelligence (DTPI), Beijing, China, 2021, pp. 286289.
[16]
X. Yin, Y. Zhu, and J. Hu, A comprehensive survey of privacy-preserving federated learning: A taxonomy, review, and future directions, ACM Computing Surveys (CSUR), vol. 54, no. 6, pp. 136, 2022.
[17]
Y. Qu, S. Yu, W. Zhou, S. Chen, and J. Wu, Customizable reliable privacy-preserving data sharing in cyber-physical social networks, IEEE Transactions on Network Science and Engineering, vol. 8, no. 1, pp. 269281, 2020.
[18]
X. Fang, S. Misra, G. Xue, and D. Yang, Smart grid—The new and improved power grid: A survey, IEEE Communications Surveys & Tutorials, vol. 14, no. 4, pp. 944980, 2011.
[19]
K. Sahinbas and F. O. Catak, Secure multi-party computation based privacy preserving data analysis in healthcare IoT systems, arXiv preprint arXiv: 2109.14334, 2021.
[20]
L. Zhang, J. Xu, P. Vijayakumar, P. K. Sharma, and U. Ghosh, Homomorphic encryption-based privacy-preserving federated learning in IoT-enabled healthcare system, IEEE Transactions on Network Science and Engineering, .
[21]
B. Jiang, J. Li, H. Wang, and H. Song, Privacy-preserving federated learning for industrial edge computing via hybrid differential privacy and adaptive compression, IEEE Transactions on Industrial Informatics, vol. 19, no. 2, pp. 11361144, 2021.
[22]
D. Li and J. Wang, FedMD: Heterogenous federated learning via model distillation, arXiv preprint arXiv: 1910.03581, 2019.
[23]
H. Wang, Z. Kaplan, D. Niu, and B. Li, Optimizing federated learning on non-IID data with reinforcement learning, in Proc. IEEE INFOCOM 2020-IEEE Conference on Computer Communications, Toronto, Canada, 2020, pp. 16981707.
[24]
M. G. Arivazhagan, V. Aggarwal, A. K. Singh, and S. Choudhary, Federated learning with personalization layers, arXiv preprint arXiv: 1912.00818, 2019.
[25]
V. Venkataramanan, S. Kaza, and A. M. Annaswamy, DER forecast using privacy-preserving federated learning, IEEE Internet of Things Journal, vol. 10, no. 3, pp. 20462055, 2022.
[26]
N. B. S. Qureshi, D. H. Kim, J. Lee, and E. K. Lee, Poisoning attacks against federated learning in load forecasting of smart energy, in Proc. 2022 IEEE/IFIP Network Operations and Management Symposium, Budapest, Hungary, 2022, pp. 17.
[27]
M. Sun, J. Li, Y. Ren, S. Fang, and J. Yan, Research on federated learning and its security issues for load forecasting, in Proc. 2021 13th International Conference on Computer Modeling and Simulation, Melbourne, Australia, 2021, pp. 237243.
[28]
N. Gholizadeh and P. Musilek, Federated learning with hyperparameter-based clustering for electrical load forecasting, Internet of Things, vol. 17, p. 100470, 2022.
[29]
Y. Wang, N. Gao, and G. Hug, Personalized federated learning for individual consumer load forecasting, CSEE Journal of Power and Energy Systems, .
[30]
D. Li, X. Nie, X. Li, Y. Zhang, and Y. Yin, Context-related video anomaly detection via generative adversarial network, Pattern Recognition Letters, vol. 156, pp. 183189, 2022.
[31]
Y. Lu, D. Chen, E. Olaniyi, and Y. Huang, Generative adversarial networks (GANs) for image augmentation in agriculture: A systematic review, Computers and Electronics in Agriculture, vol. 200, p. 107208, 2022.
[32]
A. Wali, Z. Alamgir, S. Karim, A. Fawaz, M. B. Ali, M. Adan, and M. Mujtaba, Generative adversarial networks for speech processing: A review, Computer Speech & Language, vol. 72, p. 101308, 2022.
[33]
T. Li, S. Hu, A. Beirami, and V. Smith, Ditto: Fair and robust federated learning through personalization, in Proc. 38th International Conference on Machine Learning, Virtual, 2021, pp. 63576368.
[34]
L. Cui, Y. Qu, G. Xie, D. Zeng, R. Li, S. Shen, and S. Yu, Security and privacy-enhanced federated learning for anomaly detection in IoT infrastructures, IEEE Transactions on Industrial Informatics, vol. 18, no. 5, pp. 34923500, 2021.
[35]
M. Pau, E. Patti, L. Barbierato, A. Estebsari, E. Pons, F. Ponci, and A. Monti, A cloud-based smart metering infrastructure for distribution grid services and automation, Sustainable Energy, Grids and Networks, vol. 15, pp. 1425, 2018.
[36]
S. Makonin, HUE: The hourly usage of energy dataset for buildings in British Columbia, https://doi.org/10.7910/DVN/N3HGRN, 2018.
[37]
Y. Xie, Z. Wang, D. Gao, D. Chen, L. Yao, W. Kuang, Y. Li, B. Ding, and J. Zhou, FederatedScope: A flexible federated learning platform for heterogeneity, arXiv preprint arXiv: 2204.05011, 2022.
Big Data Mining and Analytics
Pages 421-432
Cite this article:
Qu X, Guan C, Xie G, et al. Personalized Federated Learning for Heterogeneous Residential Load Forecasting. Big Data Mining and Analytics, 2023, 6(4): 421-432. https://doi.org/10.26599/BDMA.2022.9020043

1335

Views

306

Downloads

9

Crossref

6

Web of Science

9

Scopus

0

CSCD

Altmetrics

Received: 11 August 2022
Revised: 27 September 2022
Accepted: 21 October 2022
Published: 29 August 2023
© The author(s) 2023.

The articles published in this open access journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).

Return