Home Tsinghua Science and Technology Article
PDF (1.8 MB)
Cite
EndNote(RIS) BibTeX
Collect
Submit Manuscript
Open Access

Research on Medical Image Classification Based on Improved FedAvg Algorithm

School of Information Technology, Northwest University, Xi’an 710127, China
The Second Affiliated Hospital of Air Force Medical University, Xi’an 710038, China
Show Author Information

Abstract

Federated learning (FL) technology has significant advantages in solving data silos and user privacy problems, but the traditional federal average (FedAvg) algorithm is ineffective in classifying and faces the risk of refactoring attacks when dealing with non-independent and identically distributed (Non-IID) data, which is especially prominent since medical data involves sensitive personal health information. Therefore, optimizing FedAvg to adapt to Non-IID data distribution and enhancing privacy protection are urgent problems that need to be solved, and this paper investigates these two aspects. In order to enhance the classification performance of FedAvg under Non-IID distribution, this paper combines the optimized deep learning model SE-ResNet18-E with FedAvg to obtain the FedAvg(SE-ResNet18-E) algorithm. The algorithm takes advantage of the SE-ResNet18-E model in feature extraction and classification tasks, fully uses the data resources of each participant, and improves the classification performance of FedAvg under Non-IID distribution. In addition, the algorithm achieves high communication performance. Second, in order to enhance the security of FL in the medical domain, threshold Paillier encryption is further introduced on top of FedAvg(SE-ResNet18-E) to form the Safe-FedAvg(SE-ResNet18-E) algorithm, which solves the threat of reconstruction attack and private key leakage in medical FL. After experimental validation, the Safe-FedAvg (SE-ResNet18-E) algorithm effectively improves the accuracy of disease classification and effectively protects the privacy and security of medical data, and enhances the trust of medical organizations participating in FL.

Keywords

federated learning (FL)deep learningnon-independent-and-identically-distributed data (Non-IID)homomorphic encryption

References

[1]

T. Li, A. K. Sahu, A. Talwalkar, and V. Smith, Federated learning: Challenges, methods, and future Directions, IEEE Signal Process. Mag., vol. 37, no. 3, pp. 50–60, 2020.

Crossref Google Scholar
[2]
B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. Y. Arcas, Communication-efficient learning of deep networks from decentralized data, in Proc. 20th Int. Conf. Artificial Intelligence and Statistics, Fort Lauderdale, FL, USA, 2017, pp. 1273–1282.
[3]

Z. Zhang, Y. Zhang, D. Guo, S. Zhao, and X. Zhu, Communication-efficient federated continual learning for distributed learning system with Non-IID data, Sci. China Inf. Sci., vol. 66, no. 2, pp. 122102, 2023.

Crossref Google Scholar
[4]
Y. Zhao, M. Li, L. Lai, N. Suda, D. Civin, and V. Chandra, Federated learning with non-IID data, arXiv preprint arXiv: 1806.00582, 2022.
[5]
S. P. Karimireddy, S. Kale, M. Mohri, S. J. Reddi, S. U. Stich, and A. T. Suresh, SCAFFOLD: Stochastic controlled averaging for on-device federated learning, arXiv preprint arXiv: 1910.06378v1, 2021.
[6]
L. Zheng, J. Zhou, C. Chen, B. Wu, L. Wang, and B. Zhang, ASFGNN: Automated separated-federated graph neural network, Peer Peer Netw. Appl., vol. 14, no. 3, pp. 1692–1704, 2021.
Crossref
[7]
H. Wang, M. Yurochkin, Y. Sun, D. S. Papailiopoulos, and Y. Khazaeni, Federated learning with matched averaging, in Proc. 8th Int. Conf. Learning Representations, Addis Ababa, Ethiopia, 2020. https://dblp.uni-trier.de/db/conf/iclr/iclr2020.html#WangYSPK20.
[8]
Z. Chai, Y. Chen, L. Zhao, Y. Cheng, and H. Rangwala, FedAT: A communication-efficient federated learning method with asynchronous tiers under non-IID data, arXiv preprint arXiv: 2010.05958v1, 2021.
Crossref
[9]
K. Kopparapu, E. Lin, and J. Zhao, FedCD: Improving performance in non-IID federated learning, arXiv preprint arXiv: 2006.09637, 2020.
[10]
C. T. Dinh, N. H. Tran, and, T. D. Nguyen, Personalized federated learning with Moreau envelopes, in Proc. 34th Conf. Neural Information Processing Systems, Vancouver, Canada, 2020, pp. 21394–21405.
[11]
L. Tian, A. K. Sahu, M. Zaheer, M. Sanjabi, A. Talwalkar, and V. Smith, Federated optimization in heterogeneous networks, in Proc. 3rd Conf. Machine Learning and Systems, Austin, TX, USA, 2020. https://dblp.uni-trier.de/db/conf/mlsys/mlsys2020.html#LiSZSTS20.
[12]

J. Mills, J. Hu, and G. Min, Multi-task federated learning for personalised deep neural networks in edge computing, IEEE Trans. Parallel Distrib. Syst., vol. 33, no. 3, pp. 630–641, 2022.

Crossref Google Scholar
[13]

D. Wang, Q. Qin, K. Guo, R. Liu, W. Yan, Y. Ren, Q. Luo, and Y. Shen, Survey on model inversion attack and defense in federated learning, (in Chinese), J. Commun., vol. 44, no. 11, pp. 94–109, 2023.

Google Scholar
[14]
L. Zhu, Z. Liu, and S. Han, Deep leakage from gradients, in Proc. 33rd Int. Conf. Neural Information Processing Systems, Vancouver, BC, Canada, 2019, p. 1323.
[15]

I. Shiri, Y. Salimi, N. Sirjani, B. Razeghi, S. Bagherieh, M. Pakbin, Z. Mansouri, G. Hajianfar, A. H. Avval, D. Askari, et al., Differential privacy preserved federated learning for prognostic modeling in COVID-19 patients using large multi-institutional chest CT dataset, Med. Phys., vol. 51, no. 7, pp. 4736–4747, 2024.

Crossref Google Scholar
[16]

C. Lai, Y. Zhao, and D. Zheng, A privacy preserving and verifiable federated learning scheme based on homomorphic encryption, (in Chinese), Netinfo Secur., vol. 24, no. 1, pp. 93–105, 2024.

Google Scholar
[17]

X. T. Mu, K. Cheng, A. X. Song, T. Zhang, Z. W. Zhang, and Y. L. Shen, Privacy-preserving federated learning resistant to byzantine attacks, (in Chinese), Chin. J. Comput., vol. 47, no. 4, pp. 842–861, 2024.

Google Scholar
[18]
J. Zhang, B. Chen, S. Yu, and H. Deng, PEFL: A privacy-enhanced federated learning scheme for big data analytics, in Proc. 2019 IEEE Global Communications Conf., Waikoloa, HI, USA, 2019, pp. 1–6.
Crossref
[19]
K. He, X. Zhang, S. Ren, and J. Sun, Deep residual learning for image recognition, in Proc. 2016 IEEE Conf. Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 2016, pp. 770–778.
Crossref
[20]

J. Hu, L. Shen, S. Albanie, G. Sun, and E. Wu, Squeeze-and-excitation networks, IEEE Trans. Pattern Anal. Mach. Intell., vol. 42, no. 8, pp. 2011–2023, 2020.

Crossref Google Scholar
[21]

Y. Zhang, C. Chen, and Z. Wang, Research on activation function of deep learning algorithm, (in Chinese), Radio Commun. Technol., vol. 47, no. 1, pp. 115–120, 2021.

Crossref Google Scholar
[22]
D. N. Luo, Research on medical image classification method based on horizontal federated learning, (in Chinese), Master dissertation, Dalian University of Technology, Dalian, China, 2022.
Tsinghua Science and Technology
Volume 30 Issue 5,
October 2025
Pages 2243-2258
DOI: 10.26599/TST.2024.9010184
Cite this article:
Li R, Wang H, Lu Q, et al. Research on Medical Image Classification Based on Improved FedAvg Algorithm. Tsinghua Science and Technology, 2025, 30(5): 2243-2258. https://doi.org/10.26599/TST.2024.9010184
Metrics & Citations  
Article History
Copyright
Rights and Permissions
Return