FedMSA: A Model Selection and Adaptation System for Federated Learning

Sun, Rui; Li, Yinhao; Shah, Tejal; Sham, Ringo WH; Szydlo, Tomasz; Qian, Bin; Thakker, Dhaval; Ranjan, Rajiv

Abstract

Federated Learning (FL) enables multiple clients to train a shared model collaboratively without sharing any personal data. However, selecting a model and adapting it quickly to meet user expectations in a large-scale FL application with heterogeneous devices is challenging. In this paper, we propose a model selection and adaptation system for Federated Learning (FedMSA), which includes a hardware-aware model selection algorithm that trades-off model training efficiency and model performance base on FL developers’ expectation. Meanwhile, considering the expected model should be achieved by dynamic model adaptation, FedMSA supports full automation in building and deployment of the FL task to different hardware at scale. Experiments on benchmark and real-world datasets demonstrate the effectiveness of the model selection algorithm of FedMSA in real devices (e.g., Raspberry Pi and Jetson nano).

Citation

Sun, R., Li, Y., Shah, T., Sham, R. W., Szydlo, T., Qian, B., Thakker, D., & Ranjan, R. (2022). FedMSA: A Model Selection and Adaptation System for Federated Learning. Sensors, 22(19), Article 7244. https://doi.org/10.3390/s22197244

• Journal Article Type: Article
• Acceptance Date: Sep 22, 2022
• Online Publication Date: Sep 24, 2022
• Publication Date: Oct 1, 2022
• Deposit Date: Dec 10, 2024
• Publicly Available Date: Dec 10, 2024
• Journal: Sensors
• Print ISSN: 1424-8220
• Electronic ISSN: 1424-8220
• Publisher: MDPI
• Peer Reviewed: Peer Reviewed
• Volume: 22
• Issue: 19
• Article Number: 7244
• DOI: https://doi.org/10.3390/s22197244
• Keywords: Federated learning; Model selection; Device adaptation; Model adaptation; Orchestration; Distributed system
• Public URL: https://hull-repository.worktribe.com/output/4099693