Towards a Federated Learning Framework on a Multi-Cloud Environment

Rafaela C Brum (1) , Pierre Sens (2) , Luciana Arantes (2) , Maria Clicia Castro (3) , Lucia M A Drummond (1)

1 IC-UFF - Instituto de Computação [Niteroi-Rio de Janeiro]
2 DELYS - DistributEd aLgorithms and sYStems
3 UFRJ - Universidade Federal do Rio de Janeiro [Brasil] = Federal University of Rio de Janeiro [Brazil] = Université fédérale de Rio de Janeiro [Brésil]

This paper proposes Multi-FedLS, a Cross-silo Federated Learning (FL) framework for a multi-cloud environment aiming at minimizing financial cost as well as execution time. It comprises four modules: Pre-Scheduling, Initial Mapping, Fault Tolerance, and Dynamic Scheduler. Given an application and a multi-cloud environment, the Pre-Scheduling module runs experiments to obtain the expected execution times of the FL tasks and communication delays. The Initial Mapping module receives these computed values and provides a scheduling map for the server and clients' VMs. Finally, Multi-FedLS deploys the selected VMs, starts the FL application, and monitors it. The Fault Tolerance (FT) module includes fault tolerance strategies in the FL application, such as checkpoint and replication, and detects some anomalous behaviors. In case of an unexpected increase in the communication delay or a VM failure, the FT module triggers the Dynamic Scheduler Module in order to select a new VM and resume the concerned tasks of the FL application. Some preliminary experiments are presented, confirming that some proposed strategies are crucial to efficiently execute an FL application on a multi-cloud environment.

Mots clés: Federated Learning Framework; Multi-Cloud Environment; Efficient Resource Allocation

Domaines: Calcul parallèle, distribué et partagé [cs.DC]

Rafaela C Brum, Pierre Sens, Luciana Arantes, Maria Clicia Castro, Lucia M A Drummond. Towards a Federated Learning Framework on a Multi-Cloud Environment. IEEE SBAC-PADW 2022 - IEEE 34th International Symposium on Computer Architecture and High Performance Computing Workshops, Nov 2022, Bordeaux, France. pp.39-44, ⟨10.1109/SBAC-PADW56527.2022.00016⟩. ⟨hal-04015975⟩