Dynamic Load-Balancing with Variable Number of Processors based on Graph Repartitioning

Clément Vuchener (1, 2) , Aurélien Esnard (1, 2)

1 LaBRI - Laboratoire Bordelais de Recherche en Informatique
2 HiePACS - High-End Parallel Algorithms for Challenging Numerical Simulations

Dynamic load balancing is an important step conditioning the performance of parallel adaptive codes whose load evolution is difficult to predict. Most of the works which answer this problem perform well, but are limited to an initially fixed number of processors which is not modified at runtime. These approaches can be very inefficient, especially in terms of resource consumption. In this paper, we present a new graph repartitioning algorithm which accepts a variable number of processors, assuming the load is already balanced. Our algorithm minimizes both data communication and data migration overheads, while maintaining the computational load balanced. This algorithm is based on a theoretical result, that constructs optimal communication matrices with both a minimum migration volume and a minimum number of communications. An experimental study which compares our work against state-of-the-art approaches is presented.

Mots clés: dynamic load-balancing; graph; hypergraph; partitioning; migration; repartitioning

Domaines: Calcul parallèle, distribué et partagé [cs.DC]

Clément Vuchener, Aurélien Esnard. Dynamic Load-Balancing with Variable Number of Processors based on Graph Repartitioning. [Research Report] RR-7926, INRIA. 2012. ⟨hal-00687073⟩