Dynamic Load Balancing and Efficient Load Estimators for Asynchronous Iterative Algorithms

Jacques M. Bahi (1) , Sylvain Contassot-Vivier (1) , Raphaël Couturier (1)

1 FEMTO-ST - Franche-Comté Électronique Mécanique, Thermique et Optique - Sciences et Technologies (UMR 6174)

In a previous paper~\cite{HPCS2002}, we have shown the very high power of asynchronism for parallel iterative algorithms in a global context of grid computing. In this article, we study the interest of coupling load balancing with asynchronism in such algorithms. After proposing a non-centralized version of dynamic load balancing which is best suited to asynchronism, we verify its efficiency by some experiments on a general Partial Differential Equation (PDE) problem. Finally, we give some general conditions for the use of load balancing to obtain good results with this kind of algorithms and discuss the choice of the residual as an efficient load estimator.

Mots clés: Parallel iterative algorithms; asynchronism; load-balancing

Domaines: Calcul parallèle, distribué et partagé [cs.DC]

Jacques M. Bahi, Sylvain Contassot-Vivier, Raphaël Couturier. Dynamic Load Balancing and Efficient Load Estimators for Asynchronous Iterative Algorithms. IEEE Transactions on Parallel and Distributed Systems, 2005, 16, pp.289--299. ⟨hal-00096258⟩