Scheduling malleable applications in multicluster systems

Jérémy Buisson (1) , Ozan Sonmez (2) , Hashim Mohamed (2) , Wouter Lammers (2) , Dick Epema (2)

1 PARIS - Programming distributed parallel systems for large scale numerical simulation
2 PDS - Parallel and Distributed Group

In large-scale distributed execution environments such as multicluster systems and grids, resource availability may vary due to resource failures and because resources may be added to or withdrawn from such environments at any time. In addition, single sites in such systems may have to deal with workloads originating from both local users and from many other sources. As a result, application malleability, that is, the property of applications to deal with a varying amount of resources during their execution, may be very beneficial for performance. In this paper we present the design of the support of and scheduling policies for malleability in our Koala multicluster scheduler with the help of our Dynaco framework for application malleability. In addition, we show the results of experiments with scheduling malleable workloads with Koala in our DAS multicluster testbed.

Domaines: Calcul parallèle, distribué et partagé [cs.DC]

Jérémy Buisson, Ozan Sonmez, Hashim Mohamed, Wouter Lammers, Dick Epema. Scheduling malleable applications in multicluster systems. IEEE International Conference on Cluster Computing, Sep 2007, Austin, United States. pp.372, ⟨10.1109/CLUSTR.2007.4629252⟩. ⟨hal-00498790⟩