Scheduling Independent Moldable Tasks on Multi-Cores with GPUs

Abstract : The number of parallel systems using accelerators is growing up. The technology is now mature enough to allow sustained petaflop/s. However, reaching this performance scale requires efficient scheduling algorithms to manage the heterogeneous computing resources. We present a new approach for scheduling independent tasks on multiple CPUs and multiple GPUs. The tasks are assumed to be parallelizable on CPUs using the moldable model: the final number of cores allotted to a task can be decided and set by the scheduler. More precisely, we design an algorithm aiming at minimizing the makespan---the maximum completion time of all tasks---for this scheduling problem. The proposed algorithm combines a dual approximation scheme with a fast integer linear program (ILP). It determines both the partitioning of the tasks, ie whether a task should be mapped to CPUs or a GPU, and the number of CPUs allotted to a moldable task if mapped to the CPUs. A worst case analysis shows that the algorithm has an approximation ratio of $\frac{3}{2} + \epsilon$. However, since the complexity of the ILP-based algorithm could be non-polynomial, we also present a proved polynomial-time algorithm with an approximation ratio of $2+\epsilon$. We complement the theoretical analysis of our two novel algorithms with an experimental study. In these experiments, we compare our algorithms to a modified version of the classical \heft algorithm, adapted to handle moldable tasks. The experimental results show that our algorithm with the $\frac{3}{2} + \epsilon$ approximation ratio produces significantly shorter schedules than the modified \heft for most of the instances. In addition, the experiments provide evidence that this ILP-based algorithm is also practically able to solve larger problem instances in a reasonable amount of time.
Type de document :
Rapport
[Research Report] RR-8850, Inria Grenoble Rhône-Alpes, Université de Grenoble. 2016
Liste complète des métadonnées

Littérature citée [26 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01263100
Contributeur : Grégory Mounié <>
Soumis le : mercredi 27 janvier 2016 - 13:53:01
Dernière modification le : vendredi 21 décembre 2018 - 10:46:08
Document(s) archivé(s) le : jeudi 28 avril 2016 - 11:23:41

Fichier

RR-8850.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01263100, version 1

Citation

Raphaël Bleuse, Sascha Hunold, Safia Kedad-Sidhoum, Florence Monna, Grégory Mounié, et al.. Scheduling Independent Moldable Tasks on Multi-Cores with GPUs. [Research Report] RR-8850, Inria Grenoble Rhône-Alpes, Université de Grenoble. 2016. 〈hal-01263100〉

Partager

Métriques

Consultations de la notice

783

Téléchargements de fichiers

438