Scheduling Data Flow Program in XKaapi: A New Affinity Based Algorithm for Heterogeneous Architectures

Abstract : Efficient implementations of parallel applications on hetero-geneous hybrid architectures require a careful balance between compu-tations and communications with accelerator devices. Even if most of the communication time can be overlapped by computations, it is es-sential to reduce the total volume of communicated data. The litera-ture therefore abounds with ad hoc methods to reach that balance, but these are architecture and application dependent. We propose here a generic mechanism to automatically optimize the scheduling between CPUs and GPUs, and compare two strategies within this mechanism: the classical Heterogeneous Earliest Finish Time (HEFT) algorithm and our new, parametrized, Distributed Affinity Dual Approximation algo-rithm (DADA), which consists in grouping the tasks by affinity before running a fast dual approximation. We ran experiments on a heteroge-neous parallel machine with twelve CPU cores and eight NVIDIA Fermi GPUs. Three standard dense linear algebra kernels from the PLASMA library have been ported on top of the XKaapi runtime system. We re-port their performances. It results that HEFT and DADA perform well for various experimental conditions, but that DADA performs better for larger systems and number of GPUs, and, in most cases, generates much lower data transfers than HEFT to achieve the same performance.
Type de document :
Communication dans un congrès
Euro-Par 2014 Parallel Processing - 20th International Conference, Aug 2014, Porto, Portugal. pp.560 - 571, 2014, 〈10.1007/978-3-319-09873-9_47〉
Liste complète des métadonnées

Littérature citée [17 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01081629
Contributeur : Grégory Mounié <>
Soumis le : mercredi 12 novembre 2014 - 18:18:00
Dernière modification le : dimanche 23 décembre 2018 - 01:25:35
Document(s) archivé(s) le : vendredi 13 février 2015 - 10:20:42

Fichier

europar2014.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Raphaël Bleuse, Thierry Gautier, João V. F. Lima, Grégory Mounié, Denis Trystram. Scheduling Data Flow Program in XKaapi: A New Affinity Based Algorithm for Heterogeneous Architectures. Euro-Par 2014 Parallel Processing - 20th International Conference, Aug 2014, Porto, Portugal. pp.560 - 571, 2014, 〈10.1007/978-3-319-09873-9_47〉. 〈hal-01081629〉

Partager

Métriques

Consultations de la notice

902

Téléchargements de fichiers

182