Workflow-based data parallel applications on the EGEE production grid infrastructure

Abstract : Setting up and deploying complex applications on a grid infrastructure is still challenging and the programming models are rapidly evolving. Efficiently exploiting grid parallelism is often not straight forward. In this paper, we report on the techniques used for deploying applications on the EGEE production grid through four experiments coming from completely different scientific areas: nuclear fusion, astrophysics and medical imaging. These applications have in common the need for manipulating huge amounts of data and all are computationally intensive. All the cases studied show that the deployment of data intensive applications require the development of more or less elaborated application-level workload management systems on top of the gLite middleware to efficiently exploit the EGEE grid resources. In particular, the adoption of high level workflow management systems eases the integration of large scale applications while exploiting grid parallelism transparently. Different approaches for scientific workflow management are discussed. The MOTEUR workflow manager strategy to efficiently deal with complex data flows is more particularly detailed. Without requiring specific application development, it leads to very significant speed-ups.
Type de document :
Article dans une revue
Journal of Grid Computing, Springer Verlag, 2008, 6 (8), pp.369-383. <10.1007/s10723-008-9108-x>
Liste complète des métadonnées


https://hal.archives-ouvertes.fr/hal-00683983
Contributeur : Johan Montagnat <>
Soumis le : vendredi 30 mars 2012 - 12:39:22
Dernière modification le : mardi 13 décembre 2016 - 15:40:29
Document(s) archivé(s) le : mercredi 14 décembre 2016 - 18:52:13

Fichier

montagnat-glatard-etal-2008.pd...
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Johan Montagnat, Tristan Glatard, Isabel Campos Plasencia, Francisco Castejon, Xavier Pennec, et al.. Workflow-based data parallel applications on the EGEE production grid infrastructure. Journal of Grid Computing, Springer Verlag, 2008, 6 (8), pp.369-383. <10.1007/s10723-008-9108-x>. <hal-00683983>

Partager

Métriques

Consultations de
la notice

461

Téléchargements du document

244