Scalable and Resilient Workflow Executions on Production Distributed Computing Infrastructures

Abstract : In spite of the growing interest for grids and cloud infrastructures among scientific communities and the availability of such facilities at large--scale, achieving high performance in production environments remains challenging due to at least four factors: the low reliability of very large--scale distributed computing infrastructures, the performance overhead induced by shared facilities, the difficulty to obtain fair balance of all user jobs in such an heterogeneous environment, and the complexity of large--scale distributed applications deployment. All together, these difficulties make infrastructure exploitation complex, and often limited to experts. This paper introduces a pragmatic solution to tackle these four issues based on a service-oriented methodology, the reuse of existing middleware services, and the joint exploitation of local and distributed computing resources. Emphasis is put on the integrated environment ease of use. Results on an actual neuroscience application show the impact of the environment setup in terms of reliability and performance. Recommendations and best practices are derived from this experiment.
Type de document :
Communication dans un congrès
International Symposium on Parallel and Distributed Computing (ISPDC 2012), Jun 2012, Münich, Germany. pp.1-8, 2012
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-00691579
Contributeur : Johan Montagnat <>
Soumis le : jeudi 26 avril 2012 - 15:58:05
Dernière modification le : vendredi 27 avril 2012 - 09:46:12
Document(s) archivé(s) le : jeudi 15 décembre 2016 - 02:22:00

Fichier

ispdc.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-00691579, version 1

Collections

Citation

Javier Rojas Balderrama, Tram Truong Huu, Johan Montagnat. Scalable and Resilient Workflow Executions on Production Distributed Computing Infrastructures. International Symposium on Parallel and Distributed Computing (ISPDC 2012), Jun 2012, Münich, Germany. pp.1-8, 2012. <hal-00691579>

Partager

Métriques

Consultations de
la notice

115

Téléchargements du document

92