An optimized workflow enactor for data-intensive grid applications

Tristan Glatard (1) , Johan Montagnat (2) , Xavier Pennec (3)

1 CREATIS - Centre de Recherche et d'Application en Traitement de l'Image et du Signal
2 Laboratoire d'Informatique, Signaux, et Systèmes de Sophia-Antipolis (I3S) / Equipe MODALIS
3 ASCLEPIOS - Analysis and Simulation of Biomedical Images

Data-intensive applications benefit from an intrinsic data parallelism that should be exploited on parallel systems to lower execution time. In the last years, data grids have been developed to handle, process, and analyze the tremendous amount of data produced in many scientific areas. Although very large, these grid infrastructures are under heavy use and efficiency is of utmost importance. This paper deals with the optimization of workflow managers used for deploying complex data-driven applications on grids. In that kind of application, we show how to better exploit data parallelism than currently done in most existing workflow managers. We present the design of a prototype implementing our solution and we show that it provides a significant speed-up w.r.t existing solutions by exemplifying results on a realistic medical imaging application.

Domaines: Calcul parallèle, distribué et partagé [cs.DC]

Tristan Glatard, Johan Montagnat, Xavier Pennec. An optimized workflow enactor for data-intensive grid applications. 2005, pp.17. ⟨hal-00691833⟩