Self-healing of workflow activity incidents on distributed computing infrastructures

R. Ferreira da Silva 1 T. Glatard 1 Frédéric Desprez 2
1 Images et Modèles
CREATIS - Centre de Recherche en Acquisition et Traitement de l'Image pour la Santé
2 GRAAL - Algorithms and Scheduling for Distributed Heterogeneous Platforms
Inria Grenoble - Rhône-Alpes, LIP - Laboratoire de l'Informatique du Parallélisme
Abstract : Distributed computing infrastructures are commonly used through scientific gateways, but operating these gateways requires important human intervention to handle operational incidents. This paper presents a self-healing process that quantifies incident degrees of workflow activities from metrics measuring long-tail effect, application efficiency, data transfer issues, and site-specific problems. These metrics are simple enough to be computed online and they make little assumptions on the application or resource characteristics. From their degree, incidents are classified in levels and associated to sets of healing actions that are selected based on association rules modeling correlations between incident levels. We specifically study the long-tail effect issue, and propose a new algorithm to control task replication. The healing process is parametrized on real application traces acquired in production on the European Grid Infrastructure. Experimental results obtained in the Virtual Imaging Platform show that the proposed method speeds up execution up to a factor of 4, consumes up to 26% less resource time than a control execution and properly detects unrecoverable errors.
Document type :
Journal articles
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-00828491
Contributor : Béatrice Rayet <>
Submitted on : Friday, May 31, 2013 - 10:47:22 AM
Last modification on : Friday, October 26, 2018 - 10:47:33 AM

Identifiers

Citation

R. Ferreira da Silva, T. Glatard, Frédéric Desprez. Self-healing of workflow activity incidents on distributed computing infrastructures. Future Generation Computer Systems, Elsevier, 2013, 29 (8), pp.2284-2294. ⟨10.1016/j.future.2013.06.012⟩. ⟨hal-00828491⟩

Share

Metrics

Record views

495