Modeling the latency on production grids with respect to the execution context

Abstract : In this paper, we study grid jobs latency. Together with outliers, latency highly impacts applications performance on production grids, due to its order of magnitude and important variations. It is particularly prejudicial for determining the expected duration of applications handling a high number of jobs and it makes outliers detection difficult. In a previous work, a probabilistic model of the latency has been used to estimate an optimal timeout value considering a given distribution of jobs latencies. This timeout value is then used in a job resubmission strategy. The purpose of this paper is to evaluate to what extent updating this model with relevant contextual parameters can help to refine the latency estimation. In the first part of the paper, we study the validity of parameters along several weeks. Experiments on the EGEE production grid show that performance can be improved by updating model parameters. In the second part, we study the influence of the resource broker or the computing site and the day of the week. We experimentally show that some of them have a statistically significant influence on the job latency. We exploit this contextual information in the perspective of improving job submission strategies.
Liste complète des métadonnées

Cited literature [11 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-00459261
Contributor : Diane Lingrand <>
Submitted on : Tuesday, February 23, 2010 - 3:22:28 PM
Last modification on : Monday, November 5, 2018 - 3:52:09 PM
Document(s) archivé(s) le : Thursday, June 30, 2011 - 11:27:19 AM

File

lingrand-glatard-etal_2009.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Diane Lingrand, Tristan Glatard, Johan Montagnat. Modeling the latency on production grids with respect to the execution context. Parallel Computing, Elsevier, 2009, 35 (10-11), pp.493--511. ⟨10.1016/j.parco.2009.07.003⟩. ⟨hal-00459261⟩

Share

Metrics

Record views

206

Files downloads

167