Modeling the latency on production grids with respect to the execution context

Diane Lingrand (1) , Tristan Glatard (2) , Johan Montagnat (1)

1 Laboratoire d'Informatique, Signaux, et Systèmes de Sophia-Antipolis (I3S) / Equipe MODALIS
2 Institute of Informatics/Academic Medical Center

In this paper, we study grid jobs latency. Together with outliers, latency highly impacts applications performance on production grids, due to its order of magnitude and important variations. It is particularly prejudicial for determining the expected duration of applications handling a high number of jobs and it makes outliers detection difficult. In a previous work, a probabilistic model of the latency has been used to estimate an optimal timeout value considering a given distribution of jobs latencies. This timeout value is then used in a job resubmission strategy. The purpose of this paper is to evaluate to what extent updating this model with relevant contextual parameters can help to refine the latency estimation. In the first part of the paper, we study the validity of parameters along several weeks. Experiments on the EGEE production grid show that performance can be improved by updating model parameters. In the second part, we study the influence of the resource broker or the computing site and the day of the week. We experimentally show that some of them have a statistically significant influence on the job latency. We exploit this contextual information in the perspective of improving job submission strategies.

Domains: Distributed, Parallel, and Cluster Computing [cs.DC]

Diane Lingrand, Tristan Glatard, Johan Montagnat. Modeling the latency on production grids with respect to the execution context. Parallel Computing, 2009, 35 (10-11), pp.493--511. ⟨10.1016/j.parco.2009.07.003⟩. ⟨hal-00459261⟩