Towards a control-theory approach for minimizing unused grid resources

Emmanuel Stahl 1 Agustín Yabo 2, 3 Olivier Richard 4 Bruno Bzeznik 5 Bogdan Robu 6 Eric Rutten 3
2 BIOCORE - Biological control of artificial ecosystems
CRISAM - Inria Sophia Antipolis - Méditerranée , INRA - Institut National de la Recherche Agronomique, LOV - Laboratoire d'océanographie de Villefranche
3 CTRL-A - Control techniques for Autonomic, adaptive and Reconfigurable Computing systems
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
4 DATAMOVE - Data Aware Large Scale Computing
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
6 GIPSA-SYSCO - SYSCO
GIPSA-DA - Département Automatique
Abstract : HPC systems are facing more and more variability in their behavior, related to e.g., performance and power consumption, and the fact that they are less predictable requires more runtime management. This can be done in an Autonomic Management feedback loop, in response to monitored information in the systems, by analysis of this data and utilization of the results in order to activate appropriate system-level or application-level feedback mechanisms (e.g., informing schedulers, down-clocking CPUs). One such problem is found in the context of CiGri, a simple, lightweight, scalable and fault tolerant grid system which exploits the unused resources of a set of computing clusters. Computing power left over by the execution of a main HPC application scheduling is used to execute smaller jobs, which are injected as much as the global system allows. This paper presents rst results addressing the problem of au- tomated resource management in an HPC infrastructure, using techniques from Control Theory to design a controller that maximizes cluster utilization while avoiding overload. We put in place a mechanism for feedback (Proportional Integral, PI) control system software, through a maximum number of jobs to be sent to the cluster, in response to system information about the current number of jobs processed.
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01823787
Contributor : Éric Rutten <>
Submitted on : Tuesday, December 18, 2018 - 3:04:14 PM
Last modification on : Friday, April 5, 2019 - 8:24:12 PM
Document(s) archivé(s) le : Wednesday, March 20, 2019 - 2:33:29 PM

File

CtrlCiGri.pdf
Files produced by the author(s)

Identifiers

Citation

Emmanuel Stahl, Agustín Yabo, Olivier Richard, Bruno Bzeznik, Bogdan Robu, et al.. Towards a control-theory approach for minimizing unused grid resources. AI-Science'18 - workshop on Autonomous Infrastructure for Science, in conjunction with the ACM HPDC 2018, Jun 2018, Tempe, AZ, United States. pp.1-8, ⟨10.1145/3217197.3217201⟩. ⟨hal-01823787⟩

Share

Metrics

Record views

338

Files downloads

49