Characterization and Comparison of Google Cloud Load versus Grids

Sheng Di 1, * Derrick Kondo 1 Walfredo Cirne 2
* Auteur correspondant
1 MESCAL - Middleware efficiently scalable
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
2 Google Inc.
Google Inc [Mountain View]
Abstract : A new era of Cloud Computing has emerged, but the characteristics of Cloud load in data centers is not perfectly clear. Yet this characterization is critical for the design of novel Cloud job and resource management systems. In this paper, we comprehensively characterize the job/task load and host load in a real-world production data center at Google Inc. We use a detailed trace of over 25 million tasks across over 12,500 hosts. We study the differences between a Google data center and other Grid/HPC systems, from the perspective of both work load (w.r.t. jobs and tasks) and host load (w.r.t. machines). In particular, we study the job length, job submission frequency, and the resource utilization of jobs in the different systems, and also investigate valuable statistics of machine's maximum load, queue state and relative usage levels, with different job priorities and resource attributes. We find that the Google data center exhibits finer resource allocation with respect to CPU and memory than that of Grid/HPC systems. Google jobs are always submitted with much higher frequency and they are much shorter than Grid jobs. As such, Google host load exhibits higher variance and noise.
Type de document :
Rapport
2012
Liste complète des métadonnées

Littérature citée [16 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-00705858
Contributeur : Derrick Kondo <>
Soumis le : vendredi 8 juin 2012 - 13:52:27
Dernière modification le : jeudi 11 octobre 2018 - 08:48:02
Document(s) archivé(s) le : lundi 10 septembre 2012 - 12:05:15

Fichier

gtrace-cluster.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-00705858, version 1

Collections

Citation

Sheng Di, Derrick Kondo, Walfredo Cirne. Characterization and Comparison of Google Cloud Load versus Grids. 2012. 〈hal-00705858〉

Partager

Métriques

Consultations de la notice

631

Téléchargements de fichiers

1428