The Case for Dynamic Placement of Distributed Systems Components

Abstract : Today distributed systems are made of many software components with complex interactions. One of the key challenges in such an environment is determining how to place the components so that the system performs efficiently. In this paper, we illustrate the importance of component placement with a case study, examining the performance of a common stream processing pipeline comprising Kafka, Spark, and Cassandra. We study three applications (word count, Twitter sentiment analysis, machine learning) and three placement strategies. Our results show that (i) placement has a significant impact on the application throughput (up to 52%) and (ii) the placement achieving best results differs depending on the application. We discuss why existing solutions for performance troubleshooting in distributed systems are not sufficient to help choosing an efficient placement or to detect if a chosen placement is significantly under-performing compared to others. Finally, we describe research directions to address this open problem.
Type de document :
Communication dans un congrès
Conférence d’informatique en Parallélisme, Architecture et Système 2018 (COMPAS 2018), Jul 2018, Toulouse, France
Liste complète des métadonnées

Littérature citée [3 références]  Voir  Masquer  Télécharger

http://hal.univ-grenoble-alpes.fr/hal-01885794
Contributeur : Renaud Lachaize <>
Soumis le : mardi 2 octobre 2018 - 12:14:07
Dernière modification le : samedi 24 novembre 2018 - 01:24:12

Fichier

main.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01885794, version 1

Citation

Maha Alsayasneh, Vivien Quéma, Renaud Lachaize. The Case for Dynamic Placement of Distributed Systems Components. Conférence d’informatique en Parallélisme, Architecture et Système 2018 (COMPAS 2018), Jul 2018, Toulouse, France. 〈hal-01885794v1〉

Partager

Métriques

Consultations de la notice

39

Téléchargements de fichiers

21