Planner: Cost-efficient Execution Plans Placement for Uniform Stream Analytics on Edge and Cloud

Abstract : Stream processing applications handle unbounded and continuous flows of data items which are generated from multiple geographically distributed sources. Two approaches are commonly used for processing: Cloud-based analytics and Edge analytics. The first one routes the whole data set to the Cloud, incurring significant costs and late results from the high latency networks that are traversed. The latter can give timely results but forces users to manually define which part of the computation should be executed on Edge and to interconnect it with the remaining part executed in the Cloud, leading to sub-optimal placements. In this paper, we introduce Planner, a middleware for uniform and transparent stream processing across Edge and Cloud. Planner automatically selects which parts of the execution graph will be executed at the Edge in order to minimize the network cost. Real-world micro-benchmarks show that Planner reduces the network usage by 40% and the makespan (end-to-end processing time) by 15% compared to state-of-the-art.
Type de document :
Communication dans un congrès
WORKS 2018: 13th Workflows in Support of Large-Scale Science Workshop, held in conjunction with the IEEE/ACM SC18 conference, Nov 2018, Dallas, United States. pp.1-10
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01892718
Contributeur : Gabriel Antoniu <>
Soumis le : mercredi 10 octobre 2018 - 18:44:05
Dernière modification le : jeudi 15 novembre 2018 - 11:58:57

Fichier

Planner_WORKS_18.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01892718, version 1

Citation

Laurent Prosperi, Alexandru Costan, Pedro Silva, Gabriel Antoniu. Planner: Cost-efficient Execution Plans Placement for Uniform Stream Analytics on Edge and Cloud. WORKS 2018: 13th Workflows in Support of Large-Scale Science Workshop, held in conjunction with the IEEE/ACM SC18 conference, Nov 2018, Dallas, United States. pp.1-10. 〈hal-01892718〉

Partager

Métriques

Consultations de la notice

139

Téléchargements de fichiers

174