Skip to Main content Skip to Navigation
Conference papers

Rethinking Operators Placement of Stream Data Application in the Edge

Thomas Lambert 1, 2 David Guyon 1, 2 Shadi Ibrahim 1, 2
1 STACK - Software Stack for Massively Geo-Distributed Infrastructures
Inria Rennes – Bretagne Atlantique , LS2N - Laboratoire des Sciences du Numérique de Nantes
Abstract : Maximum Sustainable Throughput (MST) refers to the amount of data that a Data Stream Processing (DSP) system can ingest while keeping stable performance. It has been acknowledged as an accurate metric to evaluate the performance of stream data processing. Yet, existing operators placements continue to focus on latency and throughput, not MST, as main performance objective when deploy- ing stream data applications in the Edge. In this paper, we argue that MST should be used as an optimization objective when placing operators. This is specially important in the Edge, where network bandwidth and data streams are highly dynamic. We demonstrate that through the design and evaluation of a MST-driven operators placement (based on constraint programming) for stream data applications. Through simulations, we show how existing placement strategies that target overall communications reduction often fail to keep up with the rate of data streams. Importantly, the constraint programming-based operators placement is able to sustain up to 5x increased data ingestion compared to baseline strategies.
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-02942759
Contributor : Thomas Lambert <>
Submitted on : Friday, September 18, 2020 - 11:34:27 AM
Last modification on : Sunday, September 20, 2020 - 3:04:22 AM

Identifiers

  • HAL Id : hal-02942759, version 1

Citation

Thomas Lambert, David Guyon, Shadi Ibrahim. Rethinking Operators Placement of Stream Data Application in the Edge. CIKM 2020- 29th ACM International Conference on Information and Knowledge Management, Oct 2020, Dublin, Ireland. ⟨hal-02942759⟩

Share

Metrics

Record views

61