Skip to Main content Skip to Navigation
Conference papers

Rethinking Operators Placement of Stream Data Application in the Edge

Thomas Lambert 1, 2 David Guyon 1, 2 Shadi Ibrahim 1, 2 
1 STACK - Software Stack for Massively Geo-Distributed Infrastructures
Inria Rennes – Bretagne Atlantique , LS2N - Laboratoire des Sciences du Numérique de Nantes
Abstract : Maximum Sustainable Throughput (MST) refers to the amount of data that a Data Stream Processing (DSP) system can ingest while keeping stable performance. It has been acknowledged as an accurate metric to evaluate the performance of stream data processing. Yet, existing operators placements continue to focus on latency and throughput, not MST, as main performance objective when deploy- ing stream data applications in the Edge. In this paper, we argue that MST should be used as an optimization objective when placing operators. This is specially important in the Edge, where network bandwidth and data streams are highly dynamic. We demonstrate that through the design and evaluation of a MST-driven operators placement (based on constraint programming) for stream data applications. Through simulations, we show how existing placement strategies that target overall communications reduction often fail to keep up with the rate of data streams. Importantly, the constraint programming-based operators placement is able to sustain up to 5x increased data ingestion compared to baseline strategies.
Complete list of metadata

Cited literature [13 references]  Display  Hide  Download
Contributor : Thomas Lambert Connect in order to contact the contributor
Submitted on : Monday, November 2, 2020 - 5:14:21 PM
Last modification on : Friday, August 5, 2022 - 2:54:52 PM


Files produced by the author(s)



Thomas Lambert, David Guyon, Shadi Ibrahim. Rethinking Operators Placement of Stream Data Application in the Edge. CIKM 2020- 29th ACM International Conference on Information and Knowledge Management, Oct 2020, Dublin, Ireland. ⟨10.1145/3340531.3412116⟩. ⟨hal-02942759⟩



Record views


Files downloads