Towards a High-Level Description for Generating Stream Processing Benchmark Applications

Abstract : The relevance of Data Stream Processing (DSP) is nowadays established, thanks to its capability to analyze continuous streams and provide statistics in real-time. A considerable amount of work has been dedicated to improve performance and features of DSP platforms. Thus, benchmark application are necessary for comparison and evaluation. Unfortunately, in literature, these applications are often briefly described, the source is not available, they are too context-specific or don't provide enough flexibility. That makes it difficult for a developer to quickly evaluate the impact of some design choices. To address these issues, we introduce a high-level description model of stream applications. Based on fundamental DSP characteristics , this description allow an easy and flexible definition of benchmark topologies. With this model we aim to provide easily replicable, comparable and customizable benchmarks for DSP. We then use a framework prototype that translates the high-level description into platform-specific code simulating the application workload.
Complete list of metadatas

Cited literature [27 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02371215
Contributor : Alessio Pagliari <>
Submitted on : Tuesday, November 19, 2019 - 5:58:07 PM
Last modification on : Saturday, November 23, 2019 - 1:39:33 AM

File

workflow-description-benchmark...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02371215, version 1

Collections

Citation

Alessio Pagliari, Fabrice Huet, Guillaume Urvoy-Keller. Towards a High-Level Description for Generating Stream Processing Benchmark Applications. The Third IEEE International Workshop on Benchmarking, Performance Tuning and Optimization for Big Data Applications (BPOD 2019), Dec 2019, Los Angeles, United States. ⟨hal-02371215⟩

Share

Metrics

Record views

17

Files downloads

32