Assessing the Impact of Network Bandwidth and Operator Placement on Data Stream Processing for Edge Computing Environments

Alexandre da Silva Veith (1) , Marcos Dias de Assuncao (1) , Laurent Lefèvre (1)

1 AVALON - Algorithms and Software Architectures for Distributed and HPC Platforms

A substantial part of the " big data " generated today is received in near real time and must be promptly processed. Cloud-based architectures for data stream processing comprise multiple software modules or frameworks for data collection, message queueing, and stream processing itself. This modular approach allows each component to grow independently from one another and accommodate changes, but it may increase the end-to-end latency when data events are processed in the cloud. Recent solutions intend to explore the edges of the Internet (i.e. edge computing) to perform certain data processing tasks and hence better utilise network resources. This work evaluates the impact regarding network bandwidth while employing frameworks that are commonly used to build cloud and edge-based stream processing solutions. Mots-clés : Traitement de flux de données, méta-données, analyse de performance, systèmes distribués, informatique en nuages

Mots clés: analyse de performance; Traitement de flux de données; méta-données; systèmes distribués; informatique en nuages

Domaines: Calcul parallèle, distribué et partagé [cs.DC]; Performance et fiabilité [cs.PF]

Alexandre da Silva Veith, Marcos Dias de Assuncao, Laurent Lefèvre. Assessing the Impact of Network Bandwidth and Operator Placement on Data Stream Processing for Edge Computing Environments. COMPAS'2017 - Conférence d’informatique en Parallélisme, Architecture et Système, Jun 2017, Antibes, France. ⟨hal-01574448⟩