Skip to Main content Skip to Navigation
Conference papers

Building Analytics Pipelines for Querying Big Streams and Data Histories with H-STREAM

Abstract : This paper introduces H-STREAM, a big stream/data processing pipelines evaluation engine that proposes stream processing operators as micro-services to support the analysis and visualisation of Big Data streams stemming from IoT (Internet of Things) environments. H-STREAM micro-services combine stream processing and data storage techniques tuned depending on the number of things producing streams, the pace at which they produce them, and the physical computing resources available for processing them online and delivering them to consumers. H-STREAM delivers stream processing and visualisation micro-services installed in a cloud environment. Micro-services can be composed for implementing specific stream aggregation analysis pipelines as queries. The paper presents an experimental validation using Microsoft Azure as a deployment environment for testing the capacity of H-STREAM for dealing with velocity and volume challenges in an (i) a neuroscience experiment and (in) a social connectivity analysis scenario running on IoT farms.
Document type :
Conference papers
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-03318618
Contributor : Genoveva Vargas-Solar Connect in order to contact the contributor
Submitted on : Tuesday, August 10, 2021 - 2:23:45 PM
Last modification on : Friday, December 3, 2021 - 3:48:32 AM

Links full text

Identifiers

  • HAL Id : hal-03318618, version 1
  • ARXIV : 2108.03485

Citation

Genoveva Vargas-Solar, Javier A. Espinosa-Oviedo. Building Analytics Pipelines for Querying Big Streams and Data Histories with H-STREAM. 19th International Conference on Service-Oriented Computing, Nov 2021, Dubai, United Arab Emirates. ⟨hal-03318618⟩

Share

Metrics

Record views

23