DfAnalyzer: Runtime Dataflow Analysis of Scientific Applications using Provenance

Vítor Silva (1) , Daniel de Oliveira (2) , Patrick Valduriez (3) , Marta Mattoso (1)

1 COPPE-UFRJ - Instituto Alberto Luiz Coimbra de Pós-Graduação e Pesquisa de Engenharia
2 Fluminense Federal University [Niterói]
3 ZENITH - Scientific Data Management

We present DfAnalyzer, a tool that enables monitoring, debugging, steering, and analysis of dataflows while being generated by scientific applications. It works by capturing strategic domain data, registering provenance and execution data to enable queries at runtime. DfAnalyzer provides lightweight dataflow monitoring components to be invoked by high performance applications. It can be plugged in scripts, or Spark applications, in the same way users already plug visualization library components. During this demo, we will show how DfAnalyzer captures the dataflow, provenance, as well as how it provides runtime data analyses of applications. We will also encourage attendees to use DfAnalyzer for their own applications. PVLDB Reference Format: Vítor Silva, Daniel de Oliveira, Patrick Valduriez, Marta Mattoso. Word Template for VLDB Conferences. PVLDB, 11(5): xxxx-2018, 2018. DOI: https://doi.org/TBD

Domaines: Base de données [cs.DB]

Vítor Silva, Daniel de Oliveira, Patrick Valduriez, Marta Mattoso. DfAnalyzer: Runtime Dataflow Analysis of Scientific Applications using Provenance. Proceedings of the VLDB Endowment (PVLDB), 2018, 11 (12), pp.2082-2085. ⟨10.14778/3229863.3236265⟩. ⟨lirmm-01867887⟩