Evaluation of Dataflow Programming Models for Electronic Structure Theory

Abstract : Dataflow programming models have been growing in popularity as a means to deliver a good balance between performance and portability in the post-petascale era. In this paper we evaluate different dataflow programming models for electronic structure methods and compare them in terms of programmability, resource utilization, and scalability. In particular, we evaluate two programming paradigms for expressing scientific applications in a dataflow form: (1) explicit dataflow, where the dataflow is specified explicitly by the developer, and (2) implicit dataflow, where a task scheduling runtime derives the dataflow using per-task data-access information embedded in a serial program. We discuss our findings and present a thorough experimental analysis using methods from the NWCHEM quantum chemistry application as our case study, and OPENMP, STARPU and PARSEC as the task-based runtimes that enable the different forms of dataflow execution. Furthermore, we derive an abstract model to explore the limits of the different dataflow programming paradigms.
Complete list of metadatas

Cited literature [36 references]  Display  Hide  Download

https://hal.inria.fr/hal-01725804
Contributor : Mathieu Faverge <>
Submitted on : Wednesday, March 7, 2018 - 4:18:30 PM
Last modification on : Thursday, December 13, 2018 - 6:48:02 PM
Long-term archiving on : Friday, June 8, 2018 - 2:30:39 PM

File

paper.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01725804, version 1

Citation

Heike Jagode, Anthony Danalis, Reazul Hoque, Mathieu Faverge, Jack Dongarra. Evaluation of Dataflow Programming Models for Electronic Structure Theory. Concurrency and Computation: Practice and Experience, Wiley, In press, pp.23. ⟨hal-01725804⟩

Share

Metrics

Record views

208

Files downloads

299