PDI, an approach to decouple I/O concerns from high-performance simulation codes

Abstract : High-performance computing (HPC) applications manipulate and store large datasets for scientific analysis, visualization purposes and/or resiliency. Multiple software libraries have been designed for interacting with the parallel file system and in some cases with intermediate storage levels. These libraries provide different level of abstraction and have been optimized for different purposes. The best I/O library for a given usage depends on multiple criteria including the purpose of the I/O, the computer architecture or the problem size. Therefore, to optimize their I/O strategies, scientists have to use multiple API's depending on the targeted execution. As a result, simulation codes contain intrusive and library dependent I/O instructions interwoven with domain instructions. In this paper, we propose a novel interface that transparently manage the I/O aspects and support multiple I/O libraries within the same execution. We demonstrate the low overhead of our interface and perform experiments at scale with the Gysela production code.
Type de document :
Pré-publication, Document de travail
Liste complète des métadonnées

Littérature citée [26 références]  Voir  Masquer  Télécharger

Contributeur : Corentin Roussel <>
Soumis le : mercredi 13 septembre 2017 - 16:01:44
Dernière modification le : mardi 24 avril 2018 - 13:54:00
Document(s) archivé(s) le : jeudi 14 décembre 2017 - 13:42:43


Fichiers produits par l'(les) auteur(s)


Distributed under a Creative Commons Paternité 4.0 International License


  • HAL Id : hal-01587075, version 1


Corentin Roussel, Kai Keller, Mohamed Gaalich, Leonardo Bautista Gomez, Julien Bigot. PDI, an approach to decouple I/O concerns from high-performance simulation codes. 2017. 〈hal-01587075〉



Consultations de la notice


Téléchargements de fichiers