Automatic I/O scheduling algorithm selection for parallel file systems - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Concurrency and Computation: Practice and Experience Année : 2016

Automatic I/O scheduling algorithm selection for parallel file systems

Résumé

This article presents our approach to provide input/output (I/O) scheduling with double adaptivity: to applications and devices. In high-performance computing environments, parallel file systems provide a shared storage infrastructure to applications. In the situation where multiple applications access this shared infrastructure concurrently, their performance can be impaired because of interference. Our work focuses on I/O scheduling as a tool to improve performance by alleviating interference effects. The role of the I/O scheduler is to decide the order in which applications' requests must be processed by the parallel file system's servers, applying optimizations to adjust the resulting access pattern for improved performance. Our approach to improve I/O scheduling results is based on using information from applications' access patterns and storage devices' sensitivity to access sequentiality. We have applied machine learning to provide the ability to automatically select the best scheduling algorithm for each situation. Our approach improves performance by up to 75% over an approach that uses the same scheduling algorithm to all situations, without adaptability. Our results evidence that both aspects – applications and storage devices – are essential to make good scheduling decisions.
Fichier principal
Vignette du fichier
concurrency2015.pdf (492.28 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01247942 , version 1 (17-01-2019)

Identifiants

Citer

Francieli Zanon Boito, Rodrigo V. Kassick, Philippe Olivier Alexandre Navaux, Yves Denneulin. Automatic I/O scheduling algorithm selection for parallel file systems. Concurrency and Computation: Practice and Experience, 2016, ⟨10.1002/cpe.3606⟩. ⟨hal-01247942⟩
156 Consultations
382 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More