TWINS: Server Access Coordination in the I/O Forwarding Layer

Abstract : This paper presents a study of I/O scheduling techniques applied to the I/O forwarding layer. In high-performance computing environments, applications rely on parallel file systems (PFS) to obtain good I/O performance even when handling large amounts of data. To alleviate the concurrency caused by thousands of nodes accessing a significantly smaller number of PFS servers, intermediate I/O nodes are typically applied between processing nodes and the file system. Each intermediate node forwards requests from multiple clients to the system, a setup which gives this component the opportunity to perform optimizations like I/O scheduling. We evaluate scheduling techniques that improve spatiality and request size of the access patterns. We show they are only partially effective because the access pattern is not the main factor for read performance in the I/O forwarding layer. A new scheduling algorithm, TWINS, is presented to coordinate the access of intermediate I/O nodes to the data servers. Our proposal decreases concurrency at the data servers, a factor previously proven to negatively affect performance. The proposed algorithm is able to improve read performance from shared files by up to 28% over other scheduling algorithms and by up to 50% over not forwarding I/O.
Complete list of metadatas

Cited literature [28 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01515047
Contributor : Jean-Francois Méhaut <>
Submitted on : Thursday, April 27, 2017 - 2:52:40 AM
Last modification on : Thursday, November 8, 2018 - 2:24:07 PM
Long-term archiving on : Friday, July 28, 2017 - 12:49:03 PM

File

pdp2017-twins-hal.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01515047, version 1

Citation

Jean Luca Bez, Francieli Zanon Boito, Lucas Schnorr, Philippe Navaux, Jean-François Méhaut. TWINS: Server Access Coordination in the I/O Forwarding Layer. 25th Euromicro International Conference on Parallel, Distributed and Networked-based Processing, Igor Kotenko, Mar 2017, St. Petersburg, Russia. ⟨hal-01515047⟩

Share

Metrics

Record views

973

Files downloads

168