Distributed File System for Clusters and Grids

Olivier Valentin (1) , Pierre Lombard (1) , Adrien Lebre (1) , Christian Guinet (1) , Yves Denneulin (1)

1 LIG - Laboratoire d'Informatique de Grenoble

NFSG aims at providing a solution for file accesses within a cluster of clusters. Criteria of easiness (installation, administration, usage) but also efficiency as well as a minimal hardware and software intrusivity have led our developments. By using several facilities such as distributed file systems (NFSP) and a high-performance data transfer utility (GXfer), we hope to offer a software architecture fully compatible with the ubiquitous NFS protocol. Thanks to a distributed storage (especially multiple I/O servers provided by NFSP), several parallel streams may be used when copying a file from one cluster to another within a same grid. This technique improves data transfers by connecting distributed file system at both ends. The GXfer component implements this functionality. Thus, performances only reachable with dedicated and expensive hardware may be achieved.

Domaines: Calcul parallèle, distribué et partagé [cs.DC]; Système d'exploitation [cs.OS]

Olivier Valentin, Pierre Lombard, Adrien Lebre, Christian Guinet, Yves Denneulin. Distributed File System for Clusters and Grids. PPAM 2003: Parallel Processing and Applied Mathematics, Sep 2003, Czestochowa, Poland. pp.1099-1104, ⟨10.1007/978-3-540-24669-5_142⟩. ⟨hal-01664536⟩