Adaptive MPI Multirail Tuning for Non-Uniform Input/Output Access

Stéphanie Moreaud (1, 2) , Brice Goglin (1, 2) , Raymond Namyst (1, 2)

1 LaBRI - Laboratoire Bordelais de Recherche en Informatique
2 RUNTIME - Efficient runtime systems for parallel architectures

Multicore processors have not only reintroduced Non-Uniform Memory Access (NUMA) architectures in nowadays parallel computers, but they are also responsible for non-uniform access times with respect to Input/Output devices (NUIOA). In clusters of multicore machines equipped with several Network Interfaces, performance of communication between processes thus depends on which cores these processes are scheduled on, and on their distance to the Network Interface Cards involved. We propose a technique allowing multirail communication between processes to carefully distribute data among the network interfaces so as to counterbalance NUIOA effects. We demonstrate the relevance of our approach by evaluating its implementation within OpenMPI on a Myri-10G + InfiniBand cluster.

Domains: Operating Systems [cs.OS]

Stéphanie Moreaud, Brice Goglin, Raymond Namyst. Adaptive MPI Multirail Tuning for Non-Uniform Input/Output Access. The 17th European MPI Users Group conference, Sep 2010, Stuttgart, Germany. pp.239-248, ⟨10.1007/978-3-642-15646-5_25⟩. ⟨inria-00486178⟩