Copyright Notice:

The documents distributed by this server have been provided by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a noncommercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Publications of SPCL

A. Friedley, T. Hoefler, M. Leininger, A. Lumsdaine:

 Scalable High Performance Message Passing over InfiniBand for Open MPI

(In Proceedings of 3rd KiCC Workshop 2007, presented in Aachen, Germany, RWTH Aachen, Dec. 2007)

Abstract

InfiniBand (IB) is a popular network technology for modern high-performance computing systems. MPI implementations traditionally support IB using a reliable, connection-oriented (RC) transport. However, per-process resource usage that grows linearly with the number of processes, makes this approach prohibitive for large-scale systems. IB provides an alternative in the form of a connectionless unreliable datagram transport (UD), which allows for near-constant resource usage and initialization overhead as the process count increases. This paper describes a UD-based implementation for IB in Open MPI as a scalable alternative to existing RC-based schemes. We use the software reliability capabilities of Open MPI to provide the guaranteed delivery semantics required by MPI. Results show that UD not only requires fewer resources at scale, but also allows for shorter MPI startup times. A connectionless model also improves performance for applications that tend to send small messages to many different processes.

Documents

download article:
download slides:
 

BibTeX

@inproceedings{friedley-scalable-openmpi,
  author={A. Friedley and Torsten Hoefler and M. Leininger and Andrew Lumsdaine},
  title={{Scalable High Performance Message Passing over InfiniBand for Open MPI}},
  year={2007},
  month={12},
  booktitle={Proceedings of 3rd KiCC Workshop 2007},
  location={Aachen, Germany},
  publisher={RWTH Aachen},
}