Copyright Notice:

The documents distributed by this server have been provided by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a noncommercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Publications of SPCL

T. Hoefler, J. Squyres, G. Fagg, G. Bosilca, W. Rehm, A. Lumsdaine:

 A New Approach to MPI Collective Communication Implementations

(. Vol , Nr. , In Distributed and Parallel Systems - From Cluster to Grid Computing (DAPSYS'06), presented in Innsbruck, Austria, pages 45-54, Springer, ISSN: , ISBN: 978-0-387-69857-1, Sep. 2006)


Recent research into the optimization of collective MPI operations has resulted in a wide variety of algorithms and corresponding implementations, each typically only applicable in a relatively narrow scope: on a specific architecture, on a specific network, with a specific number of processes, with a specific data size and/or data-type ­ or any combination of these (or other) factors. This situation presents an enormous challenge to portable MPI implementations which are expected to provide optimized collective operation performance on all platforms. Many portable implementations have attempted to provide a token number of algorithms that are intended to realize good performance on most systems. However, many platform configurations are still left without well-tuned collective operations. This paper presents a proposal for a framework that will allow a wide variety of collective algorithm implementations and a flexible, multi-tiered selection process for choosing which implementation to use when an application invokes an MPI collective function.


download article:
download slides:


  author={Torsten Hoefler and J. Squyres and G. Fagg and G. Bosilca and Wolfgang Rehm and Andrew Lumsdaine},
  title={{A New Approach to MPI Collective Communication Implementations}},
  booktitle={Distributed and Parallel Systems - From Cluster to Grid Computing (DAPSYS'06)},
  location={Innsbruck, Austria},