Copyright Notice:

The documents distributed by this server have been provided by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a noncommercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Publications of SPCL

A. Friedley, G. Bronevetsky, A. Lumsdaine, T. Hoefler:

 Hybrid MPI: Efficient Message Passing for Multi-core Systems

(Vol , Nr. , In IEEE/ACM International Conference on High Performance Computing, Networking, Storage and Analysis (SC13), presented in Denver, Colorado, USA, pages 18:1--18:11, , ISSN: , ISBN: 978-1-4503-2378-9, Nov. 2013, )

Publisher Reference


Multi-core shared memory architectures are ubiquitous in both High-Performance Computing (HPC) and commodity systems because they provide an excellent trade-off between performance and programmability. MPI’s abstraction of explicit communication across distributed memory is very popular for programming scientific applications. Unfortunately, OS-level process separations force MPI to perform unnecessary copying of messages within shared memory nodes. This paper presents a novel approach that transparently shares memory across MPI processes executing on the same node, allowing them to communicate like threaded applications. While prior work explored thread-based MPI libraries, we demonstrate that this approach is impractical and performs poorly in practice. We instead propose a novel process-based approach that enables shared memory communication and integrates with existing MPI libraries and applications without modifications. Our protocols for shared memory message passing exhibit better performance and reduced cache footprint. Communication speedups of more than 26% are demonstrated for two applications.


download article:


  author={A. Friedley and G. Bronevetsky and A. Lumsdaine and T. Hoefler},
  title={{Hybrid MPI: Efficient Message Passing for Multi-core Systems}},
  booktitle={IEEE/ACM International Conference on High Performance Computing, Networking, Storage and Analysis (SC13)},
  location={Denver, Colorado, USA},