Copyright Notice:

The documents distributed by this server have been provided by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a noncommercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Publications of SPCL

T. Hoefler, S. Gottlieb:

 Parallel Zero-Copy Algorithms for Fast Fourier Transform and Conjugate Gradient using MPI Datatypes

(Vol LNCS 6305, Nr. , In Recent Advances in the Message Passing Interface (EuroMPI'10), presented in Stuttgart, Germany, pages 132--141, Springer, ISSN: 0302-9743, ISBN: 078-3-642-15645-8, Sep. 2010, )

Publisher Reference

Abstract

Many parallel applications need to communicate non-contiguous data. Most applications manually copy (pack/unpack) data before communications even though MPI allows a zero-copy specification. In this work, we study two complex use-cases: (1) Fast Fourier Transformation where we express a local memory transpose as part of the datatype, and (2) a conjugate gradient solver with a checkerboard layout that requires multiple nested datatypes. We demonstrate significant speedups up to a factor of 3.8 and 18%, respectively, in both cases. Our work can be used as a template to utilize datatypes for application developers. For MPI implementers, we show two practically relevant access patterns that deserve special optimization.

Documents

download article:
download slides:
 

BibTeX

@inproceedings{hoefler-datatypes,
  author={Torsten Hoefler and S. Gottlieb},
  title={{Parallel Zero-Copy Algorithms for Fast Fourier Transform and Conjugate Gradient using MPI Datatypes}},
  year={2010},
  month={09},
  pages={132--141},
  volume={LNCS 6305},
  number={},
  booktitle={Recent Advances in the Message Passing Interface (EuroMPI'10)},
  location={Stuttgart, Germany},
  publisher={Springer},
  issn={0302-9743},
  isbn={078-3-642-15645-8},
  note={},
}