Copyright Notice:

The documents distributed by this server have been provided by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a noncommercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Publications of SPCL

T. Hoefler, T. Schneider, A. Lumsdaine:

 Accurately Measuring Collective Operations at Massive Scale

(. Vol , Nr. , In Proceedings of the 22nd IEEE International Parallel & Distributed Processing Symposium, PMEO'08 Workshop, presented in Miami, FL, pages , , ISSN: 1530-2075, ISBN: 978-1-4244-1694-3, Apr. 2008)
Invited to a journal special issue on top picks from PMEO'08.


Accurate, reproducible and comparable measurement of collective operations is a complicated task. Although Different measurement schemes are implemented in well-known benchmarks, many of these schemes introduce different systematic errors in their measurements. We characterize these errors and select a window-based approach as the most accurate method. However, this approach complicates measurements significantly and introduces a clock synchronization as a new source of systematic errors. We analyze approaches to avoid or correct those errors and develop a scalable synchronization scheme to conduct benchmarks on massively parallel systems. Our results are compared to the window-based scheme implemented in the SKaMPI benchmarks and show a reduction of the synchronization overhead by a factor of 16 on 128 processes.


download article:
download slides:


  author={Torsten Hoefler and Timo Schneider and Andrew Lumsdaine},
  title={{Accurately Measuring Collective Operations at Massive Scale}},
  booktitle={Proceedings of the 22nd IEEE International Parallel \& Distributed Processing Symposium, PMEO'08 Workshop},
  location={Miami, FL},