Copyright Notice:

The documents distributed by this server have been provided by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a noncommercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Publications of SPCL

L. Gianinazzi, T. Ben-Nun, M. Besta, S. Ashkboos, Y. Baumann, P. Luczynski, T. Hoefler:

 The spatial computer: A model for energy-efficient parallel computation

(arXiv:2205.04934. May 2022)

Abstract

We present a new parallel model of computation suitable for spatial architectures, for which the energy used for communication heavily depends on the distance of the communicating processors. In our model, processors have locations on a conceptual two-dimensional grid, and their distance therein determines their communication cost. In particular, we introduce the energy cost of a spatial computation, which measures the total distance traveled by all messages, and study the depth of communication, which measures the largest number of hops of a chain of messages. We show matching energy lower- and upper bounds for many foundational problems, including sorting, median selection, and matrix multiplication. Our model does not depend on any parameters other than the input shape and size, simplifying algorithm analysis. We also show how to simulate PRAM algorithms in our model and how to obtain results for a more complex model that introduces the size of the local memories of the processors as a parameter.

Documents

download article:
access preprint on arxiv:
 

BibTeX

@article{gianinazzi2022spatial,
  author={Lukas Gianinazzi and Tal Ben-Nun and Maciej Besta and Saleh Ashkboos and Yves Baumann and Piotr Luczynski and Torsten Hoefler},
  title={{The spatial computer: A model for energy-efficient parallel computation}},
  journal={arXiv:2205.04934},
  year={2022},
  month={05},
  doi={10.48550/arXiv.2205.04934},
}