Copyright Notice:

The documents distributed by this server have been provided by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a noncommercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Publications of SPCL

T. Hoefler, M. Khalilov, J. Clark, S. Anubolu, M. Kalkunte, K. Schramm, E. Spada, D. Roweth, K. Underwood, A. Caulfield, A. Kabbani, A. Rastegari:

 In-Network Collective Operations: Game Changer or Challenge for AI Workloads?

(IEEE Computer. Vol 59, Nr. 1, pages 24-33, IEEE, ISSN: 1558-0814, Jan. 2026)

Publisher Reference

Abstract

This paper summarizes the opportunities of in-network collective operations for accelerated collective operations in artificial intelligence (AI) workloads. We provide sufficient detail to make this important field accessible to nonexperts in AI or networking, fostering a connection between these communities.

Documents

download article:
access preprint on arxiv:
 

BibTeX

@article{hoefler-inc,
  author={Torsten Hoefler and Mikhail Khalilov and Josiah Clark and Surendra Anubolu and Mohan Kalkunte and Karen Schramm and Eric Spada and Duncan Roweth and Keith Underwood and Adrian Caulfield and Abdul Kabbani and Amirreza Rastegari},
  title={{In-Network Collective Operations: Game Changer or Challenge for AI Workloads?}},
  journal={IEEE Computer},
  year={2026},
  month={01},
  pages={24-33},
  volume={59},
  number={1},
  publisher={IEEE},
  issn={1558-0814},
  doi={10.1109/MC.2025.3616048},
}