Copyright Notice:

The documents distributed by this server have been provided by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a noncommercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Publications of SPCL

T. Bonato, A. Ghalayini, N. Gebara, B. Pit-Claudel, J. Li, M. Khalilov, L. Piccolboni, W. Reda, P. Tsai, T. Ji, A. Kabbani, T. Hoefler:

 Ordered Chaos: Towards Adaptive Multipath Load Balancing with Precise Fast Loss Detection

(In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC'26), presented in Chicago, IL, USA, IEEE, ISBN: 979-8-3195-4789-7, Nov. 2026)

Abstract

Load balancing in best-effort datacenter fabrics faces a tradeoff. Order-preserving schemes such as Equal-Cost Multipath (ECMP) retain loss semantics but use path diversity coarsely, while packet spraying balances load well but removes the ordering signals needed for fast, precise loss detection. We present Ordered Chaos, an end-host design that preserves enough structure for reliable loss detection without giving up fine-grained multipath routing. Reactive Subflow Spraying (RSS) divides each flow into ordered, dynamically routed subflows. Precise Fast Loss Detection (PFLD) combines this ordering with probes to distinguish reordering from congestion, corruption, tail, and retransmission losses within one RTT. Across simulations, AI and HPC workloads, and a DPU prototype, RSS+PFLD improves tail flow completion time by up to 3×, eliminates up to 99% of timeout-based recoveries, and accelerates collective and training communication by up to 35%.

Documents

download article:
access preprint on arxiv:
 

BibTeX

@inproceedings{bonato2026orderedchaos,
  author={Tommaso Bonato and Ahmad Ghalayini and Nadeen Gebara and Benoit Pit-Claudel and Jiayong Li and Mikhail Khalilov and Luca Piccolboni and Waleed Reda and Pei-Huan Tsai and Tao Ji and Abdul Kabbani and Torsten Hoefler},
  title={{Ordered Chaos: Towards Adaptive Multipath Load Balancing with Precise Fast Loss Detection}},
  year={2026},
  month={11},
  booktitle={Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC'26)},
  location={Chicago, IL, USA},
  publisher={IEEE},
  isbn={979-8-3195-4789-7},
}