Copyright Notice:

The documents distributed by this server have been provided by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a noncommercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Publications of SPCL

M. Khalilov, M. Chrapek, S. Shen, A. Vezzu, T. Benz, S. Di Girolamo, T. Schneider, D. De Sensi, L. Benini, T. Hoefler:

 OSMOSIS: Enabling Multi-Tenancy in Datacenter SmartNICs

(Jul. 2024)

Publisher Reference

Abstract

Multi-tenancy is essential for unleashing SmartNIC's potential in datacenters. Our systematic analysis in this work shows that existing on-path SmartNICs have resource multiplexing limitations. For example, existing solutions lack multi-tenancy capabilities such as performance isolation and QoS provisioning for compute and IO resources. Compared to standard NIC data paths with a well-defined set of offloaded functions, unpredictable execution times of SmartNIC kernels make conventional approaches for multi-tenancy and QoS insufficient. We fill this gap with OSMOSIS, a SmartNICs resource manager co-design. OSMOSIS extends existing OS mechanisms to enable dynamic hardware resource multiplexing of the on-path packet processing data plane. We integrate OSMOSIS within an open-source RISC-V-based 400Gbit/s SmartNIC. Our performance results demonstrate that OSMOSIS fully supports multi-tenancy and enables broader adoption of SmartNICs in datacenters with low overhead.

Documents

download article:
access preprint on arxiv:
 

BibTeX

@inproceedings{,
  author={Mikhail Khalilov and Marcin Chrapek and Siyuan Shen and Alessandro Vezzu and Thomas Benz and Salvatore Di Girolamo and Timo Schneider and Daniele De Sensi and Luca Benini and Torsten Hoefler},
  title={{OSMOSIS: Enabling Multi-Tenancy in Datacenter SmartNICs}},
  year={2024},
  month={7},
}