Chopin: Combining Distributed and Centralized Schedulers for Self-Adjusting Datacenter Networks

Neta Rozen-Schiff*, Klaus Tycho Foerster*, Stefan Schmid*, David Hay*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The performance of distributed and data-centric applications often critically depends on the interconnecting network. Emerging reconfigurable datacenter networks (RDCNs) are a particularly innovative approach to improve datacenter throughput. Relying on a dynamic optical topology which can be adjusted towards the workload in a demand-aware manner, RDCNs allow to exploit temporal and spatial locality in the communication pattern, and to provide topological shortcuts for frequently communicating racks. The key challenge, however, concerns how to realize demand-awareness in RDCNs in a scalable fashion. This paper presents and evaluates Chopin, a hybrid scheduler for self-adjusting networks that provides demand-awareness at low overhead, by combining centralized and distributed approaches. Chopin allocates optical circuits to elephant flows, through its slower centralized scheduler, utilizing global information. Chopin’s distributed scheduler is orders of magnitude faster and can swiftly react to changes in the traffic and adjust the optical circuits accordingly, by using only local information and running at each rack separately.

Original languageAmerican English
Title of host publication26th International Conference on Principles of Distributed Systems, OPODIS 2022
EditorsEshcar Hillel, Roberto Palmieri, Etienne Riviere
PublisherSchloss Dagstuhl- Leibniz-Zentrum fur Informatik GmbH, Dagstuhl Publishing
Pages25:1-25:23
Number of pages23
ISBN (Electronic)9783959772655
DOIs
StatePublished - 15 Feb 2023
Event26th International Conference on Principles of Distributed Systems, OPODIS 2022 - Brussels, Belgium
Duration: 13 Dec 202215 Dec 2022

Publication series

NameLeibniz International Proceedings in Informatics, LIPIcs
Volume253
ISSN (Print)1868-8969

Conference

Conference26th International Conference on Principles of Distributed Systems, OPODIS 2022
Country/TerritoryBelgium
CityBrussels
Period13/12/2215/12/22

Bibliographical note

Publisher Copyright:
© Neta Rozen-Schiff, Klaus-Tycho Foerster, Stefan Schmid, and David Hay.

Keywords

  • centralized scheduler
  • distributed scheduler
  • reconfigurable optical networks

Fingerprint

Dive into the research topics of 'Chopin: Combining Distributed and Centralized Schedulers for Self-Adjusting Datacenter Networks'. Together they form a unique fingerprint.

Cite this