Era: A framework for economic resource allocation for the cloud

Moshe Babaioff, Gali Noti, Ishai Menache, Yishay Mansour, Carlo Curino, Omer Reingold, Erez Timnat, Noam Nisan, Nar Ganapathy, Moshe Tennenholtz

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

26 Scopus citations

Abstract

Cloud computing has reached significant maturity from a systems perspective, but currently deployed solutions rely on rather basic economics mechanisms that yield suboptimal allocation of the costly hardware resources. In this paper we present Economic Resource Allocation (ERA), a complete framework for scheduling and pricing cloud resources, aimed at increasing the efficiency of cloud resources usage by allocating resources according to economic principles. The ERA architecture carefully abstracts the underlying cloud infrastructure, enabling the development of scheduling and pricing algorithms independently of the concrete lower-level cloud infrastructure and independently of its concerns. Specifically, ERA is designed as a flexible layer that can sit on top of any cloud system and interfaces with both the cloud resource manager and with the users who reserve resources to run their jobs. The jobs are scheduled based on prices that are dynamically calculated according to the predicted demand. Additionally, ERA provides a key internal API to pluggable algorithmic modules that include scheduling, pricing and demand prediction. We provide a proof-of-concept software and demonstrate the effectiveness of the architecture by testing ERA over both public and private cloud systems - Azure Batch of Microsoft and Hadoop/YARN. A broader intent of our work is to foster collaborations between economics and system communities. To that end, we have developed a simulation platform via which economics and system experts can test their algorithmic implementations.

Original languageAmerican English
Title of host publication26th International World Wide Web Conference 2017, WWW 2017 Companion
PublisherInternational World Wide Web Conferences Steering Committee
Pages634-642
Number of pages9
ISBN (Electronic)9781450349147
DOIs
StatePublished - 2017
Externally publishedYes
Event26th International World Wide Web Conference, WWW 2017 Companion - Perth, Australia
Duration: 3 Apr 20177 Apr 2017

Publication series

Name26th International World Wide Web Conference 2017, WWW 2017 Companion

Conference

Conference26th International World Wide Web Conference, WWW 2017 Companion
Country/TerritoryAustralia
CityPerth
Period3/04/177/04/17

Bibliographical note

Publisher Copyright:
© 2017 International World Wide Web Conference Committee (IW3C2), published under Creative Commons CC BY 4.0 License.

Keywords

  • Cloud Computing
  • Dynamic Pricing
  • Economics
  • Reservations

Fingerprint

Dive into the research topics of 'Era: A framework for economic resource allocation for the cloud'. Together they form a unique fingerprint.

Cite this