Cloud computing has reached significant maturity from a systems perspective, but currently deployed solutions rely on rather basic economics mechanisms that yield suboptimal allocation of the costly hardware resources. In this paper we present Economic Resource Allocation (ERA), a complete framework for scheduling and pricing cloud resources, aimed at increasing the efficiency of cloud resources usage by allocating resources according to economic principles. The ERA architecture carefully abstracts the underlying cloud infrastructure, enabling the development of scheduling and pricing algorithms independently of the concrete lower-level cloud infrastructure and independently of its concerns. Specifically, ERA is designed as a flexible layer that can sit on top of any cloud system and interfaces with both the cloud resource manager and with the users who reserve resources to run their jobs. The jobs are scheduled based on prices that are dynamically calculated according to the predicted demand. Additionally, ERA provides a key internal API to pluggable algorithmic modules that include scheduling, pricing and demand prediction. We provide a proof-of-concept software and demonstrate the effectiveness of the architecture by testing ERA over both public and private cloud systems - Azure Batch of Microsoft and Hadoop/YARN. A broader intent of our work is to foster collaborations between economics and system communities. To that end, we have developed a simulation platform via which economics and system experts can test their algorithmic implementations.
|Original language||American English|
|Title of host publication||26th International World Wide Web Conference 2017, WWW 2017 Companion|
|Publisher||International World Wide Web Conferences Steering Committee|
|Number of pages||9|
|State||Published - 2017|
|Event||26th International World Wide Web Conference, WWW 2017 Companion - Perth, Australia|
Duration: 3 Apr 2017 → 7 Apr 2017
|Name||26th International World Wide Web Conference 2017, WWW 2017 Companion|
|Conference||26th International World Wide Web Conference, WWW 2017 Companion|
|Period||3/04/17 → 7/04/17|
Bibliographical notePublisher Copyright:
© 2017 International World Wide Web Conference Committee (IW3C2), published under Creative Commons CC BY 4.0 License.
- Cloud Computing
- Dynamic Pricing