Scientific workflow applications on amazon EC2

Gideon Juve*, Ewa Deelman, Karan Vahi, Gaurang Mehta, Benjamin P. Berman, Bruce Berriman, Phil Maechling

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

201 Scopus citations

Abstract

The proliferation of commercial cloud computing providers has generated significant interest in the scientific computing community. Much recent research has attempted to determine the benefits and drawbacks of cloud computing for scientific applications. Although clouds have many attractive features, such as virtualization, on-demand provisioning, and "pay as you go" usage-based pricing, it is not clear whether they are able to deliver the performance required for scientific applications at a reasonable price. In this paper we examine the performance and cost of clouds from the perspective of scientific workflow applications. We use three characteristic workflows to compare the performance of a commercial cloud with that of a typical HPC system, and we analyze the various costs associated with running those workflows in the cloud. We find that the performance of clouds is not unreasonable given the hardware resources provided, and that performance comparable to HPC systems can be achieved given similar resources. We also find that the cost of running workflows on a commercial cloud can be reduced by storing data in the cloud rather than transferring it from outside.

Original languageAmerican English
Title of host publicatione-science 2009 - Proceedings of the 2009 5th IEEE International Conference on e-Science Workshops
Pages59-66
Number of pages8
DOIs
StatePublished - 2009
Externally publishedYes
Event2009 5th IEEE International Conference on e-Science Workshops, e-science 2009 - Oxford, United Kingdom
Duration: 9 Dec 200911 Dec 2009

Publication series

Namee-science 2009 - Proceedings of the 2009 5th IEEE International Conference on e-Science Workshops

Conference

Conference2009 5th IEEE International Conference on e-Science Workshops, e-science 2009
Country/TerritoryUnited Kingdom
CityOxford
Period9/12/0911/12/09

Fingerprint

Dive into the research topics of 'Scientific workflow applications on amazon EC2'. Together they form a unique fingerprint.

Cite this