Semi-open trace based simulation for reliable evaluation of job throughput and user productivity

Netanel Zakay, Dror G. Feitelson

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

5 Scopus citations

Abstract

New scheduling algorithms are first evaluated using simulation. In these simulations, the workload has a huge influence on the measured performance of the simulated system. Therefore, it is customary to use workload traces recorded previously from real systems. Such open-system simulations preserve all the jobs' properties. However, preserving the jobs' arrival times actually destroys the logic of the user's workflow, especially dependencies and think times between successive jobs. Furthermore, performance in such simulations is measured by the average wait time and slowdown, under the fixed load and throughput conditions dictated by the trace. Therefore, it is impossible to evaluate the system's effect on throughput and productivity. As an alternative we propose semi-open trace based simulations that include dynamic user activity and internal feedback from the system to the users. In these simulations, like in a real system, users adjust their job-submittal behavior in response to system performance. As a result, the simulations produce different loads and throughputs for different scheduling algorithms or parametrizations. We implemented such a simulation for evaluating the schedulers of parallel job systems. We also developed a novel user-aware scheduler designed specifically to increase users' productivity. While conventional simulations cannot measure this scheduler's influence reliably, and would suggest it is useless, our simulation evaluates it realistically and shows its beneficial effect on the users' productivity and the system's throughput.

Original languageAmerican English
Title of host publicationProceedings - IEEE 7th International Conference on Cloud Computing Technology and Science, CloudCom 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages413-421
Number of pages9
ISBN (Electronic)9781467395601
DOIs
StatePublished - 1 Feb 2016
Event7th IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2015 - Vancouver, Canada
Duration: 30 Nov 20153 Dec 2015

Publication series

NameProceedings - IEEE 7th International Conference on Cloud Computing Technology and Science, CloudCom 2015

Conference

Conference7th IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2015
Country/TerritoryCanada
CityVancouver
Period30/11/153/12/15

Bibliographical note

Publisher Copyright:
© 2015 IEEE.

Keywords

  • Discrete-event simulation
  • Feedback
  • Parallel system
  • Performance evlauation
  • Resampling
  • Scheduling
  • Simulations
  • Trace driven simulation

Fingerprint

Dive into the research topics of 'Semi-open trace based simulation for reliable evaluation of job throughput and user productivity'. Together they form a unique fingerprint.

Cite this