Memory usage in the LANL CM-5 workload

Dror G. Feitelson*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

26 Scopus citations

Abstract

It is generally agreed that memory requirements should be taken into account in the scheduling of parallel jobs. However, so far the work on combined processor and memory scheduling has not been based on detailed information and measurements. To rectify this problem, we present an analysis of memory usage by a production workload on a large parallel machine, the 1024-node CM-5 installed at Los Alamos National Lab. Our main observations are - The distribution of memory requests has strong discrete components, i e. some sizes are much more popular than others. - Many jobs use a relatively small fraction of the memory available on each node, so there is some room for time slicing among several memory-resident jobs. - Larger jobs (using more nodes) tend to use more memory, but it is difficult to characterize the scaling of per-processor memory usage.

Original languageEnglish
Title of host publicationJob Scheduling Strategies for Parallel Processing - IPPS 1997 Workshop, Proceedings
EditorsDror G. Feitelson, Larry Rudolph
PublisherSpringer Verlag
Pages78-94
Number of pages17
ISBN (Print)3540635742, 9783540635741
DOIs
StatePublished - 1997
Event3rd Workshop on Job Scheduling Strategies for Parallel Processing, IPPS 1997 - Geneva, Switzerland
Duration: 5 Apr 19975 Apr 1997

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume1291
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference3rd Workshop on Job Scheduling Strategies for Parallel Processing, IPPS 1997
Country/TerritorySwitzerland
CityGeneva
Period5/04/975/04/97

Bibliographical note

Publisher Copyright:
© Springer-Verlag Berlin Heidelberg 1997.

Fingerprint

Dive into the research topics of 'Memory usage in the LANL CM-5 workload'. Together they form a unique fingerprint.

Cite this