Design and implementation of the Vesta parallel file system

Peter F. Corbett*, Dror G. Feitelson

*Corresponding author for this work

Research output: Contribution to conferencePaperpeer-review

31 Scopus citations

Abstract

The Vesta parallel file system is designed to provide parallel file access to application programs running on multicomputers with parallel I/O subsystems. Vesta uses a new abstraction of files: a file is not a sequence of bytes, but rather it can be partitioned into multiple disjoint sequences that are accessed in parallel. The partitioning - which can also be changed dynamically - reduces the need for synchronization and coordination during the access. Some control over the layout of data is also provided, so the layout can be matched with the anticipated access patterns. The system is fully implemented, and is beginning to be used by application programmers. The implementation does not compromise scalability or parallelism. In fact, all data accesses are done directly to the I/O node that contains the requested data, without any indirection or access to shared metadata. There are no centralized control points in the system.

Original languageEnglish
Pages63-70
Number of pages8
StatePublished - 1994
Externally publishedYes
EventProceedings of the Scalable High-Performance Computing Conference - Knoxville, TN, USA
Duration: 23 May 199425 May 1994

Conference

ConferenceProceedings of the Scalable High-Performance Computing Conference
CityKnoxville, TN, USA
Period23/05/9425/05/94

Fingerprint

Dive into the research topics of 'Design and implementation of the Vesta parallel file system'. Together they form a unique fingerprint.

Cite this