Atomic writes for data integrity and consistency in shared storage devices for clusters

M. Okun; A. Barak

doi:10.1109/ICAPP.2002.1173588

Atomic writes for data integrity and consistency in shared storage devices for clusters

M. Okun, A. Barak

The Rachel and Selim Benin School of Engineering and Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

2 Scopus citations

Abstract

The recent trend to use storage area networks in distributed and cluster systems has necessitated an improvement of integrity and consistency guarantees of stored data in the presence of node or network failures. Currently, the main method for preserving data integrity and consistency is logging, e.g. journaling. This paper presents a new, general method for preserving data consistency by atomic multi-block writes. The atomic writes method guarantees that either all the blocks in a write operation are written or no blocks are written at all. Its main advantage is that it does not require a recovery phase after a failure. The atomic writes method should be implemented in both the operating system and storage system levels. It is easy to use and implement. We present the method, its implementation and an example of its use for handling meta-data consistency in the Global File System (GFS).

Original language	English
Title of host publication	Proceedings - 5th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2002
Editors	Wanlei Zhou, Andrzej Goscinski, Guo-jie Li, Xue-bin Chi
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	286-292
Number of pages	7
ISBN (Electronic)	0769515126, 9780769515120
DOIs	https://doi.org/10.1109/ICAPP.2002.1173588
State	Published - 2002
Event	5th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2002 - Beijing, China Duration: 23 Oct 2002 → 25 Oct 2002

Publication series

Name	Proceedings - 5th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2002

Conference

Conference	5th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2002
Country/Territory	China
City	Beijing
Period	23/10/02 → 25/10/02

Bibliographical note

Publisher Copyright:
© 2002 IEEE.

Keywords

atomic transactions
cluster systems
data consistency
storage area networks
system fault-tolerance

Access to Document

10.1109/ICAPP.2002.1173588

Cite this

Okun, M., & Barak, A. (2002). Atomic writes for data integrity and consistency in shared storage devices for clusters. In W. Zhou, A. Goscinski, G. Li, & X. Chi (Eds.), Proceedings - 5th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2002 (pp. 286-292). Article 1173588 (Proceedings - 5th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2002). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICAPP.2002.1173588

Okun, M. ; Barak, A. / Atomic writes for data integrity and consistency in shared storage devices for clusters. Proceedings - 5th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2002. editor / Wanlei Zhou ; Andrzej Goscinski ; Guo-jie Li ; Xue-bin Chi. Institute of Electrical and Electronics Engineers Inc., 2002. pp. 286-292 (Proceedings - 5th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2002).

@inproceedings{f241e37438264c5db92c3e8939a4f38c,

title = "Atomic writes for data integrity and consistency in shared storage devices for clusters",

abstract = "The recent trend to use storage area networks in distributed and cluster systems has necessitated an improvement of integrity and consistency guarantees of stored data in the presence of node or network failures. Currently, the main method for preserving data integrity and consistency is logging, e.g. journaling. This paper presents a new, general method for preserving data consistency by atomic multi-block writes. The atomic writes method guarantees that either all the blocks in a write operation are written or no blocks are written at all. Its main advantage is that it does not require a recovery phase after a failure. The atomic writes method should be implemented in both the operating system and storage system levels. It is easy to use and implement. We present the method, its implementation and an example of its use for handling meta-data consistency in the Global File System (GFS).",

keywords = "atomic transactions, cluster systems, data consistency, storage area networks, system fault-tolerance",

author = "M. Okun and A. Barak",

note = "Publisher Copyright: {\textcopyright} 2002 IEEE.; 5th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2002 ; Conference date: 23-10-2002 Through 25-10-2002",

year = "2002",

doi = "10.1109/ICAPP.2002.1173588",

language = "אנגלית",

series = "Proceedings - 5th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2002",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "286--292",

editor = "Wanlei Zhou and Andrzej Goscinski and Guo-jie Li and Xue-bin Chi",

booktitle = "Proceedings - 5th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2002",

address = "ארצות הברית",

}

Okun, M & Barak, A 2002, Atomic writes for data integrity and consistency in shared storage devices for clusters. in W Zhou, A Goscinski, G Li & X Chi (eds), Proceedings - 5th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2002., 1173588, Proceedings - 5th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2002, Institute of Electrical and Electronics Engineers Inc., pp. 286-292, 5th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2002, Beijing, China, 23/10/02. https://doi.org/10.1109/ICAPP.2002.1173588

Atomic writes for data integrity and consistency in shared storage devices for clusters. / Okun, M.; Barak, A.
Proceedings - 5th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2002. ed. / Wanlei Zhou; Andrzej Goscinski; Guo-jie Li; Xue-bin Chi. Institute of Electrical and Electronics Engineers Inc., 2002. p. 286-292 1173588 (Proceedings - 5th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2002).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Atomic writes for data integrity and consistency in shared storage devices for clusters

AU - Okun, M.

AU - Barak, A.

PY - 2002

Y1 - 2002

N2 - The recent trend to use storage area networks in distributed and cluster systems has necessitated an improvement of integrity and consistency guarantees of stored data in the presence of node or network failures. Currently, the main method for preserving data integrity and consistency is logging, e.g. journaling. This paper presents a new, general method for preserving data consistency by atomic multi-block writes. The atomic writes method guarantees that either all the blocks in a write operation are written or no blocks are written at all. Its main advantage is that it does not require a recovery phase after a failure. The atomic writes method should be implemented in both the operating system and storage system levels. It is easy to use and implement. We present the method, its implementation and an example of its use for handling meta-data consistency in the Global File System (GFS).

AB - The recent trend to use storage area networks in distributed and cluster systems has necessitated an improvement of integrity and consistency guarantees of stored data in the presence of node or network failures. Currently, the main method for preserving data integrity and consistency is logging, e.g. journaling. This paper presents a new, general method for preserving data consistency by atomic multi-block writes. The atomic writes method guarantees that either all the blocks in a write operation are written or no blocks are written at all. Its main advantage is that it does not require a recovery phase after a failure. The atomic writes method should be implemented in both the operating system and storage system levels. It is easy to use and implement. We present the method, its implementation and an example of its use for handling meta-data consistency in the Global File System (GFS).

KW - atomic transactions

KW - cluster systems

KW - data consistency

KW - storage area networks

KW - system fault-tolerance

UR - http://www.scopus.com/inward/record.url?scp=84964715424&partnerID=8YFLogxK

U2 - 10.1109/ICAPP.2002.1173588

DO - 10.1109/ICAPP.2002.1173588

M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???

AN - SCOPUS:84964715424

T3 - Proceedings - 5th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2002

SP - 286

EP - 292

BT - Proceedings - 5th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2002

A2 - Zhou, Wanlei

A2 - Goscinski, Andrzej

A2 - Li, Guo-jie

A2 - Chi, Xue-bin

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 5th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2002

Y2 - 23 October 2002 through 25 October 2002

ER -

Okun M, Barak A. Atomic writes for data integrity and consistency in shared storage devices for clusters. In Zhou W, Goscinski A, Li G, Chi X, editors, Proceedings - 5th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2002. Institute of Electrical and Electronics Engineers Inc. 2002. p. 286-292. 1173588. (Proceedings - 5th International Conference on Algorithms and Architectures for Parallel Processing, ICA3PP 2002). doi: 10.1109/ICAPP.2002.1173588

Atomic writes for data integrity and consistency in shared storage devices for clusters

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this