FFMK: A fast and fault-tolerant microkernel-based system for exascale computing

Carsten Weinhold; Adam Lackorzynski; Jan Bierbaum; Martin Küttler; Maksym Planeta; Hermann Härtig; Amnon Shiloh; Ely Levy; Tal Ben-Nun; Amnon Barak; Thomas Steinke; Thorsten Schütt; Jan Fajerski; Alexander Reinefeld; Matthias Lieber; Wolfgang E. Nagel

doi:10.1007/978-3-319-40528-5_18

FFMK: A fast and fault-tolerant microkernel-based system for exascale computing

Carsten Weinhold^*
, Adam Lackorzynski
, Jan Bierbaum
, Martin Küttler
, Maksym Planeta
, Hermann Härtig
, Amnon Shiloh
, Ely Levy
, Tal Ben-Nun
, Amnon Barak
, Thomas Steinke
, Thorsten Schütt
, Jan Fajerski
, Alexander Reinefeld
, Matthias Lieber
, Wolfgang E. Nagel

^*Corresponding author for this work

The Rachel and Selim Benin School of Engineering and Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

3 Scopus citations

Abstract

In this paper we describe the hardware and application-inherent challenges that future exascale systems pose to high-performance computing (HPC) and propose a system architecture that addresses them. This architecture is based on proven building blocks and few principles: (1) a fast light-weight kernel that is supported by a virtualized Linux for tasks that are not performance critical, (2) decentralized load and health management using fault-tolerant gossip-based information dissemination, (3) a maximally-parallel checkpoint store for cheap checkpoint/restart in the presence of frequent component failures, and (4) a runtime that enables applications to interact with the underlying system platform through new interfaces. The paper discusses the vision behind FFMK and the current state of a prototype implementation of the system, which is based on a microkernel and an adapted MPI runtime.

Original language	English
Title of host publication	Software for Exascale Computing - SPPEXA 2013-2015
Editors	Wolfgang E. Nagel, Hans-Joachim Bungartz, Philipp Neumann
Publisher	Springer Verlag
Pages	405-426
Number of pages	22
ISBN (Print)	9783319405261
DOIs	https://doi.org/10.1007/978-3-319-40528-5_18
State	Published - 2016
Event	International Conference on Software for Exascale Computing, SPPEXA 2015 - Munich, Germany Duration: 25 Jan 2016 → 27 Jan 2016

Publication series

Name	Lecture Notes in Computational Science and Engineering
Volume	113
ISSN (Print)	1439-7358

Conference

Conference	International Conference on Software for Exascale Computing, SPPEXA 2015
Country/Territory	Germany
City	Munich
Period	25/01/16 → 27/01/16

Bibliographical note

Publisher Copyright:
© Springer International Publishing Switzerland 2016.

Access to Document

10.1007/978-3-319-40528-5_18

Cite this

Weinhold, C., Lackorzynski, A., Bierbaum, J., Küttler, M., Planeta, M., Härtig, H., Shiloh, A., Levy, E., Ben-Nun, T., Barak, A., Steinke, T., Schütt, T., Fajerski, J., Reinefeld, A., Lieber, M., & Nagel, W. E. (2016). FFMK: A fast and fault-tolerant microkernel-based system for exascale computing. In W. E. Nagel, H.-J. Bungartz, & P. Neumann (Eds.), Software for Exascale Computing - SPPEXA 2013-2015 (pp. 405-426). (Lecture Notes in Computational Science and Engineering; Vol. 113). Springer Verlag. https://doi.org/10.1007/978-3-319-40528-5_18

@inproceedings{6ff19ba21a0245ea88fe485e8b221d1b,

title = "FFMK: A fast and fault-tolerant microkernel-based system for exascale computing",

abstract = "In this paper we describe the hardware and application-inherent challenges that future exascale systems pose to high-performance computing (HPC) and propose a system architecture that addresses them. This architecture is based on proven building blocks and few principles: (1) a fast light-weight kernel that is supported by a virtualized Linux for tasks that are not performance critical, (2) decentralized load and health management using fault-tolerant gossip-based information dissemination, (3) a maximally-parallel checkpoint store for cheap checkpoint/restart in the presence of frequent component failures, and (4) a runtime that enables applications to interact with the underlying system platform through new interfaces. The paper discusses the vision behind FFMK and the current state of a prototype implementation of the system, which is based on a microkernel and an adapted MPI runtime.",

author = "Carsten Weinhold and Adam Lackorzynski and Jan Bierbaum and Martin K{\"u}ttler and Maksym Planeta and Hermann H{\"a}rtig and Amnon Shiloh and Ely Levy and Tal Ben-Nun and Amnon Barak and Thomas Steinke and Thorsten Sch{\"u}tt and Jan Fajerski and Alexander Reinefeld and Matthias Lieber and Nagel, \{Wolfgang E.\}",

note = "Publisher Copyright: {\textcopyright} Springer International Publishing Switzerland 2016.; International Conference on Software for Exascale Computing, SPPEXA 2015 ; Conference date: 25-01-2016 Through 27-01-2016",

year = "2016",

doi = "10.1007/978-3-319-40528-5\_18",

language = "אנגלית",

isbn = "9783319405261",

series = "Lecture Notes in Computational Science and Engineering",

publisher = "Springer Verlag",

pages = "405--426",

editor = "Nagel, \{Wolfgang E.\} and Hans-Joachim Bungartz and Philipp Neumann",

booktitle = "Software for Exascale Computing - SPPEXA 2013-2015",

address = "גרמניה",

}

Weinhold, C, Lackorzynski, A, Bierbaum, J, Küttler, M, Planeta, M, Härtig, H, Shiloh, A, Levy, E, Ben-Nun, T, Barak, A, Steinke, T, Schütt, T, Fajerski, J, Reinefeld, A, Lieber, M & Nagel, WE 2016, FFMK: A fast and fault-tolerant microkernel-based system for exascale computing. in WE Nagel, H-J Bungartz & P Neumann (eds), Software for Exascale Computing - SPPEXA 2013-2015. Lecture Notes in Computational Science and Engineering, vol. 113, Springer Verlag, pp. 405-426, International Conference on Software for Exascale Computing, SPPEXA 2015, Munich, Germany, 25/01/16. https://doi.org/10.1007/978-3-319-40528-5_18

FFMK: A fast and fault-tolerant microkernel-based system for exascale computing. / Weinhold, Carsten; Lackorzynski, Adam; Bierbaum, Jan et al.
Software for Exascale Computing - SPPEXA 2013-2015. ed. / Wolfgang E. Nagel; Hans-Joachim Bungartz; Philipp Neumann. Springer Verlag, 2016. p. 405-426 (Lecture Notes in Computational Science and Engineering; Vol. 113).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - FFMK

T2 - International Conference on Software for Exascale Computing, SPPEXA 2015

AU - Weinhold, Carsten

AU - Lackorzynski, Adam

AU - Bierbaum, Jan

AU - Küttler, Martin

AU - Planeta, Maksym

AU - Härtig, Hermann

AU - Shiloh, Amnon

AU - Levy, Ely

AU - Ben-Nun, Tal

AU - Barak, Amnon

AU - Steinke, Thomas

AU - Schütt, Thorsten

AU - Fajerski, Jan

AU - Reinefeld, Alexander

AU - Lieber, Matthias

AU - Nagel, Wolfgang E.

PY - 2016

Y1 - 2016

N2 - In this paper we describe the hardware and application-inherent challenges that future exascale systems pose to high-performance computing (HPC) and propose a system architecture that addresses them. This architecture is based on proven building blocks and few principles: (1) a fast light-weight kernel that is supported by a virtualized Linux for tasks that are not performance critical, (2) decentralized load and health management using fault-tolerant gossip-based information dissemination, (3) a maximally-parallel checkpoint store for cheap checkpoint/restart in the presence of frequent component failures, and (4) a runtime that enables applications to interact with the underlying system platform through new interfaces. The paper discusses the vision behind FFMK and the current state of a prototype implementation of the system, which is based on a microkernel and an adapted MPI runtime.

AB - In this paper we describe the hardware and application-inherent challenges that future exascale systems pose to high-performance computing (HPC) and propose a system architecture that addresses them. This architecture is based on proven building blocks and few principles: (1) a fast light-weight kernel that is supported by a virtualized Linux for tasks that are not performance critical, (2) decentralized load and health management using fault-tolerant gossip-based information dissemination, (3) a maximally-parallel checkpoint store for cheap checkpoint/restart in the presence of frequent component failures, and (4) a runtime that enables applications to interact with the underlying system platform through new interfaces. The paper discusses the vision behind FFMK and the current state of a prototype implementation of the system, which is based on a microkernel and an adapted MPI runtime.

UR - https://www.scopus.com/pages/publications/84989926715

U2 - 10.1007/978-3-319-40528-5_18

DO - 10.1007/978-3-319-40528-5_18

M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???

AN - SCOPUS:84989926715

SN - 9783319405261

T3 - Lecture Notes in Computational Science and Engineering

SP - 405

EP - 426

BT - Software for Exascale Computing - SPPEXA 2013-2015

A2 - Nagel, Wolfgang E.

A2 - Bungartz, Hans-Joachim

A2 - Neumann, Philipp

PB - Springer Verlag

Y2 - 25 January 2016 through 27 January 2016

ER -

Weinhold C, Lackorzynski A, Bierbaum J, Küttler M, Planeta M, Härtig H et al. FFMK: A fast and fault-tolerant microkernel-based system for exascale computing. In Nagel WE, Bungartz HJ, Neumann P, editors, Software for Exascale Computing - SPPEXA 2013-2015. Springer Verlag. 2016. p. 405-426. (Lecture Notes in Computational Science and Engineering). doi: 10.1007/978-3-319-40528-5_18

FFMK: A fast and fault-tolerant microkernel-based system for exascale computing

Abstract

Publication series

Conference

Bibliographical note

Access to Document

Other files and links

Fingerprint

Cite this