Skip to Content.
Sympa Menu

h5part - [H5part] paper

h5part AT

Subject: H5Part development and discussion

List archive

[H5part] paper

Chronological Thread 
  • From: Andreas Adelmann <andreas.adelmann AT>
  • To: h5part AT
  • Subject: [H5part] paper
  • Date: Mon, 02 Aug 2010 06:49:27 +0200
  • List-archive: <>
  • List-id: H5Part development and discussion <>

Check this out (

Known challenges for petascale machines are that (1) the costs of I/O for high performance applications can be substantial, especially for output tasks like checkpointing, and (2) noise from I/O actions can inject undesirable delays into the runtimes of such codes on individual compute nodes. This paper introduces the flexible ‘DataStager’ framework for data staging and alternative services within that jointly address (1) and (2). Data staging services moving output data from compute nodes to staging or I/O nodes prior to storage are used to reduce I/O overheads on applications’ total processing times, and explicit management of data staging offers reduced perturbation when extracting output data from a petascale machine’s compute partition. Experimental evaluations of DataStager on the Cray XT machine at Oak Ridge National Laboratory establish both the necessity of intelligent data staging and the high performance of our approach, using the GTC fusion modeling code and benchmarks running on 1000+ processors.

Best Andreas

Dr. sc. math. Andreas (Andy) Adelmann
Staff Scientist
Paul Scherrer Institut WBGB/132 CH-5232 Villigen PSI
Phone Office: xx41 56 310 42 33 Fax: xx41 56 310 50 90
Phone Home: xx41 62 891 91 44
Wednesday: ETH CAB H ??.? xx41 44 632 ?? ??
The more exotic, the more abstract the knowledge,
the more profound will be its consequences."
Leon Lederman

  • [H5part] paper, Andreas Adelmann, 08/02/2010

Archive powered by MHonArc 2.6.19.

Top of Page