h5part AT lists.psi.ch
Subject: H5Part development and discussion
- From: Andreas Adelmann <andreas.adelmann AT psi.ch>
- To: h5part AT lists.psi.ch
- Subject: [H5part] paper
- Date: Mon, 02 Aug 2010 06:49:27 +0200
- List-archive: <https://lists.web.psi.ch/pipermail/h5part/>
- List-id: H5Part development and discussion <h5part.lists.psi.ch>
Check this out (http://www.springerlink.com/content/wk23064764644160/):
Known challenges for petascale machines are that (1) the costs of I/O for high performance applications can be substantial, especially for output tasks like checkpointing, and (2) noise from I/O actions can inject undesirable delays into the runtimes of such codes on individual compute nodes. This paper introduces the flexible ‘DataStager’ framework for data staging and alternative services within that jointly address (1) and (2). Data staging services moving output data from compute nodes to staging or I/O nodes prior to storage are used to reduce I/O overheads on applications’ total processing times, and explicit management of data staging offers reduced perturbation when extracting output data from a petascale machine’s compute partition. Experimental evaluations of DataStager on the Cray XT machine at Oak Ridge National Laboratory establish both the necessity of intelligent data staging and the high performance of our approach, using the GTC fusion modeling code and benchmarks running on 1000+ processors.
Dr. sc. math. Andreas (Andy) Adelmann
Paul Scherrer Institut WBGB/132 CH-5232 Villigen PSI
Phone Office: xx41 56 310 42 33 Fax: xx41 56 310 50 90
Phone Home: xx41 62 891 91 44
Wednesday: ETH CAB H ??.? xx41 44 632 ?? ??
The more exotic, the more abstract the knowledge,
the more profound will be its consequences."
- [H5part] paper, Andreas Adelmann, 08/02/2010
Archive powered by MHonArc 2.6.19.