H5Part development and discussion

[Andreas Adelmann <andreas.adelmann AT psi.ch>]

Check this out (http://www.springerlink.com/content/wk23064764644160/):

Abstract
Known challenges for petascale machines are that (1) the costs of I/O 
for high performance applications can be substantial, especially for 
output tasks like checkpointing, and (2) noise from I/O actions can 
inject undesirable delays into the runtimes of such codes on individual 
compute nodes. This paper introduces the flexible ‘DataStager’ framework 
for data staging and alternative services within that jointly address 
(1) and (2). Data staging services moving output data from compute nodes 
to staging or I/O nodes prior to storage are used to reduce I/O 
overheads on applications’ total processing times, and explicit 
management of data staging offers reduced perturbation when extracting 
output data from a petascale machine’s compute partition. Experimental 
evaluations of DataStager on the Cray XT machine at Oak Ridge National 
Laboratory establish both the necessity of intelligent data staging and 
the high performance of our approach, using the GTC fusion modeling code 
and benchmarks running on 1000+ processors.

Best Andreas

--
Dr. sc. math. Andreas (Andy) Adelmann
Staff Scientist
Paul Scherrer Institut WBGB/132 CH-5232 Villigen PSI
Phone Office: xx41 56 310 42 33 Fax: xx41 56 310 50 90
Phone Home: xx41 62 891 91 44
-------------------------------------------------------
Wednesday: ETH CAB H ??.?  xx41 44 632 ?? ??
=======================================================
The more exotic, the more abstract the knowledge,
the more profound will be its consequences."
Leon Lederman
=======================================================