[prev in list] [next in list] [prev in thread] [next in thread] 

List:       gpfsug-discuss
Subject:    [gpfsug-discuss] GPFS and Lustre
From:       ewahl () osc ! edu (Ed Wahl)
Date:       2014-08-11 13:55:48
Message-ID: C59E5201836F7147BAD35189FFBB35D101164CE365 () USOAPP09V04P ! si ! lan
[Download RAW message or body]

In a similar vein, IBM has an application transparent "File Cache Library" as well.  \
I believe it IS licensed and the only requirement is that it is for use on IBM \
hardware only.  Saw some presentations that mention it in some BioSci talks @SC13 and \
the numbers for a couple of selected small read applications were awesome. 

I probably have the contact info for it around here somewhere.  In addition to the \
pdf/user manual.

Ed Wahl
Ohio Supercomputer Center

________________________________________
From: gpfsug-discuss-bounces@gpfsug.org [gpfsug-discuss-bounces at gpfsug.org] on \
                behalf of Frank Kraemer [kraemerf at de.ibm.com]
Sent: Saturday, August 09, 2014 10:03 AM
To: gpfsug-discuss at gpfsug.org
Subject: Re: [gpfsug-discuss] GPFS and Lustre

Vic, Sergi,

from my point of view for real High-End workloads the complete I/O stack
needs to be fine tuned and well understood in order to provide a good
system to the users.

- Application(s)
+ I/O Lib(s)
+ MPI
+ Parallel Filesystem (e.g. GPFS)
+ Hardware (Networks, Servers, Disks, etc.)

One of the best solutions to bring your application very efficently to work
with a Parallel FS is Sionlib from FZ Juelich:

Sionlib is a scalable I/O library for the parallel access to task-local
files. The library not only supports writing and reading binary data to or
from from several thousands of processors into a single or a small number
of physical files but also provides for global open and close functions to
access SIONlib file in parallel. SIONlib provides different interfaces:
parallel access using MPI, OpenMp, or their combination and sequential
access for post-processing utilities.

http://www.fz-juelich.de/ias/jsc/EN/Expertise/Support/Software/SIONlib/_node.html
http://apps.fz-juelich.de/jsc/sionlib/html/sionlib_tutorial_2013.pdf

-frank-

P.S. Nice blog from Nils

https://www.ibm.com/developerworks/community/blogs/storageneers/entry/scale_out_backup_with_tsm_and_gss_performance_test_results?lang=en


Frank Kraemer
IBM Consulting IT Specialist  / Client Technical Architect
Hechtsheimer Str. 2, 55131 Mainz
mailto:kraemerf at de.ibm.com
voice: +49171-3043699
IBM Germany

_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at gpfsug.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss


[prev in list] [next in list] [prev in thread] [next in thread]