February 2012 - Darshan-users - mailman3.cels.anl.gov

Darshan and Intel MPI (x86_64)
by Harr, Cameron Contractor, SAIC 01 Mar '12

01 Mar '12

I'm trying to get Darshan running on a RedHat/X86_64 cluster with a few different flavors of MPI available. I'm most recently trying Intel MPI and gfortran (Intel Compilers didn't seem to work) and after a fair bit of tweaking, got the executable recompiled with libdarshan.so successfully linked in. In my job run script, I verify that libdarshan is linked in and the job runs to completion; however no output is generated. I also tried setting DARSHAN_INTERNAL_TIMING=1, but still no output. Should I be able to use Intel MPI and/or is there a place that documents which MPI stacks are supported? -- _____________________ Cameron Harr | SAIC | C4IT BU Systems Analyst | FNMOC phone: 831.656.4154 mobile: 831.233.8216 email: cameron.harr.ctr(a)navy.mil<mailto:[email protected]> email: harrc(a)saic.com<mailto:[email protected]>

3 8

2.2.0 pre-release
by Phil Carns 29 Feb '12

29 Feb '12

Hi all, Kevin and I have tagged a new darshan pre-release. We would be happy for anyone to try it out who is interested, but please don't use it in production anywhere ;-) ftp://ftp.mcs.anl.gov/pub/darshan/releases/darshan-2.2.0-pre1.tar.gz You can have a look at the trac tickets that went into this release here: https://trac.mcs.anl.gov/projects/darshan/query?group=status&milestone=spli… or have a look at the changelog here: https://trac.mcs.anl.gov/projects/darshan/browser/tags/darshan-2.2.0-pre1/C… The biggest visible change is that we have split the code into two parts: darshan-runtime and darshan-util. The former is for use on the system where you intend to instrument jobs. The latter is for use on systems where you intend to analyze log files. This fixes a number of bugs and improves portability in general. They are distributed as subdirectories in the same tar ball. There is no documentation for this release yet, but the main change is in how to configure the two parts of darshan. Here is an example for darshan-runtime. Note that mpicc is specified using the CC environment variable: ./configure --with-mem-align=16 --with-log-path=/my/log/dir --prefix=/my/install/dir --with-jobid-env=COBALT_JOBID CC=mpicc This is an example configure line for darshan-util: ../darshan-util/configure --prefix=/my/install/dir We don't have any other planned changes for the official release. Between now and the real 2.2.0 release we will just be testing, fixing any resulting bugs, and updating the online documentation. thanks! -Phil

1 1

Ovis
by Rob Latham 10 Feb '12

10 Feb '12

There's a guy here from Sandia (Jim Brandt) talking about a tool called 'Ovis'. It's not exactly like darshan. more like TACC stats. the statistics collection approach is different from darshan, but there are probably some good ideas in their data exploration UI. they use something called 'baler' log file analysis from Louisiana Tech (Narate Taerat working under Chokchai 'box' Leangsukusn). Looks at a bunch of log files and groups similar things, but also will flag outliers. there are other components of this project that aren't so relevant to darshan, at least not until darshan decides to send stats to a central location: a lightweight distributed metric service to collect stats from every node. ==rob -- Rob Latham Mathematics and Computer Science Division Argonne National Lab, IL USA

1 0