November 2016 - Darshan-users - mailman3.cels.anl.gov

compatibility with HDF5 1.10.x
by Karl-Ulrich Bamberg 30 Jan '17

30 Jan '17

Dear Darshan-developers, Thanks for this great tool, it helps us a lot. We switched to HDF5 1.10 and found that DARSHAN (Git/master) is not compatible due to the typedef of hid_t which changed in HDF5 1.10. There is a patch attached, that provides a configure-switch for HDF5 1.10. Unfortunately 1.10 breaks compatibility tim 1.8 so I do not (yet) see, if there is any way to use both with the same DARSHAN. Kind regards and keep up with the good work :-) Kalle Mit freundlichen Grüßen -- Karl-Ulrich Bamberg Ludwig-Maximilians-Universität München Arnold-Sommerfeld-Center (ASC) Computational & Plasma Physics Theresienstr. 37, D-80333 München phone: +49 (0)89 2180 4577 fax: +49 (0)89 2180 99 4577 e-mail: Karl-Ulrich.Bamberg(a)physik.uni-muenchen.de

3 5

Darshan trace file creation
by Wadud Miah 30 Nov '16

30 Nov '16

Hello, I built Darshan with Intel MPI 5.1.3 and gcc 4.3.4 with the following configure flags: ./configure --prefix=$HOME/darshan-3.1.2-impi --with-mem-align=8 --with-jobid-env=NONE --with-log-path-by-env=DARSHAN_LOGPATH which built fine. I set DARSHAN_LOGPATH to darshan-trace-dir and I created the directory darshan-trace-dir. I then executed my MPI code which does I/O using: mpirun -n 9 -env LD_PRELOAD /home/pr1ebt00/pr1ebt05/darshan-3.1.2-impi/lib/libdarshan.so ./bt.A.9.mpi_io_full in the same directory that has the darshan-trace-dir directory. However, I do not see any tracefile in the directory darshan-trace-dir and no error messages. Any help will be greatly appreciated. Thanks in advance, Wadud. --------------------------------------- Dr. Wadud Miah Computational Scientist Numerical Algorithms Group 01865 518035 ________________________________ The Numerical Algorithms Group Ltd is a company registered in England and Wales with company number 1249803. The registered office is: Wilkinson House, Jordan Hill Road, Oxford OX2 8DR, United Kingdom. This e-mail has been scanned for all viruses by Microsoft Office 365. ________________________________

2 6

darshan-3.1.2 compilation Issue with lustre libs
by Glenn Lockwood 30 Nov '16

30 Nov '16

Hi Pankaj It looks like earlier versions of Lustre didn't define a constant correctly. As a temporary work-around, you can add the following line: #define LOV_MAX_STRIPE_COUNT 2000 to the top of darshan-runtime/darshan-lustre.h We didn't test the Darshan Lustre module against older versions of Lustre, which is why we didn't catch this--sorry! I'll put in a permanent fix for future releases of Darshan and try to find an older Lustre system on which we can test. Glenn Date: Wed, 30 Nov 2016 12:58:08 +0530 (IST) > From: Pankaj Dorlikar <pankajd(a)cdac.in> > To: darshan-users(a)lists.mcs.anl.gov > Subject: [Darshan-users] darshan-3.1.2 compilation Issue with lustre > libs > Message-ID: > <348240992.395.1480490888121.JavaMail.open-xchange(a)webmail.cdac.in > > > Content-Type: text/plain; charset="utf-8" > > Hi, > > > > I am getting below error while compiling darshan-3.1.2 on cent os 6.2 , > intel 64 > bit machine with lustre client installed as below : > > lustre-client-debuginfo-2.1.1-2.6.32_220.el6.x86_64.x86_64 > > lustre-client-2.1.1-2.6.32_220.el6.x86_64.x86_64 > > lustre-client-modules-2.1.1-2.6.32_220.el6.x86_64.x86_64 > > For compilation, I am using below command line and it thorows the below > error : > > mpicc -DDARSHAN_CONFIG_H=\"darshan-runtime-config.h\" -I . -I ../ -I . > -I./../ > -g -O2 -D_LARGEFILE64_SOURCE -DDARSHAN_LUSTRE -c lib/darshan-lustre.c -o > lib/darshan-lustre.o > lib/darshan-lustre.c: In function ?darshan_instrument_lustre_file?: > lib/darshan-lustre.c:59: error: ?LOV_MAX_STRIPE_COUNT? undeclared (first > use in > this function) > lib/darshan-lustre.c:59: error: (Each undeclared identifier is reported > only > once > lib/darshan-lustre.c:59: error: for each function it appears in.) > make: *** [lib/darshan-lustre.o] Error 1 > > > > Any pointers regarding this would be helpful.. > > > > > > Thanks, > > Pankaj > ------------------------------------------------------------ > ------------------------------------------------------------------- > [ C-DAC is on Social-Media too. Kindly follow us at: > Facebook: https://www.facebook.com/CDACINDIA & Twitter: @cdacindia ] > > This e-mail is for the sole use of the intended recipient(s) and may > contain confidential and privileged information. If you are not the > intended recipient, please contact the sender by reply e-mail and destroy > all copies and the original message. Any unauthorized review, use, > disclosure, dissemination, forwarding, printing or copying of this email > is strictly prohibited and appropriate legal action will be taken. > ------------------------------------------------------------ > ------------------------------------------------------------------- >

1 0

darshan-3.1.2 compilation Issue with lustre libs
by Pankaj Dorlikar 30 Nov '16

30 Nov '16

Hi, I am getting below error while compiling darshan-3.1.2 on cent os 6.2 , intel 64 bit machine with lustre client installed as below : lustre-client-debuginfo-2.1.1-2.6.32_220.el6.x86_64.x86_64 lustre-client-2.1.1-2.6.32_220.el6.x86_64.x86_64 lustre-client-modules-2.1.1-2.6.32_220.el6.x86_64.x86_64 For compilation, I am using below command line and it thorows the below error : mpicc -DDARSHAN_CONFIG_H=\"darshan-runtime-config.h\" -I . -I ../ -I . -I./../ -g -O2 -D_LARGEFILE64_SOURCE -DDARSHAN_LUSTRE -c lib/darshan-lustre.c -o lib/darshan-lustre.o lib/darshan-lustre.c: In function ‘darshan_instrument_lustre_file’: lib/darshan-lustre.c:59: error: ‘LOV_MAX_STRIPE_COUNT’ undeclared (first use in this function) lib/darshan-lustre.c:59: error: (Each undeclared identifier is reported only once lib/darshan-lustre.c:59: error: for each function it appears in.) make: *** [lib/darshan-lustre.o] Error 1 Any pointers regarding this would be helpful.. Thanks, Pankaj ------------------------------------------------------------------------------------------------------------------------------- [ C-DAC is on Social-Media too. Kindly follow us at: Facebook: https://www.facebook.com/CDACINDIA & Twitter: @cdacindia ] This e-mail is for the sole use of the intended recipient(s) and may contain confidential and privileged information. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies and the original message. Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this email is strictly prohibited and appropriate legal action will be taken. -------------------------------------------------------------------------------------------------------------------------------

1 0

Darshan events at SC16
by Phil Carns 09 Nov '16

09 Nov '16

Darshan will be featured in several community events at SC 2016 next week; please stop by and visit us if you are interested in learning more about Darshan and other related topics: * Tutorial: Parallel I/O in Practice <http://sc16.supercomputing.org/presentation/?id=tut113&sess=sess203>, by Robert Latham, Robert Ross, and Brent Welch. Sunday, November 13th, 8:30am – 5pm, in room 355-B (requires tutorial registration). * Paper presentation: Modular HPC I/O Characterization with Darshan <http://www.vi-hps.org/symposia/espt/espt-sc16.html>, by Shane Snyder, Philip Carns, Kevin Harms, Robert Ross, Glenn Lockwood and Nicholas Wright. Sunday, November 13th, 3:30pm – 3:55pm, ESPT workshop in room 155-E (requires workshop registration). * Birds of a Feather session: Analyzing Parallel I/O <http://wr.informatik.uni-hamburg.de/events/2016/bof-monitoring>, by Philip Carns and Julian Kunkel with guest presentations from Glenn Lockwood, Shane Snyder, Jakob Luettgau, Salem El Sayed, and Xiaosong Ma. Wednesday, November 16th, 5:15pm – 7:00pm, in room 155-E. thanks, -Phil

1 0

Darshan 3.1.2 point release now available
by Shane Snyder 04 Nov '16

04 Nov '16

Darshan users, Darshan version 3.1.2 is a point release meant to address a bug in versions 3.1.0 and 3.1.1 that can cause crashes in applications (or other binaries) when LD_PRELOADing the Darshan library. The bug was caused by an error in the resolution of the address of the fopen64 function call, so any binary that calls this function is affected. This bug does not affect Darshan’s methods for instrumenting statically-linked executables. The release tarball can be downloaded HERE <ftp://ftp.mcs.anl.gov/pub/darshan/releases/darshan-3.1.2.tar.gz>. Documentation for this version of Darshan can be found HERE <http://press3.mcs.anl.gov/darshan/documentation/>. Thanks! --Darshan team

1 0

Re: [Darshan-users] Segmentation fault with Darshan-3.1.1
by Harms, Kevin 01 Nov '16

01 Nov '16

If you set LD_PRELOAD in your shell, then you will be intercepting any POSIX operations by any program, such as ls. I’m guessing you don’t want to profile ‘ls’? You can set LD_PRELOAD only for the application you want to profile. $ LD_PRELOAD=/path/to/darshan/lib/libdarshan.so ./myapp Add the FORTRAN library as well if you are profiling FORTRAN code. You can also export LD_PRELOAD it with the proper mpirun options. kevin -----Original Message----- From: <darshan-users-bounces(a)lists.mcs.anl.gov> on behalf of "Suman, Preeti" <preeti.suman(a)intel.com> Date: Monday, October 24, 2016 at 4:01 PM To: "darshan-users(a)lists.mcs.anl.gov" <darshan-users(a)lists.mcs.anl.gov> Subject: [Darshan-users] Segmentation fault with Darshan-3.1.1 Hello, With Darshan-3.1.1, compiled with GCC-5.1 or Intel-17 compilers on KNL, when LD_PRELOAD=<path_to>/darshan-runtime/lib/libdarshan.so is set, I am getting a segmentation fault whenever I do ‘ls’. Example: bash-4.2$ ls Segmentation fault (core dumped) Have you encountered this before? For version-3.1.1 is it recommended to build Darshan with --disable-ld-preload ? Thanks, Preeti Suman Software Development Engineer, Systems Engineering, Architecture & Runtimes Email: preeti.suman(a)intel.com <mailto:[email protected]>

4 3