March 2018 - Darshan-users - mailman3.cels.anl.gov

download/ftp site down
by Phil Carns 29 Mar '18

29 Mar '18

Hi all, Our FTP server is down at the moment and the ETA for return isn't clear yet. If you need a tar ball with the latest Darshan release you can use this link, which will generate it directly from the git repository: https://xgitlab.cels.anl.gov/darshan/darshan/repository/darshan-3.1.6/archi… thanks, -Phil

1 1

Files listed twice in darshan output
by Ed Karrels 29 Mar '18

29 Mar '18

Is it normal for a file to be listed more than once in darshan output for the same process rank? I've got a logfile (generated by runtime version 2.3.0) for which darshan-parser (version 2.3.1) outputs stats for a few of the accessed files twice. $ darshan-parser stonej_vmd_BLUEWATERS_id1340701_1-19-39124-18216319424980466532_1.darshan.gz | nl | egrep '41554.CP_F_(OPEN|CLOSE)_TIMESTAMP' 388 -1 14116071308113141554 CP_F_OPEN_TIMESTAMP 0.314585 .../atomselect.tcl /mnt/a lustre 391 -1 14116071308113141554 CP_F_CLOSE_TIMESTAMP 0.363727 .../atomselect.tcl /mnt/a lustre 30034 -1 14116071308113141554 CP_F_OPEN_TIMESTAMP 0.398742 .../atomselect.tcl /mnt/a lustre 30037 -1 14116071308113141554 CP_F_CLOSE_TIMESTAMP 0.399672 .../atomselect.tcl /mnt/a lustre It looks like the file was opened and closed twice, but when I tried this in a test program with darshan runtime and util version 2.3.1, the accesses were combined into one set of records in Darshan. I'm wondering if this is normal and I should deal with it when loading darshan data into a database, or if this file is flawed and I can ignore it. thanks, Ed

2 1

Darshan Convert
by Borcean, Gabriel T 12 Mar '18

12 Mar '18

Recommended ways of processing quantity of mixed version darshan logs for some type of analysis? Any possibility Spark integration? Any documentation for custom utilities with darshan-logutils*?

2 1

darshan 3.1.6 is now available
by Shane Snyder 05 Mar '18

05 Mar '18

Darshan version 3.1.6 is available for download here <http://press3.mcs.anl.gov/darshan/download/>. This release addresses two bugs discovered in version 3.1.5: - Bug fix in mapping of Darshan’s ‘MPI_File_read_all’ wrapper to the underlying MPI symbol. This results in a crash if a dynamically-linked application preloads the Darshan library and calls ‘MPI_File_read_all’. - Bug fix for linker failures caused when an application links in a library that calls MPI externally (e.g., PETSc). - Reported by Bilel Hadri We highly recommend upgrading from version 3.1.5 to 3.1.6 particularly for deployments on production systems, as these bugs could be disruptive for end users. Please report any questions, issues, or concerns using this mailing list, or by opening an issue on the Darshan GitLab page. Thanks! --Darshan team

1 0