Darshan users,
We are happy to announce a new pre-release for Darshan 3.3.0 (darshan-3.3.0-pre2). You can download the source HERE<ftp://ftp.mcs.anl.gov/pub/darshan/releases/darshan-3.3.0-pre2.tar.gz>.
This release contains a number of new features, bug fixes, and other improvements as detailed below:
* New PyDarshan Python package for analyzing Darshan log files
* PyDarshan provides a couple of interfaces to Darshan logs that should allow for easier development of custom Darshan log analysis utilities in Python
* See the PyDarshan documentation<https://www.mcs.anl.gov/research/projects/darshan/docs/pydarshan/index.html> for more details
* Thanks to Jakob Luettgau(DKRZ) for all of the hard work in contributing this package
* Bug fixes
* Modified Lustre module to use a safer method for obtaining Lustre file striping information (based on fgetxattr rather than ioctl)
* Fixed bug leading to potential deadlock when reducing shared records in MPI programs (known to affect mvapich2)
* Fixed bug causing errors when using Darshan's non-MPI mode when Darshan is built with an MPI compiler
* Disabled DXT's MPI-IO offset tracking for OpenMPI applications to avoid crashes caused by an OpenMPI bug
* Fixed various HDF5 module bugs:
* Fixes for applications using H5S_SELECT_NONE selections resulting in HDF5 error messages
* Fixes for applications using non-MPIIO VFDs resulting in HDF5 error messages
* Fixes for potentially incorrect counter values related to common accesses in the H5D module
* Other fixes allowing usage of the HDF5 modules in serial HDF5 applications
* Other enhancements
* Added support for querying Lustre file striping statistics for Lustre files that are symlinked from other file systems
* Added support for instrumenting openat, preadv, preadv2, pwritev, and pwritev2 functions, improving instrumentation of OpenMPI applications
* Improved error messages and documentation for darshan-util tools, including handling of incomplete Darshan log files
* Added new H5D module counter indicating the Darshan record ID of the file an HDF5 dataset belongs to
As always, please report any issues, comments, or questions to us using this mailing list or our GitLab page<https://xgitlab.cels.anl.gov/darshan/darshan>.
Thanks!
--Darshan team
Hi all,
I’ve built 3.2.1 Darshan with --enable-hdf5-mod=
When I began writing chunks collectively with hdf5 I got errors only when darshan
instrumentation is enabled.
The darshan instrumentation without hdf5 chunking worked fine (also with --enable-hdf5-
mod).
I have opened a topic at the HDF group forum: https://forum.hdfgroup.org/t/parallel-hdf5-write-with-irregular-size-in-one…
The resulting errors are posted to this topic as well.
The minimal example to reproduce the error is also here: https://dbkt.hdfgroup.org/
original/2X/c/c58be4df192333b6d15d6e91d58b114b85cea2f4.cc
My Setup is:
* OpenMPI (OpenRTE) 4.0.5
* HDF5 1.12.0
* Darshan 3.2.1
Could you take a look and check if there is a problem with the HDF5 instrumentation in
Darshan?
Thank you
Tobias
