Hello,
I'm trying to use Darshan for the first time to get the I/O profil of several kinds of jobs (Fortran and Python).
For the Fortran jobs I have no issue, I get 1 darshan logfile per execution and I can build a report with this command python -m darshan summary "log.darshan".
For the Python jobs, I use export DARSHAN_ENABLE_NONMPI=1 before running the job.
My Python script uses multiprocessing to read several files in parallel. I get one darshan logfile for each sub-process at the end of the execution.
I have tried to use " python -m darshan summary " to get a report merging all the logfiles but did not manage to get the right syntax. I am wondering if what I want to do is even possible with Pydarshan.
I tried using the "--include_names" argument but it seems to be a filter on the files accessed by the job and not on the log files themselves.
Can someone confirm me if it's possible to 'merge' several logfiles in one report or not ?
best regards,
Niels
--
----- Météo-France -----
OGER NIELS
DSI/D - Chef de projet Calcul Intensif
niels.oger(a)meteo.fr
Fixe : +33 561078198
