About 2 months ago, I tried using Darshan to trace a TensorFlow2 DL training. I could not trace the input. What I _think_ happens is the TF2 uses mmap() for reading the input files and I don't think Darshan can capture that file IO. But I'm not a Darshan expert so perhaps someone has tried this before and can help

(BTW - it's possible to build TensorFlow so it doesn't use mmap() for reading files.)

Jeff



On Mon, Jul 6, 2020 at 1:08 PM Devarajan, Hariharan <hdevarajan@anl.gov> wrote:

 

Hello,

 

I was able to run my test program with 3.2.1 darshan. However, when i trace an app which load tensorflow it seems darshan doesn't produce trace. I am attaching two tars one with working example and one without. The only difference between the two is in test.py where i import tensorflow on first line.

 

Can you please assist on how I can further debug the problem?

 

Regards

Hariharan

 

_______________________________________________
Darshan-users mailing list
Darshan-users@lists.mcs.anl.gov
https://lists.mcs.anl.gov/mailman/listinfo/darshan-users