Sajid please use latest mpich master branch from www.github.com/pmodels/mpich<http://www.github.com/pmodels/mpich>. This contains the bug fix that was merged with the following PR: https://github.com/pmodels/mpich/pull/3947 Giuseppe Congiu Postdoctoral Appointee MCS Division Argonne National Laboratory 9700 South Cass Ave., Lemont, IL 60439 On Nov 27, 2019, at 11:15 AM, Sajid Ali via discuss <[email protected]<mailto:[email protected]>> wrote: Hi Jeff/Giuseppe, I spoke to the computational specialist from research IT and he confirmed that this particular build of MPICH is indeed broken. As Giuseppe pointed out the hydra launcher was running multi threaded jobs on each node because it was unable to read the nodelist. When we passed a nodelist to mpirun and repeated the same test, the results looked more reasonable (~80us latency instead of ~0.05us due to ch3:TCP). Thanks for the help! -- Sajid Ali | PhD Candidate Applied Physics Northwestern University s-sajid-ali.github.io<http://s-sajid-ali.github.io/> _______________________________________________ discuss mailing list [email protected]<mailto:[email protected]> To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss