I would like to use hydra environment variables to bind threads to cores. I am using hydra 3.2 with mvapich2 version 2.2b_psm built with intel 15.0.
I have a simple program to print out the cpu affinity for each process which I have used to test process binding. I have included the output of this program below.
[jlow@blogin2 hybrid_hello]$ HYDRA_BINDING=socket mpirun -np 4 a.out
Hello from node blogin2, core 0-15; AKA rank 3, thread 0
Hello from node blogin2, core 0-15; AKA rank 0, thread 0
Hello from node blogin2, core 0-15; AKA rank 2, thread 0
Hello from node blogin2, core 0-15; AKA rank 1, thread 0
[jlow@blogin2 hybrid_hello]$ mpirun -bind-to core:2 -np 4 a.out
Hello from node blogin2, core 4,5; AKA rank 2, thread 0
Hello from node blogin2, core 6,7; AKA rank 3, thread 0
Hello from node blogin2, core 0,1; AKA rank 0, thread 0
Hello from node blogin2, core 2,3; AKA rank 1, thread 0
[jlow@blogin2 hybrid_hello]$ mpirun -bind-to socket -np 4 a.out
Hello from node blogin2, core 8-15; AKA rank 3, thread 0
Hello from node blogin2, core 0-7; AKA rank 0, thread 0
Hello from node blogin2, core 0-7; AKA rank 2, thread 0
Hello from node blogin2, core 8-15; AKA rank 1, thread 0
[jlow@blogin2 hybrid_hello]$ HYDRA_BINDING=socket mpirun -np 4 a.out
Hello from node blogin2, core 0-15; AKA rank 3, thread 0
Hello from node blogin2, core 0-15; AKA rank 1, thread 0
Hello from node blogin2, core 0-15; AKA rank 2, thread 0
Hello from node blogin2, core 0-15; AKA rank 0, thread 0
It appears that hydra is ignoring my environmental variables. How can I use environmental variables to bind processes to cores with hydra?
Thanks,
John J. Low
Principal Computational Science Specialist
Computing, Environment and Life Sciences
Building 240, 2143
9700 South Cass Avenue
Argonne National Laboratory
Argonne, IL 60439.
630-252-0045
www.linkedin.com/pub/john-low/15/8b0/5aa/