April 2014 - discuss - mailman3.cels.anl.gov

Re: [mpich-discuss] how to declare ranks IDs on each machine?
by Lu, Huiwei 25 Apr '14

25 Apr '14

You can determine the rank order of your MPI processes in your machinefile. For example, if you create a machinefile like: machine1 machine1 machine1 machine1 machine2 machine1 Using ‘mpiexec -f machinefile -n 6 ./example/cpi’, then rank 0-3 and rank 5 will run on machine1, and rank 4 will run on machine2. — Huiwei Lu Postdoc Appointee Mathematics and Computer Science Division, Argonne National Laboratory http://www.mcs.anl.gov/~huiweilu/ On Apr 25, 2014, at 2:42 AM, ehsan saei <ehsan.saei(a)gmail.com> wrote: > Dear all, > > I want to run my code on two machines and I want to declare rank IDs manually. > for example I want to rank=0 on machine 1 and rank= 4 on machine 2 and rank=5 on machine 1 > > how can I do that? > > Thanks in advance, > Ehsan > _______________________________________________ > discuss mailing list discuss(a)mpich.org > To manage subscription options or unsubscribe: > https://lists.mpich.org/mailman/listinfo/discuss

1 0

how to declare ranks IDs on each machine?
by ehsan saei 25 Apr '14

25 Apr '14

Dear all, I want to run my code on two machines and I want to declare rank IDs manually. for example I want to rank=0 on machine 1 and rank= 4 on machine 2 and rank=5 on machine 1 how can I do that? Thanks in advance, Ehsan

1 0

Re: [mpich-discuss] How to use MPI on two computers
by Lu, Huiwei 24 Apr '14

24 Apr '14

A machinefile is just a txt file. You can create it use your editor. If you use ‘ssh user@computername1’ and ‘ssh user@computername2' to connect your machines, the machinefile would be: computername1 computername2 — Huiwei On Apr 24, 2014, at 9:07 AM, ehsan saei <ehsan.saei(a)gmail.com> wrote: > Thanks for your respond. > I have ssh connection. Now my question is how can I create this machine file? > with hostnameA do you mean something like this: user@computername:"number of proccess" ? > > > On Thu, Apr 24, 2014 at 3:19 PM, Lu, Huiwei <huiweilu(a)mcs.anl.gov> wrote: > The easiest way of installing MPI on Ubuntu is by ‘sudo apt-get install mpich’. > As long as these two machines can ssh to each other, MPI can be used to connect them. > To use multiple machines, you need to create a machine file like: > //machinefile: > hostnameA > hostnameB > Then if you run MPI using ‘mpiexec -f machinefile -n 2 ./example/cpi’, the application ‘cpi’ will run on both machines and communication through MPI. > > For more details, please refer to https://www.mpich.org/static/downloads/3.1/mpich-3.1-userguide.pdf for more information. > > — > Huiwei Lu > Postdoc Appointee > Mathematics and Computer Science Division, Argonne National Laboratory > http://www.mcs.anl.gov/~huiweilu/ > > On Apr 24, 2014, at 7:39 AM, ehsan saei <ehsan.saei(a)gmail.com> wrote: > > > Dear community, > > > > I have to PCs with ubuntu 12.04 installed on them. How can I use MPI on these machines? > > Is it possible to connect them without router? > > It would be grateful if you guide me. > > > > Thanks in advance, > > Ehsan > > _______________________________________________ > > discuss mailing list discuss(a)mpich.org > > To manage subscription options or unsubscribe: > > https://lists.mpich.org/mailman/listinfo/discuss > > _______________________________________________ > discuss mailing list discuss(a)mpich.org > To manage subscription options or unsubscribe: > https://lists.mpich.org/mailman/listinfo/discuss > > _______________________________________________ > discuss mailing list discuss(a)mpich.org > To manage subscription options or unsubscribe: > https://lists.mpich.org/mailman/listinfo/discuss

1 0

Re: [mpich-discuss] How to use MPI on two computers
by ehsan saei 24 Apr '14

24 Apr '14

Thanks for your respond. I have ssh connection. Now my question is how can I create this machine file? with hostnameA do you mean something like this: user@computername:"number of proccess" ? On Thu, Apr 24, 2014 at 3:19 PM, Lu, Huiwei <huiweilu(a)mcs.anl.gov> wrote: > The easiest way of installing MPI on Ubuntu is by ‘sudo apt-get install > mpich’. > As long as these two machines can ssh to each other, MPI can be used to > connect them. > To use multiple machines, you need to create a machine file like: > //machinefile: > hostnameA > hostnameB > Then if you run MPI using ‘mpiexec -f machinefile -n 2 ./example/cpi’, the > application ‘cpi’ will run on both machines and communication through MPI. > > For more details, please refer to > https://www.mpich.org/static/downloads/3.1/mpich-3.1-userguide.pdf for > more information. > > — > Huiwei Lu > Postdoc Appointee > Mathematics and Computer Science Division, Argonne National Laboratory > http://www.mcs.anl.gov/~huiweilu/ > > On Apr 24, 2014, at 7:39 AM, ehsan saei <ehsan.saei(a)gmail.com> wrote: > > > Dear community, > > > > I have to PCs with ubuntu 12.04 installed on them. How can I use MPI on > these machines? > > Is it possible to connect them without router? > > It would be grateful if you guide me. > > > > Thanks in advance, > > Ehsan > > _______________________________________________ > > discuss mailing list discuss(a)mpich.org > > To manage subscription options or unsubscribe: > > https://lists.mpich.org/mailman/listinfo/discuss > > _______________________________________________ > discuss mailing list discuss(a)mpich.org > To manage subscription options or unsubscribe: > https://lists.mpich.org/mailman/listinfo/discuss >

1 0

Re: [mpich-discuss] How to use MPI on two computers
by Lu, Huiwei 24 Apr '14

24 Apr '14

The easiest way of installing MPI on Ubuntu is by ‘sudo apt-get install mpich’. As long as these two machines can ssh to each other, MPI can be used to connect them. To use multiple machines, you need to create a machine file like: //machinefile: hostnameA hostnameB Then if you run MPI using ‘mpiexec -f machinefile -n 2 ./example/cpi’, the application ‘cpi’ will run on both machines and communication through MPI. For more details, please refer to https://www.mpich.org/static/downloads/3.1/mpich-3.1-userguide.pdf for more information. — Huiwei Lu Postdoc Appointee Mathematics and Computer Science Division, Argonne National Laboratory http://www.mcs.anl.gov/~huiweilu/ On Apr 24, 2014, at 7:39 AM, ehsan saei <ehsan.saei(a)gmail.com> wrote: > Dear community, > > I have to PCs with ubuntu 12.04 installed on them. How can I use MPI on these machines? > Is it possible to connect them without router? > It would be grateful if you guide me. > > Thanks in advance, > Ehsan > _______________________________________________ > discuss mailing list discuss(a)mpich.org > To manage subscription options or unsubscribe: > https://lists.mpich.org/mailman/listinfo/discuss

1 0

How to use MPI on two computers
by ehsan saei 24 Apr '14

24 Apr '14

Dear community, I have to PCs with ubuntu 12.04 installed on them. How can I use MPI on these machines? Is it possible to connect them without router? It would be grateful if you guide me. Thanks in advance, Ehsan

1 0

Re: [mpich-discuss] credentials for mpiexec -f machinefile
by Jan Balewski 23 Apr '14

23 Apr '14

That does the trick. I set: export MPIR_CVAR_CH3_PORT_RANGE=10100:10200 set up all the firewalls, and waited for mpiexec to time out. This way I can see which port it decided to open. Now I see port 10100 is being used. [cosy11@oswrk210 mpich-3.1]$ mpiexec -f machinefile2 -n 4 ./examples/cpi [proxy:0:[email protected]] HYDU_sock_connect (utils/sock/sock.c:172): unable to connect from "oswrk207.lns.mit.edu" to "198.125.163.210" (Connection timed out) [proxy:0:[email protected]] main (pm/pmiserv/pmip.c:189): unable to connect to server 198.125.163.210 at port 10100 (check for firewalls!) Next, I open only a range of ports on the openStack controller: and my pi computation went through: [cosy11@oswrk210 mpich-3.1]$ mpiexec -f machinefile2 -n 4 ./examples/cpi Process 3 of 4 is on oswrk207.lns.mit.edu Process 2 of 4 is on oswrk207.lns.mit.edu ProcessB 0 of 4 is on oswrk210.lns.mit.edu ProcessB 1 of 4 is on oswrk210.lns.mit.edu pi is approximately 3.1415926535902168, Error is 0.0000000000004237 wall clock time = 0.161488 Thanks a lot - this lets me move forward. You can close this ticket Jan On Apr 23, 2014, at 11:35 PM, "Balaji, Pavan" <balaji(a)anl.gov> wrote: > Jan, > > It looks like mpiexec is not respecting all the aliases for that environment variable. Can you use MPIR_CVAR_CH3_PORT_RANGE to set the port range for now? We’ll add MPICH_PORT_RANGE as an alias for it in the next release. > > FWIW, use the README.envvar for the environment variable names. They should contain the correct information. Aliases are only maintained for backward compatibility. > > — Pavan > > On Apr 23, 2014, at 10:06 PM, Jan Balewski <balewski(a)MIT.EDU> wrote: > >> >> On Apr 23, 2014, at 5:32 PM, Kenneth Raffenetti <raffenet(a)mcs.anl.gov> wrote: >> >>> You can control the port range that mpich will use. See this item in the FAQ >>> >>> http://wiki.mpich.org/mpich/index.php/Frequently_Asked_Questions#Q:_How_do_… >> >> Hi, >> Thanks, but somehow setting of MPICH_PORT_RANGE variable on the master VM does not propagate. >> mpiexec still tries to open the port 34781 which is out of the range set by >> export MPICH_PORT_RANGE=10000:10100 >> >> I'm missing sth - not sure what? >> Jan >> >> -------- >> [cosy11@oswrk210 mpich-3.1]$ echo $MPICH_PORT_RANGE >> 10000:10100 >> >> [cosy11@oswrk210 mpich-3.1]$ mpiexec -f machinefile2 -n 4 ./examples/cpi >> [proxy:0:[email protected]] HYDU_sock_connect (utils/sock/sock.c:172): unable to connect from "oswrk207.lns.mit.edu" to "198.125.163.210" (Connection timed out) >> [proxy:0:[email protected]] main (pm/pmiserv/pmip.c:189): unable to connect to server 198.125.163.210 at port 34781 (check for firewalls!) >> >> _______________________________________________ >> discuss mailing list discuss(a)mpich.org >> To manage subscription options or unsubscribe: >> https://lists.mpich.org/mailman/listinfo/discuss > > _______________________________________________ > discuss mailing list discuss(a)mpich.org > To manage subscription options or unsubscribe: > https://lists.mpich.org/mailman/listinfo/discuss

1 0

Re: [mpich-discuss] credentials for mpiexec -f machinefile
by Balaji, Pavan 23 Apr '14

23 Apr '14

Jan, It looks like mpiexec is not respecting all the aliases for that environment variable. Can you use MPIR_CVAR_CH3_PORT_RANGE to set the port range for now? We’ll add MPICH_PORT_RANGE as an alias for it in the next release. FWIW, use the README.envvar for the environment variable names. They should contain the correct information. Aliases are only maintained for backward compatibility. — Pavan On Apr 23, 2014, at 10:06 PM, Jan Balewski <balewski(a)MIT.EDU> wrote: > > On Apr 23, 2014, at 5:32 PM, Kenneth Raffenetti <raffenet(a)mcs.anl.gov> wrote: > >> You can control the port range that mpich will use. See this item in the FAQ >> >> http://wiki.mpich.org/mpich/index.php/Frequently_Asked_Questions#Q:_How_do_… > > Hi, > Thanks, but somehow setting of MPICH_PORT_RANGE variable on the master VM does not propagate. > mpiexec still tries to open the port 34781 which is out of the range set by > export MPICH_PORT_RANGE=10000:10100 > > I'm missing sth - not sure what? > Jan > > -------- > [cosy11@oswrk210 mpich-3.1]$ echo $MPICH_PORT_RANGE > 10000:10100 > > [cosy11@oswrk210 mpich-3.1]$ mpiexec -f machinefile2 -n 4 ./examples/cpi > [proxy:0:[email protected]] HYDU_sock_connect (utils/sock/sock.c:172): unable to connect from "oswrk207.lns.mit.edu" to "198.125.163.210" (Connection timed out) > [proxy:0:[email protected]] main (pm/pmiserv/pmip.c:189): unable to connect to server 198.125.163.210 at port 34781 (check for firewalls!) > > _______________________________________________ > discuss mailing list discuss(a)mpich.org > To manage subscription options or unsubscribe: > https://lists.mpich.org/mailman/listinfo/discuss

1 0

Re: [mpich-discuss] credentials for mpiexec -f machinefile
by Jan Balewski 23 Apr '14

23 Apr '14

On Apr 23, 2014, at 5:32 PM, Kenneth Raffenetti <raffenet(a)mcs.anl.gov> wrote: > You can control the port range that mpich will use. See this item in the FAQ > > http://wiki.mpich.org/mpich/index.php/Frequently_Asked_Questions#Q:_How_do_… Hi, Thanks, but somehow setting of MPICH_PORT_RANGE variable on the master VM does not propagate. mpiexec still tries to open the port 34781 which is out of the range set by export MPICH_PORT_RANGE=10000:10100 I'm missing sth - not sure what? Jan -------- [cosy11@oswrk210 mpich-3.1]$ echo $MPICH_PORT_RANGE 10000:10100 [cosy11@oswrk210 mpich-3.1]$ mpiexec -f machinefile2 -n 4 ./examples/cpi [proxy:0:[email protected]] HYDU_sock_connect (utils/sock/sock.c:172): unable to connect from "oswrk207.lns.mit.edu" to "198.125.163.210" (Connection timed out) [proxy:0:[email protected]] main (pm/pmiserv/pmip.c:189): unable to connect to server 198.125.163.210 at port 34781 (check for firewalls!)

1 0

Re: [mpich-discuss] credentials for mpiexec -f machinefile
by Kenneth Raffenetti 23 Apr '14

23 Apr '14

You can control the port range that mpich will use. See this item in the FAQ http://wiki.mpich.org/mpich/index.php/Frequently_Asked_Questions#Q:_How_do_… Ken On 04/23/2014 04:26 PM, Jan Balewski wrote: > > On Apr 23, 2014, at 5:10 PM, "Antonio J. Peña" <apenya(a)mcs.anl.gov> wrote: > >> No, what I meant was doing "ssh localhost", but now I look at your logs again, it may be a problem of your DNS configuration. >> mpi-966f395e-bbb1-4a20-8cbc-c10081e91244 seems to be unable to resolve the IP address of mpi-be6bebee-55e3-4901-a5bb-637395ba46f6. Take a look at your /etc/hosts files in both hosts. >> > > Right, I just figured that out as well. When VM's are launched the get assigned this funny names, not matching the DNS names. > So I have manually adjusted the content of this 3 files (I run on SL6.5) > vi /etc/hostname > vi /etc/sysconfig/network > vi /etc/hosts > > so the DNS name , public IP, and hostname --fqd return the same info, e.g. > > [cosy11@oswrk210 mpich-3.1]$ hostname --fqd > oswrk210.lns.mit.edu > > Now the command below does not crashes but hangs for many minutes, eventually time-outing. > So looks like I need to open port 60568 , right? > After I shut down fire wall on IP=210 it complain abut port 45895 > Next I shut down firewall in IP=207 > and it complained abut new port 35167 > > Finally I shut down firewall between VM (on the openStack controller) and … IT WORKED: > > [cosy11@oswrk210 mpich-3.1]$ mpiexec -f machinefile2 -n 4 ./examples/cpi > Process 0 of 4 is on oswrk210.lns.mit.edu > Process 3 of 4 is on oswrk207.lns.mit.edu > Process 1 of 4 is on oswrk210.lns.mit.edu > Process 2 of 4 is on oswrk207.lns.mit.edu > pi is approximately 3.1415926535899028, Error is 0.0000000000001097 > wall clock time = 0.003602 > > QUESTION: > Can you tell me what ports I need to have open on the master & worker VMs for mpiexec to distribute work on them? > > Jan > > > > > _______________________________________________ > discuss mailing list discuss(a)mpich.org > To manage subscription options or unsubscribe: > https://lists.mpich.org/mailman/listinfo/discuss >

1 0