Hello everyone, The host file content is just the IP of the other computer. So its just: 130.166.115.232 When I typed in the mpirun --host my comp,therecomp /bin/hostname this was the output crowlab: [~]> mpirun --host 130.166.115.232,130.166.115.232 /bin/hostname [proxy:0:[email protected]] HYDU_sock_connect (./utils/sock/sock.c:174): unable to connect from "localhost.localdomain" to "localhost.localdomain" (Connection refused) [proxy:0:[email protected]] main (./pm/pmiserv/pmip.c:189): unable to connect to server localhost.localdomain at port 41231 (check for firewalls!) Again same problem as before, its attempting to connect from "localhost.localdomain" (my computer) to "localhost.localdomain" (again my computer) instead of using the IP addresses that I gave it. Sincerely, Sam On Mon, Oct 31, 2016 at 9:47 PM, <[email protected]> wrote:
Send discuss mailing list submissions to [email protected]
To subscribe or unsubscribe via the World Wide Web, visit https://lists.mpich.org/mailman/listinfo/discuss or, via email, send a message with subject or body 'help' to [email protected]
You can reach the person managing the list at [email protected]
When replying, please edit your Subject line so it is more specific than "Re: Contents of discuss digest..."
Today's Topics:
1. Re: Running a program on multiple computers (Kenneth Raffenetti) 2. Re: Using external load-balancer with mpich (Halim Amer) 3. Re: Using external load-balancer with mpich ([email protected]) 4. Re: Is there a way to set timeout to mpi process launch? (Halim Amer) 5. Re: Using external load-balancer with mpich (Halim Amer) 6. Re: Is there a way to set timeout to mpi process launch? (Pranav Ladkat) 7. ADIOI_Set_lock error (Luke Van Roekel)
----------------------------------------------------------------------
Message: 1 Date: Thu, 27 Oct 2016 22:17:59 -0500 From: Kenneth Raffenetti <[email protected]> To: <[email protected]> Subject: Re: [mpich-discuss] Running a program on multiple computers Message-ID: <[email protected]> Content-Type: text/plain; charset="utf-8"; format=flowed
Hi,
Apologies for the delay in response. My comments inline below.
On 10/15/2016 07:40 PM, Mahdi, Sam wrote:
Hello everyone,
I am attempting to run a single program on 32 cores split across 4 computers (So each computer has 8 cores). I am attempting to use mpich for this. I currently am just testing on 2 computers, I have the program installed on both, as well as mpich installed on both. I have created a register key and can login in using ssh into the other computer without a password. I have come across 2 problems. One, when I attempt to connect using the mpirun -np 3 --host a (the IP of the computer I am attempting to connect to) hostname I recieve the error unable to connect from "localhost.localdomain" to "localhost.localdomain"
This is indicating my computers "localhost.localdomain" is attempting to connect to another "localhost.localdomain". How can I change this so that it connects via my IP to the other computers IP?
Secondly, I attempted to use a host file instead using the hydra process wiki. I created a hosts file with just the IP of the computer I am attempting to connect to. When I type in the command mpiexec -f hosts -n 4 ./applic
I get this error [[email protected]] HYDU_parse_hostfile (./utils/args/args.c:323): unable to open host file: hosts
along with other errors of unable to parse hostfile, match handler etc. I assume this is all due to it being unable to read the host file. Is there any specific place I should save my hosts file? I have it saved directly on my Desktop. I have attempted to indicate the full path where it is located, but I still get the same error.
There is no required location for the hosts file. If you are specifying full path and there are still issues, it may be a formatting issue. Can you paste or attach the contents of your hosts file so we can confirm the format is good?
For the first problem, I have read that I need to change /etc/hosts manually by using the sudo command to manually enter the IP of the computer I am attempting to connect to in the /etc/hosts file. I assume the computer is attempting to connect to itself (set up the program first on its own core, then send it to another, hence attempting to start it on localhost.localdomain).
For the second problem, I have attempted to add run the command mpirun --host my computer IP, the other computer IP ./program
This format should be okay for your purposes. What happens if you try:
mpirun --host my computer IP, the other computer IP /bin/hostname
If the hostnames of each host are echoed to the command-line, then job launch is successful and the issues is during connection setup during MPI_Init.
Ken
------------------------------
Message: 2 Date: Thu, 27 Oct 2016 23:18:08 -0500 From: Halim Amer <[email protected]> To: <[email protected]> Subject: Re: [mpich-discuss] Using external load-balancer with mpich Message-ID: <[email protected]> Content-Type: text/plain; charset="windows-1252"; format=flowed
I don't understand what you are trying to do. Can you give an example?
Halim www.mcs.anl.gov/~aamer
On 10/26/16 5:21 PM, lost wrote:
Can I use an external load balancer with mpiexec by providing a single hostname in hosts file with, optionally, some large number for host rank, and putting load balancer listening on that hostname and forwarding connections to the actual hosts?
I am trying to achieve autoscaling (load balancer tracks liveness of hosts and spins up new ones on demand).
_______________________________________________ discuss mailing list [email protected] To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss
------------------------------
Message: 3 Date: Thu, 27 Oct 2016 21:59:03 -0700 From: <[email protected]> To: Halim Amer <[email protected]>, "[email protected]" <[email protected]> Subject: Re: [mpich-discuss] Using external load-balancer with mpich Message-ID: <[email protected]> Content-Type: text/plain; charset="utf-8"
I have a system, that can start and stop machines depending on fleet?s current load. Essentially, it must be the one to decide, which machine will receive a new task, and optionally start acquire a new one from some pool for it.
For example, I can have two hosts of six currently executing something (might be not related to MPICH), and my load balancer machine is aware of it. Other 4 are in low-power state to conserve costs. So when I call mpiexec, I want to tell it to send all the tasks to the load balancer, requesting 2 hosts, so that load balancer then could start two new hosts to handle that request. If the initial hosts would not be busy with some other task, load balancer would send incoming jobs to them, and kept all other four deallocated.
- Victor
From: Halim Amer Sent: Thursday, October 27, 2016 9:18 PM To: [email protected] Subject: Re: [mpich-discuss] Using external load-balancer with mpich
I don't understand what you are trying to do. Can you give an example?
Halim www.mcs.anl.gov/~aamer
On 10/26/16 5:21 PM, lost wrote:
Can I use an external load balancer with mpiexec by providing a single hostname in hosts file with, optionally, some large number for host rank, and putting load balancer listening on that hostname and forwarding connections to the actual hosts?
I am trying to achieve autoscaling (load balancer tracks liveness of hosts and spins up new ones on demand).
_______________________________________________ discuss mailing list [email protected] To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss
_______________________________________________ discuss mailing list [email protected] To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss
_______________________________________________ discuss mailing list [email protected] To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss