Hi, Pavan,

Here is the full output info. Thanks!

ubuntu@ip-10-237-132-179:~/mpitest/mpitutorial/tutorials/mpi-send-and-receive/code$ mpiexec -n 2 -f host_file -verbose ./send_recv

host: ec2-54-185-239-50.us-west-2.compute.amazonaws.com

host: ec2-54-196-213-218.compute-1.amazonaws.com

==================================================================================================

mpiexec options:

----------------

Base path: /usr/local/bin/

Launcher: (null)

Debug level: 1

Enable X: -1

Global environment:

-------------------

TERM=xterm

SHELL=/bin/bash

SSH_CLIENT=155.69.144.109 63331 22

SSH_TTY=/dev/pts/0

USER=ubuntu

LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lz=01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.axv=01;35:*.anx=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.axa=00;36:*.oga=00;36:*.spx=00;36:*.xspf=00;36:

MAIL=/var/mail/ubuntu

PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games

PWD=/home/ubuntu/mpitest/mpitutorial/tutorials/mpi-send-and-receive/code

LANG=en_US.UTF-8

SHLVL=1

HOME=/home/ubuntu

LOGNAME=ubuntu

SSH_CONNECTION=155.69.144.109 63331 10.237.132.179 22

LESSOPEN=| /usr/bin/lesspipe %s

LESSCLOSE=/usr/bin/lesspipe %s %s

OLDPWD=/home/ubuntu/mpitest

_=/usr/local/bin/mpiexec

Hydra internal environment:

---------------------------

GFORTRAN_UNBUFFERED_PRECONNECTED=y

Proxy information:

*********************

[1] proxy: ec2-54-185-239-50.us-west-2.compute.amazonaws.com (1 cores)

Exec list: ./send_recv (1 processes);

[2] proxy: ec2-54-196-213-218.compute-1.amazonaws.com (1 cores)

Exec list: ./send_recv (1 processes);

==================================================================================================

[mpiexec@ip-10-237-132-179] Timeout set to -1 (-1 means infinite)

[mpiexec@ip-10-237-132-179] Got a control port string of ec2-54-185-239-50.us-west-2.compute.amazonaws.com:38817

Proxy launch args: /usr/local/bin/hydra_pmi_proxy --control-port ec2-54-185-239-50.us-west-2.compute.amazonaws.com:38817 --debug --rmk user --launcher ssh --demux poll --pgid 0 --retries 10 --usize -2 --proxy-id

Arguments being passed to proxy 0:

--version 3.2 --iface-ip-env-name MPIR_CVAR_CH3_INTERFACE_HOSTNAME --hostname ec2-54-185-239-50.us-west-2.compute.amazonaws.com --global-core-map 0,1,2 --pmi-id-map 0,0 --global-process-count 2 --auto-cleanup 1 --pmi-kvsname kvs_1442_0 --pmi-process-mapping (vector,(0,2,1)) --ckpoint-num -1 --global-inherited-env 18 'TERM=xterm' 'SHELL=/bin/bash' 'SSH_CLIENT=155.69.144.109 63331 22' 'SSH_TTY=/dev/pts/0' 'USER=ubuntu' 'LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lz=01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.axv=01;35:*.anx=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.axa=00;36:*.oga=00;36:*.spx=00;36:*.xspf=00;36:' 'MAIL=/var/mail/ubuntu' 'PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games' 'PWD=/home/ubuntu/mpitest/mpitutorial/tutorials/mpi-send-and-receive/code' 'LANG=en_US.UTF-8' 'SHLVL=1' 'HOME=/home/ubuntu' 'LOGNAME=ubuntu' 'SSH_CONNECTION=155.69.144.109 63331 10.237.132.179 22' 'LESSOPEN=| /usr/bin/lesspipe %s' 'LESSCLOSE=/usr/bin/lesspipe %s %s' 'OLDPWD=/home/ubuntu/mpitest' '_=/usr/local/bin/mpiexec' --global-user-env 0 --global-system-env 1 'GFORTRAN_UNBUFFERED_PRECONNECTED=y' --proxy-core-count 1 --exec --exec-appnum 0 --exec-proc-count 1 --exec-local-env 0 --exec-wdir /home/ubuntu/mpitest/mpitutorial/tutorials/mpi-send-and-receive/code --exec-args 1 ./send_recv

Arguments being passed to proxy 1:

--version 3.2 --iface-ip-env-name MPIR_CVAR_CH3_INTERFACE_HOSTNAME --hostname ec2-54-196-213-218.compute-1.amazonaws.com --global-core-map 0,1,2 --pmi-id-map 0,1 --global-process-count 2 --auto-cleanup 1 --pmi-kvsname kvs_1442_0 --pmi-process-mapping (vector,(0,2,1)) --ckpoint-num -1 --global-inherited-env 18 'TERM=xterm' 'SHELL=/bin/bash' 'SSH_CLIENT=155.69.144.109 63331 22' 'SSH_TTY=/dev/pts/0' 'USER=ubuntu' 'LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lz=01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.axv=01;35:*.anx=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.axa=00;36:*.oga=00;36:*.spx=00;36:*.xspf=00;36:' 'MAIL=/var/mail/ubuntu' 'PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games' 'PWD=/home/ubuntu/mpitest/mpitutorial/tutorials/mpi-send-and-receive/code' 'LANG=en_US.UTF-8' 'SHLVL=1' 'HOME=/home/ubuntu' 'LOGNAME=ubuntu' 'SSH_CONNECTION=155.69.144.109 63331 10.237.132.179 22' 'LESSOPEN=| /usr/bin/lesspipe %s' 'LESSCLOSE=/usr/bin/lesspipe %s %s' 'OLDPWD=/home/ubuntu/mpitest' '_=/usr/local/bin/mpiexec' --global-user-env 0 --global-system-env 1 'GFORTRAN_UNBUFFERED_PRECONNECTED=y' --proxy-core-count 1 --exec --exec-appnum 0 --exec-proc-count 1 --exec-local-env 0 --exec-wdir /home/ubuntu/mpitest/mpitutorial/tutorials/mpi-send-and-receive/code --exec-args 1 ./send_recv

[mpiexec@ip-10-237-132-179] Launch arguments: /usr/local/bin/hydra_pmi_proxy --control-port ec2-54-185-239-50.us-west-2.compute.amazonaws.com:38817 --debug --rmk user --launcher ssh --demux poll --pgid 0 --retries 10 --usize -2 --proxy-id 0

[mpiexec@ip-10-237-132-179] Launch arguments: /usr/bin/ssh -x ec2-54-196-213-218.compute-1.amazonaws.com "/usr/local/bin/hydra_pmi_proxy" --control-port ec2-54-185-239-50.us-west-2.compute.amazonaws.com:38817 --debug --rmk user --launcher ssh --demux poll --pgid 0 --retries 10 --usize -2 --proxy-id 1

[proxy:0:0@ip-10-237-132-179] got pmi command (from 0): init

pmi_version=1 pmi_subversion=1

[proxy:0:0@ip-10-237-132-179] PMI response: cmd=response_to_init pmi_version=1 pmi_subversion=1 rc=0

[proxy:0:0@ip-10-237-132-179] got pmi command (from 0): get_maxes

[proxy:0:0@ip-10-237-132-179] PMI response: cmd=maxes kvsname_max=256 keylen_max=64 vallen_max=1024

[proxy:0:0@ip-10-237-132-179] got pmi command (from 0): get_appnum

[proxy:0:0@ip-10-237-132-179] PMI response: cmd=appnum appnum=0

[proxy:0:0@ip-10-237-132-179] got pmi command (from 0): get_my_kvsname

[proxy:0:0@ip-10-237-132-179] PMI response: cmd=my_kvsname kvsname=kvs_1442_0

[proxy:0:0@ip-10-237-132-179] got pmi command (from 0): get_my_kvsname

[proxy:0:0@ip-10-237-132-179] PMI response: cmd=my_kvsname kvsname=kvs_1442_0

[proxy:0:0@ip-10-237-132-179] got pmi command (from 0): get

kvsname=kvs_1442_0 key=PMI_process_mapping

[proxy:0:0@ip-10-237-132-179] PMI response: cmd=get_result rc=0 msg=success value=(vector,(0,2,1))

[proxy:0:0@ip-10-237-132-179] got pmi command (from 0): barrier_in

[proxy:0:0@ip-10-237-132-179] forwarding command (cmd=barrier_in) upstream

[mpiexec@ip-10-237-132-179] [pgid: 0] got PMI command: cmd=barrier_in

[proxy:0:1@ip-10-37-219-175] got pmi command (from 4): init

pmi_version=1 pmi_subversion=1

[proxy:0:1@ip-10-37-219-175] PMI response: cmd=response_to_init pmi_version=1 pmi_subversion=1 rc=0

[proxy:0:1@ip-10-37-219-175] got pmi command (from 4): get_maxes

[proxy:0:1@ip-10-37-219-175] PMI response: cmd=maxes kvsname_max=256 keylen_max=64 vallen_max=1024

[proxy:0:1@ip-10-37-219-175] got pmi command (from 4): get_appnum

[proxy:0:1@ip-10-37-219-175] PMI response: cmd=appnum appnum=0

[proxy:0:1@ip-10-37-219-175] got pmi command (from 4): get_my_kvsname

[proxy:0:1@ip-10-37-219-175] PMI response: cmd=my_kvsname kvsname=kvs_1442_0

[proxy:0:1@ip-10-37-219-175] got pmi command (from 4): get_my_kvsname

[proxy:0:1@ip-10-37-219-175] PMI response: cmd=my_kvsname kvsname=kvs_1442_0

[proxy:0:1@ip-10-37-219-175] got pmi command (from 4): get

kvsname=kvs_1442_0 key=PMI_process_mapping

[proxy:0:1@ip-10-37-219-175] PMI response: cmd=get_result rc=0 msg=success value=(vector,(0,2,1))

[proxy:0:1@ip-10-37-219-175] got pmi command (from 4): barrier_in

[mpiexec@ip-10-237-132-179] [pgid: 0] got PMI command: cmd=barrier_in

[mpiexec@ip-10-237-132-179] PMI response to fd 6 pid 4: cmd=barrier_out

[mpiexec@ip-10-237-132-179] PMI response to fd 7 pid 4: cmd=barrier_out

[proxy:0:0@ip-10-237-132-179] PMI response: cmd=barrier_out

[proxy:0:0@ip-10-237-132-179] got pmi command (from 0): put

kvsname=kvs_1442_0 key=P0-businesscard value=description#ec2-54-185-239-50.us-west-2.compute.amazonaws.com$port#34711$ifname#10.237.132.179$

[proxy:0:0@ip-10-237-132-179] cached command: P0-businesscard=description#ec2-54-185-239-50.us-west-2.compute.amazonaws.com$port#34711$ifname#10.237.132.179$

[proxy:0:0@ip-10-237-132-179] PMI response: cmd=put_result rc=0 msg=success

[proxy:0:0@ip-10-237-132-179] got pmi command (from 0): barrier_in

[proxy:0:0@ip-10-237-132-179] flushing 1 put command(s) out

[proxy:0:0@ip-10-237-132-179] forwarding command (cmd=put P0-businesscard=description#ec2-54-185-239-50.us-west-2.compute.amazonaws.com$port#34711$ifname#10.237.132.179$) upstream

[proxy:0:0@ip-10-237-132-179] forwarding command (cmd=barrier_in) upstream

[mpiexec@ip-10-237-132-179] [pgid: 0] got PMI command: cmd=put P0-businesscard=description#ec2-54-185-239-50.us-west-2.compute.amazonaws.com$port#34711$ifname#10.237.132.179$

[mpiexec@ip-10-237-132-179] [pgid: 0] got PMI command: cmd=barrier_in

[proxy:0:1@ip-10-37-219-175] forwarding command (cmd=barrier_in) upstream

[proxy:0:1@ip-10-37-219-175] PMI response: cmd=barrier_out

[proxy:0:1@ip-10-37-219-175] got pmi command (from 4): put

kvsname=kvs_1442_0 key=P1-businesscard value=description#ec2-54-196-213-218.compute-1.amazonaws.com$port#50148$ifname#10.37.219.175$

[proxy:0:1@ip-10-37-219-175] cached command: P1-businesscard=description#ec2-54-196-213-218.compute-1.amazonaws.com$port#50148$ifname#10.37.219.175$

[proxy:0:1@ip-10-37-219-175] PMI response: cmd=put_result rc=0 msg=success

[proxy:0:1@ip-10-37-219-175] got pmi command (from 4): barrier_in

[proxy:0:1@ip-10-37-219-175] flushing 1 put command(s) out

[proxy:0:1@ip-10-37-219-175] forwarding command (cmd=put P1-businesscard=description#ec2-54-196-213-218.compute-1.amazonaws.com$port#50148$ifname#10.37.219.175$) upstream

[proxy:0:1@ip-10-37-219-175] forwarding command (cmd=barrier_in) upstream

[mpiexec@ip-10-237-132-179] [pgid: 0] got PMI command: cmd=put P1-businesscard=description#ec2-54-196-213-218.compute-1.amazonaws.com$port#50148$ifname#10.37.219.175$

[mpiexec@ip-10-237-132-179] [pgid: 0] got PMI command: cmd=barrier_in

[mpiexec@ip-10-237-132-179] PMI response to fd 6 pid 4: cmd=keyval_cache P0-businesscard=description#ec2-54-185-239-50.us-west-2.compute.amazonaws.com$port#34711$ifname#10.237.132.179$ P1-businesscard=description#ec2-54-196-213-218.compute-1.amazonaws.com$port#50148$ifname#10.37.219.175$

[mpiexec@ip-10-237-132-179] PMI response to fd 7 pid 4: cmd=keyval_cache P0-businesscard=description#ec2-54-185-239-50.us-west-2.compute.amazonaws.com$port#34711$ifname#10.237.132.179$ P1-businesscard=description#ec2-54-196-213-218.compute-1.amazonaws.com$port#50148$ifname#10.37.219.175$

[mpiexec@ip-10-237-132-179] PMI response to fd 6 pid 4: cmd=barrier_out

[mpiexec@ip-10-237-132-179] PMI response to fd 7 pid 4: cmd=barrier_out

[proxy:0:0@ip-10-237-132-179] PMI response: cmd=barrier_out

[proxy:0:0@ip-10-237-132-179] got pmi command (from 0): get

kvsname=kvs_1442_0 key=P1-businesscard

[proxy:0:0@ip-10-237-132-179] PMI response: cmd=get_result rc=0 msg=success value=description#ec2-54-196-213-218.compute-1.amazonaws.com$port#50148$ifname#10.37.219.175$

[proxy:0:1@ip-10-37-219-175] PMI response: cmd=barrier_out

[proxy:0:0@ip-10-237-132-179] got pmi command (from 0): abort

exitcode=1174117

[proxy:0:0@ip-10-237-132-179] we don't understand this command abort; forwarding upstream

[mpiexec@ip-10-237-132-179] [pgid: 0] got PMI command: cmd=abort exitcode=1174117

Fatal error in MPI_Send: Unknown error class, error stack:

MPI_Send(174)..............: MPI_Send(buf=0x7fffc219b73c, count=1, MPI_INT, dest=1, tag=0, MPI_COMM_WORLD) failed

MPID_nem_tcp_connpoll(1835): Communication error with rank 1: Connection timed out

On Wed, Mar 16, 2016 at 11:08 AM, Balaji, Pavan <balaji@anl.gov> wrote:

Amelie,

Can you run your mpiexec command with the -verbose option and paste the output here?

% mpiexec -n 2 -f host_file -verbose ./send_recv_test

-- Pavan

> On Mar 15, 2016, at 10:01 PM, amelie chi zhou <amelie.czhou@gmail.com> wrote:
>
> Hi, Ken,
>
> I tried with netcat and the connection is successfully established.
>
> On one side of the machines, I ran:
> ubuntu@ip-10-235-37-156:~$ netcat -l 10000
>
> On the other side:
> ubuntu@ip-10-169-125-85:~/mpitest$ netcat -v ec2-54-188-xx-xx.us-west-2.compute.amazonaws.com 10000
> Connection to ec2-54-188-xx-xx.us-west-2.compute.amazonaws.com 10000 port [tcp/webmin] succeeded!
>
> On Wed, Mar 16, 2016 at 12:11 AM, Kenneth Raffenetti <raffenet@mcs.anl.gov> wrote:
> I suspect that there is still a firewall in the way given that the EC2 instances are in different regions. One way to test your security group rules without MPI would be to try to establish a connection between the 2 machines on a high TCP port (e.g. 10000) with a simple utility like netcat (https://en.wikipedia.org/wiki/Netcat).
>
> Ken
>
>
> On 03/15/2016 10:38 AM, amelie chi zhou wrote:
> Hi, Ken,
>
> Thanks for the reply.
> What kind of problem are you referring to?
> In the rules of the security groups, I allow tcp connections from all ip addresses for all ports. Also, the two machines can ssh and scp to each other with no problem. In this simple test, security is not my major concern.
>
> Regards,
> Amelie
> On 15 Mar 2016, at 10:23 PM, Kenneth Raffenetti <raffenet@mcs.anl.gov> wrote:
>
> The different regions are a problem in this setup. Note that security groups in EC2 are *per region*.
>
> https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/using-network-security.html#default-security-group
>
> I'll note that using MPI across the internet like this is a bad idea if you have concerns about security.
>
> Ken
>
> On 03/15/2016 06:16 AM, amelie chi zhou wrote:
> Hi,
>
> I configured two virtual machines on Amazon EC2 to run mpich-3.2. The
> system is Ubuntu 12.04.2 LTS.
>
> The two virtual machines can ssh to each other successfully
> (passwordless) and I can run a simple hello world program using the two
> machines.
>
> ubuntu@ip-10-169-125-85:~$ mpiexec -n 2 -f host_file ./hello_world
> Hello world from processor ip-10-169-125-85, rank 1 out of 2 processors
> Hello world from processor ip-10-235-37-156, rank 0 out of 2 processors
>
> Then I run a simple program with MPI_Send and MPI_Receive to communicate
> between the two vms. Following are the core code of the program.
>
> if (world_rank == 0) {
> // If we are rank 0, set the number to -1 and send it to process 1
> number = -1;
> MPI_Send(&number, 1, MPI_INT, 1, 0, MPI_COMM_WORLD);
> } else if (world_rank == 1) {
> MPI_Recv(&number, 1, MPI_INT, 0, 0, MPI_COMM_WORLD, MPI_STATUS_IGNORE);
> printf("Process 1 received number %d from process 0\n", number);
> }
>
>
> Following are the error msg I encountered.
>
> ubuntu@ip-10-169-125-85:~$ mpiexec -n 2 -f host_file ./send_recv
> Fatal error in MPI_Send: Unknown error class, error stack:
> MPI_Send(174)..............: MPI_Send(buf=0x7fff49f2759c, count=1,
> MPI_INT, dest=1, tag=0, MPI_COMM_WORLD) failed
> MPID_nem_tcp_connpoll(1835): Communication error with rank 1: Connection
> timed out
>
>
> I googled similar errors and have made sure that: 1) there is no rule in
> my firewall setting, 2) there is a tcp port listening on both sides when
> the send_recv program runs. I cannot think of any other possible way to
> fix this problem. BTW, the two virtual machines are on two different
> regions of Amazon EC2 and are not in VPCs. Please help. Thanks!
>
> Regards,
> Amelie
>
>
> _______________________________________________
> discuss mailing list discuss@mpich.org
> To manage subscription options or unsubscribe:
> https://lists.mpich.org/mailman/listinfo/discuss
> _______________________________________________
> discuss mailing list discuss@mpich.org
> To manage subscription options or unsubscribe:
> https://lists.mpich.org/mailman/listinfo/discuss
> _______________________________________________
> discuss mailing list discuss@mpich.org
> To manage subscription options or unsubscribe:
> https://lists.mpich.org/mailman/listinfo/discuss
>
> _______________________________________________
> discuss mailing list discuss@mpich.org
> To manage subscription options or unsubscribe:
> https://lists.mpich.org/mailman/listinfo/discuss
>
> _______________________________________________
> discuss mailing list discuss@mpich.org
> To manage subscription options or unsubscribe:
> https://lists.mpich.org/mailman/listinfo/discuss

_______________________________________________
discuss mailing list discuss@mpich.org
To manage subscription options or unsubscribe:
https://lists.mpich.org/mailman/listinfo/discuss