December 2015 - discuss - mailman3.cels.anl.gov

Creating an MPI job using MPI_Comm_connect/accept
by Mohammad Javad Rashti 29 Dec '15

29 Dec '15

Hi, Using mpich-3.1.2, we are trying to create a multi-process multi-node MPI job with the client-server model but we are having issues creating the global communicator we need. We cannot use mpiexec to launch the MPI processes; they are launched by a different daemon and we want them to join a group and use MPI after they are launched. We chose to use a server to publish a name/port and wait on a known number of clients to connect. The goal is to create an intracommunicator among all the clients and the server, and start normal MPI communication (not sure whether there is a better way to accomplish this goal?). *The problem *is that the first client connects fine, but the subsequent clients block. The *simplified method *that we are using is here: * ------------------- Server -----------------* - Call *MPI_Open_port(MPI_INFO_NULL, port_name)* - Call *MPI_Publish_name(service_name, MPI_INFO_NULL, port_name)* - clients = 0 Loop until clients = MAX_CLIENTS: if ( !clients ) - Call *MPI_Comm_accept(port_name,MPI_INFO_NULL,0,MPI_COMM_FELF,&new_ircomm)* else - Call *MPI_Comm_accept(port_name,MPI_INFO_NULL,0,previous_iacomm,&new_ircomm)* - Call *MPI_Intercomm_merge(new_ircomm, 0, &new_iacomm)* - previous_iacomm = new_iacomm - clients ++ end Loop *---------------- Client ---------------* - Call *MPI_Lookup_name(service_name, MPI_INFO_NULL, port_name)* - Call *MPI_Comm_connect(port_name, MPI_INFO_NULL, 0, MPI_COMM_SELF, &new_ircomm)* - Call *MPI_Intercomm_merge(new_ircomm, 1 , &new_iacomm)* - previous_iacomm *= *new_iacomm Loop for all clients connecting after me: - Call *MPI_Comm_accept(port_name,MPI_INFO_NULL,0,previous_iacomm,&new_ircomm)* - Call *MPI_Intercomm_merge(new_ircomm, 0, &new_iacomm)* - previous_iacomm = new_iacomm end Loop ---------------------------------- *Note *that MPI report states that MPI_Comm_accept is collective over the calling communicator, that's why we are calling it by the server and all previously connected clients. *The problem we are having *is that the first client connects fine, but the subsequent clients block on MPI_Comm_connect. Also the server and previously connected clients block on MPI_Comm_accept. (the server does not block only if we use MPI_COMM_SELF for all accept calls, but that does not help us creating the global intracomm that we want. I suspect that we are missing something in our usage of MPI_Comm_accept. Any insight is helpful and appreciated. I can send the actual C code if needed. Thanks Mohammad _______________________________________________ discuss mailing list discuss(a)mpich.org To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss

1 0

Re: [mpich-discuss] mpich-3.2 34
by Professor W P Jones 27 Dec '15

27 Dec '15

Hi Pavan Here are all the existing log files. Regards Bill Professor W P Jones Department of Mechanical Engineering Imperial College London Exhibition Road London SW7 2AZ Tel: +44 (0)20 7594 7037/7033 Mobile +44 (0)776 495 9702 Fax: +44 (0)20 7594 5702 E-mail: w.jones(a)imperial.ac.uk web site: http://www.imperial.ac.uk/me On 28/12/15 00:40, Balaji, Pavan wrote: > Could you send us the log files listed in the README? > > http://git.mpich.org/mpich.git/blob/HEAD:/README.vin#l235 > > -- Pavan > >> On Dec 27, 2015, at 5:34 AM, Professor W P Jones <w.jones(a)imperial.ac.uk> wrote: >> >> Hi >> >> I am trying to build MPICH-3.2 34 using Lahey/Fujitsu Linux64 Fortran Express Release L8.10b and I obtain the following error: >> >> checking for Fortran 90 module output directory flag... >> configure: error: FCMODOUTFLAG could not be determined but is critical for the current Fortran build system >> >> Please can you advise how this can be fixed? >> >> Many thanks >> Bill Jones >> >> -- >> Professor W P Jones >> Department of Mechanical Engineering >> Imperial College London >> Exhibition Road >> London SW7 2AZ >> Tel: +44 (0)20 7594 7037/7033 >> Mobile +44 (0)776 495 9702 >> Fax: +44 (0)20 7594 5702 >> E-mail: w.jones(a)imperial.ac.uk >> web site: http://www.imperial.ac.uk/me >> >> _______________________________________________ >> discuss mailing list discuss(a)mpich.org >> To manage subscription options or unsubscribe: >> https://lists.mpich.org/mailman/listinfo/discuss > _______________________________________________ > discuss mailing list discuss(a)mpich.org > To manage subscription options or unsubscribe: > https://lists.mpich.org/mailman/listinfo/discuss _______________________________________________ discuss mailing list discuss(a)mpich.org To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss

1 0

Re: [mpich-discuss] mpich-3.2 34
by Balaji, Pavan 27 Dec '15

27 Dec '15

Could you send us the log files listed in the README? http://git.mpich.org/mpich.git/blob/HEAD:/README.vin#l235 -- Pavan > On Dec 27, 2015, at 5:34 AM, Professor W P Jones <w.jones(a)imperial.ac.uk> wrote: > > Hi > > I am trying to build MPICH-3.2 34 using Lahey/Fujitsu Linux64 Fortran Express Release L8.10b and I obtain the following error: > > checking for Fortran 90 module output directory flag... > configure: error: FCMODOUTFLAG could not be determined but is critical for the current Fortran build system > > Please can you advise how this can be fixed? > > Many thanks > Bill Jones > > -- > Professor W P Jones > Department of Mechanical Engineering > Imperial College London > Exhibition Road > London SW7 2AZ > Tel: +44 (0)20 7594 7037/7033 > Mobile +44 (0)776 495 9702 > Fax: +44 (0)20 7594 5702 > E-mail: w.jones(a)imperial.ac.uk > web site: http://www.imperial.ac.uk/me > > _______________________________________________ > discuss mailing list discuss(a)mpich.org > To manage subscription options or unsubscribe: > https://lists.mpich.org/mailman/listinfo/discuss _______________________________________________ discuss mailing list discuss(a)mpich.org To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss

1 0

mpich-3.2 34
by Professor W P Jones 27 Dec '15

27 Dec '15

Hi I am trying to build MPICH-3.2 34 using Lahey/Fujitsu Linux64 Fortran Express Release L8.10b and I obtain the following error: checking for Fortran 90 module output directory flag... configure: error: FCMODOUTFLAG could not be determined but is critical for the current Fortran build system Please can you advise how this can be fixed? Many thanks Bill Jones -- Professor W P Jones Department of Mechanical Engineering Imperial College London Exhibition Road London SW7 2AZ Tel: +44 (0)20 7594 7037/7033 Mobile +44 (0)776 495 9702 Fax: +44 (0)20 7594 5702 E-mail: w.jones(a)imperial.ac.uk web site: http://www.imperial.ac.uk/me _______________________________________________ discuss mailing list discuss(a)mpich.org To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss

1 0

Re: [mpich-discuss] mpich-3.2 installing problem
by Balaji, Pavan 17 Dec '15

17 Dec '15

Hmm. I don't think you actually installed GCC. You simply untarred it. > On Dec 16, 2015, at 8:01 PM, karl wong <aa8631990(a)gmail.com> wrote: > > GCC installing procedure: > 1.sudo tar xvf gcc-5.2-bin.tar -C / > 2.echo $SHELL > 3.echo 'export PATH=/usr/local/bin:$PATH' >> ~/.bash_profile > MPICH-3.2 installing procedure: > 1. tar xzf mpich-3.2.tar.gz > 2. cd mpich-3.2 > 3. ./configure --prefix=/Users/<USERNAME>/mpich-install 2>&1 | tee c.txt > 4. make 2>&1 | tee m.txt > and then I met the problem . > > 2015-12-17 7:02 GMT+08:00 Eric A. Borisch <eborisch(a)gmail.com>: > With MacPorts, for example: > > sudo port install mpich-gcc5 > > should get you up and running. Be sure to read the notes it spits out > at the end of installation for usage. Most of the requirements will be > pulled down in compiled form provided you've used the default prefix > (/opt/local) for macports. > > - Eric > > On Wed, Dec 16, 2015 at 3:27 PM, Kenneth Raffenetti > <raffenet(a)mcs.anl.gov> wrote: > > We should also note that package managers like MacPorts and Homebrew have > > MPICH 3.2 available in their repos now. > > > > On 12/16/2015 02:13 PM, Seo, Sangmin wrote: > >> > >> I think it’s a compiler installation problem. How did you install GCC > >> 5.2? Can you try to uninstall and reinstall GCC and then build mpich-3.2 > >> again? > >> > >> Regards, > >> Sangmin > >> > >> > >>> On Dec 15, 2015, at 8:24 PM, karl wong <aa8631990(a)gmail.com > >>> <mailto:[email protected]>> wrote: > >>> > >>> Dear team, > >>> > >>> When installing mpich-3.2 with gcc on iMac X EI Capitan, I met the > >>> following problem: > >>> > >>> make[2]: *** [src/mpltrmem.lo] Error 1 > >>> make[1]: *** [all-recursive] Error 1 > >>> make: *** [all] Error 2 > >>> > >>> Attachment is the file you may need. For this file: > >>> mpich-3.2/src/pm/hydra/tools/topo/hwloc/hwloc/config.log, I cannot > >>> find it. > >>> <Archive.zip>_______________________________________________ > >>> discuss mailing list discuss(a)mpich.org <mailto:[email protected]> > >>> To manage subscription options or unsubscribe: > >>> https://lists.mpich.org/mailman/listinfo/discuss > >> > >> > >> > >> > >> _______________________________________________ > >> discuss mailing list discuss(a)mpich.org > >> To manage subscription options or unsubscribe: > >> https://lists.mpich.org/mailman/listinfo/discuss > >> > > _______________________________________________ > > discuss mailing list discuss(a)mpich.org > > To manage subscription options or unsubscribe: > > https://lists.mpich.org/mailman/listinfo/discuss > _______________________________________________ > discuss mailing list discuss(a)mpich.org > To manage subscription options or unsubscribe: > https://lists.mpich.org/mailman/listinfo/discuss > > _______________________________________________ > discuss mailing list discuss(a)mpich.org > To manage subscription options or unsubscribe: > https://lists.mpich.org/mailman/listinfo/discuss _______________________________________________ discuss mailing list discuss(a)mpich.org To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss

1 0

Re: [mpich-discuss] mpich-3.2 installing problem
by Guo, Yanfei 17 Dec '15

17 Dec '15

I think the problem is with the GCC you have installed. I have tried using the GCC in homebrew and I could not reproduce the problem. I would suggest installing GCC using homebrew or macports on OS X. Yanfei Guo Postdoctoral Researcher MCS Division, ANL On 12/16/15, 8:01 PM, "karl wong" <aa8631990(a)gmail.com> wrote: >GCC installing procedure:1.sudo > tar xvf gcc-5.2-bin.tar > -C / >2.echo $SHELL >3.echo 'export > PATH=/usr/local/bin:$PATH' >> > ~/.bash_profile >MPICH-3.2 > installing procedure: >1. tar xzf mpich-3.2.tar.gz >2. cd mpich-3.2 >3. ./configure --prefix=/Users/<USERNAME>/mpich-install 2>&1 | tee c.txt >4. make 2>&1 | tee m.txt >and then I met the problem . > > > >2015-12-17 7:02 GMT+08:00 Eric A. Borisch ><eborisch(a)gmail.com>: > >With MacPorts, for example: > >sudo port install mpich-gcc5 > >should get you up and running. Be sure to read the notes it spits out >at the end of installation for usage. Most of the requirements will be >pulled down in compiled form provided you've used the default prefix >(/opt/local) for macports. > > - Eric > >On Wed, Dec 16, 2015 at 3:27 PM, Kenneth Raffenetti ><raffenet(a)mcs.anl.gov> wrote: >> We should also note that package managers like MacPorts and Homebrew have >> MPICH 3.2 available in their repos now. >> >> On 12/16/2015 02:13 PM, Seo, Sangmin wrote: >>> >>> I think it’s a compiler installation problem. How did you install GCC >>> 5.2? Can you try to uninstall and reinstall GCC and then build mpich-3.2 >>> again? >>> >>> Regards, >>> Sangmin >>> >>> >>>> On Dec 15, 2015, at 8:24 PM, karl wong <aa8631990(a)gmail.com >>>> <mailto:[email protected]>> wrote: >>>> >>>> Dear team, >>>> >>>> When installing mpich-3.2 with gcc on iMac X EI Capitan, I met the >>>> following problem: >>>> >>>> make[2]: *** [src/mpltrmem.lo] Error 1 >>>> make[1]: *** [all-recursive] Error 1 >>>> make: *** [all] Error 2 >>>> >>>> Attachment is the file you may need. For this file: >>>> mpich-3.2/src/pm/hydra/tools/topo/hwloc/hwloc/config.log, I cannot >>>> find it. >>>> <Archive.zip>_______________________________________________ >>>> discuss mailing list discuss(a)mpich.org <mailto:[email protected]> >>>> To manage subscription options or unsubscribe: >>>> >https://lists.mpich.org/mailman/listinfo/discuss <https://lists.mpich.org/mailman/listinfo/discuss> >>> >>> >>> >>> >>> _______________________________________________ >>> discuss mailing list discuss(a)mpich.org >>> To manage subscription options or unsubscribe: >>> >https://lists.mpich.org/mailman/listinfo/discuss <https://lists.mpich.org/mailman/listinfo/discuss> >>> >> _______________________________________________ >> discuss mailing list discuss(a)mpich.org >> To manage subscription options or unsubscribe: >> >https://lists.mpich.org/mailman/listinfo/discuss <https://lists.mpich.org/mailman/listinfo/discuss> >_______________________________________________ >discuss mailing list discuss(a)mpich.org >To manage subscription options or unsubscribe: >https://lists.mpich.org/mailman/listinfo/discuss > > > > > > _______________________________________________ discuss mailing list discuss(a)mpich.org To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss

1 0

Re: [mpich-discuss] mpich-3.2 installing problem
by karl wong 16 Dec '15

16 Dec '15

GCC installing procedure: 1.sudo tar xvf gcc-5.2-bin.tar -C / 2.echo $SHELL 3.echo 'export PATH=/usr/local/bin:$PATH' >> ~/.bash_profile MPICH-3.2 installing procedure: 1. tar xzf mpich-3.2.tar.gz 2. cd mpich-3.2 3. ./configure --prefix=/Users/<USERNAME>/mpich-install 2>&1 | tee c.txt 4. make 2>&1 | tee m.txt and then I met the problem . 2015-12-17 7:02 GMT+08:00 Eric A. Borisch <eborisch(a)gmail.com>: > With MacPorts, for example: > > sudo port install mpich-gcc5 > > should get you up and running. Be sure to read the notes it spits out > at the end of installation for usage. Most of the requirements will be > pulled down in compiled form provided you've used the default prefix > (/opt/local) for macports. > > - Eric > > On Wed, Dec 16, 2015 at 3:27 PM, Kenneth Raffenetti > <raffenet(a)mcs.anl.gov> wrote: > > We should also note that package managers like MacPorts and Homebrew have > > MPICH 3.2 available in their repos now. > > > > On 12/16/2015 02:13 PM, Seo, Sangmin wrote: > >> > >> I think it’s a compiler installation problem. How did you install GCC > >> 5.2? Can you try to uninstall and reinstall GCC and then build mpich-3.2 > >> again? > >> > >> Regards, > >> Sangmin > >> > >> > >>> On Dec 15, 2015, at 8:24 PM, karl wong <aa8631990(a)gmail.com > >>> <mailto:[email protected]>> wrote: > >>> > >>> Dear team, > >>> > >>> When installing mpich-3.2 with gcc on iMac X EI Capitan, I met the > >>> following problem: > >>> > >>> make[2]: *** [src/mpltrmem.lo] Error 1 > >>> make[1]: *** [all-recursive] Error 1 > >>> make: *** [all] Error 2 > >>> > >>> Attachment is the file you may need. For this file: > >>> mpich-3.2/src/pm/hydra/tools/topo/hwloc/hwloc/config.log, I cannot > >>> find it. > >>> <Archive.zip>_______________________________________________ > >>> discuss mailing list discuss(a)mpich.org <mailto:[email protected]> > >>> To manage subscription options or unsubscribe: > >>> https://lists.mpich.org/mailman/listinfo/discuss > >> > >> > >> > >> > >> _______________________________________________ > >> discuss mailing list discuss(a)mpich.org > >> To manage subscription options or unsubscribe: > >> https://lists.mpich.org/mailman/listinfo/discuss > >> > > _______________________________________________ > > discuss mailing list discuss(a)mpich.org > > To manage subscription options or unsubscribe: > > https://lists.mpich.org/mailman/listinfo/discuss > _______________________________________________ > discuss mailing list discuss(a)mpich.org > To manage subscription options or unsubscribe: > https://lists.mpich.org/mailman/listinfo/discuss > _______________________________________________ discuss mailing list discuss(a)mpich.org To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss

1 0

Re: [mpich-discuss] mpich-3.2 installing problem
by Eric A. Borisch 16 Dec '15

16 Dec '15

With MacPorts, for example: sudo port install mpich-gcc5 should get you up and running. Be sure to read the notes it spits out at the end of installation for usage. Most of the requirements will be pulled down in compiled form provided you've used the default prefix (/opt/local) for macports. - Eric On Wed, Dec 16, 2015 at 3:27 PM, Kenneth Raffenetti <raffenet(a)mcs.anl.gov> wrote: > We should also note that package managers like MacPorts and Homebrew have > MPICH 3.2 available in their repos now. > > On 12/16/2015 02:13 PM, Seo, Sangmin wrote: >> >> I think it’s a compiler installation problem. How did you install GCC >> 5.2? Can you try to uninstall and reinstall GCC and then build mpich-3.2 >> again? >> >> Regards, >> Sangmin >> >> >>> On Dec 15, 2015, at 8:24 PM, karl wong <aa8631990(a)gmail.com >>> <mailto:[email protected]>> wrote: >>> >>> Dear team, >>> >>> When installing mpich-3.2 with gcc on iMac X EI Capitan, I met the >>> following problem: >>> >>> make[2]: *** [src/mpltrmem.lo] Error 1 >>> make[1]: *** [all-recursive] Error 1 >>> make: *** [all] Error 2 >>> >>> Attachment is the file you may need. For this file: >>> mpich-3.2/src/pm/hydra/tools/topo/hwloc/hwloc/config.log, I cannot >>> find it. >>> <Archive.zip>_______________________________________________ >>> discuss mailing list discuss(a)mpich.org <mailto:[email protected]> >>> To manage subscription options or unsubscribe: >>> https://lists.mpich.org/mailman/listinfo/discuss >> >> >> >> >> _______________________________________________ >> discuss mailing list discuss(a)mpich.org >> To manage subscription options or unsubscribe: >> https://lists.mpich.org/mailman/listinfo/discuss >> > _______________________________________________ > discuss mailing list discuss(a)mpich.org > To manage subscription options or unsubscribe: > https://lists.mpich.org/mailman/listinfo/discuss _______________________________________________ discuss mailing list discuss(a)mpich.org To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss

1 0

Re: [mpich-discuss] mpich-3.2 installing problem
by Kenneth Raffenetti 16 Dec '15

16 Dec '15

We should also note that package managers like MacPorts and Homebrew have MPICH 3.2 available in their repos now. On 12/16/2015 02:13 PM, Seo, Sangmin wrote: > I think it’s a compiler installation problem. How did you install GCC > 5.2? Can you try to uninstall and reinstall GCC and then build mpich-3.2 > again? > > Regards, > Sangmin > > >> On Dec 15, 2015, at 8:24 PM, karl wong <aa8631990(a)gmail.com >> <mailto:[email protected]>> wrote: >> >> Dear team, >> >> When installing mpich-3.2 with gcc on iMac X EI Capitan, I met the >> following problem: >> >> make[2]: *** [src/mpltrmem.lo] Error 1 >> make[1]: *** [all-recursive] Error 1 >> make: *** [all] Error 2 >> >> Attachment is the file you may need. For this file: >> mpich-3.2/src/pm/hydra/tools/topo/hwloc/hwloc/config.log, I cannot >> find it. >> <Archive.zip>_______________________________________________ >> discuss mailing list discuss(a)mpich.org <mailto:[email protected]> >> To manage subscription options or unsubscribe: >> https://lists.mpich.org/mailman/listinfo/discuss > > > > _______________________________________________ > discuss mailing list discuss(a)mpich.org > To manage subscription options or unsubscribe: > https://lists.mpich.org/mailman/listinfo/discuss > _______________________________________________ discuss mailing list discuss(a)mpich.org To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss

1 0

Re: [mpich-discuss] mpich-3.2 installing problem
by Seo, Sangmin 16 Dec '15

16 Dec '15

I think it’s a compiler installation problem. How did you install GCC 5.2? Can you try to uninstall and reinstall GCC and then build mpich-3.2 again? Regards, Sangmin On Dec 15, 2015, at 8:24 PM, karl wong <aa8631990(a)gmail.com<mailto:[email protected]>> wrote: Dear team, When installing mpich-3.2 with gcc on iMac X EI Capitan, I met the following problem: make[2]: *** [src/mpltrmem.lo] Error 1 make[1]: *** [all-recursive] Error 1 make: *** [all] Error 2 Attachment is the file you may need. For this file: mpich-3.2/src/pm/hydra/tools/topo/hwloc/hwloc/config.log, I cannot find it. <Archive.zip>_______________________________________________ discuss mailing list discuss(a)mpich.org<mailto:[email protected]> To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss _______________________________________________ discuss mailing list discuss(a)mpich.org To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss

1 0