June 2016 - discuss - mailman3.cels.anl.gov

Re: [mpich-discuss] Any past mpich version work with RHEL/CentOS7 verbs?
by Jonathan Perkins 05 Jun '16

05 Jun '16

Hello. MXM is not required if you're using MVAPICH2. MVAPICH2 will work well with the ibverbs distributed by RHEL/CENTOS. On Sun, Jun 5, 2016, 12:27 PM Galloway, Michael D. <gallowaymd(a)ornl.gov> wrote: > All, > > > Our cluster has centos7.2 libibverbs installed, we'd like to build an > mpich that will work with it if possible, I understand current versions of > mpich/mvapich have a requirement of OFED+MXM. We plan to deploy OFED and > MXM later this summer but we are wondering if there is any way to get mpich > working now with our environment. > > > --- michael > > > _______________________________________________ > discuss mailing list discuss(a)mpich.org > To manage subscription options or unsubscribe: > https://lists.mpich.org/mailman/listinfo/discuss _______________________________________________ discuss mailing list discuss(a)mpich.org To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss

1 0

Any past mpich version work with RHEL/CentOS7 verbs?
by Galloway, Michael D. 05 Jun '16

05 Jun '16

?All, Our cluster has centos7.2 libibverbs installed, we'd like to build an mpich that will work with it if possible, I understand current versions of mpich/mvapich have a requirement of OFED+MXM. We plan to deploy OFED and MXM later this summer but we are wondering if there is any way to get mpich working now with our environment. --- michael _______________________________________________ discuss mailing list discuss(a)mpich.org To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss

1 0

Re: [mpich-discuss] stdin redirection
by Seo, Sangmin 05 Jun '16

05 Jun '16

Hello Salvatore, The current MPICH uses pipe to redirect stdin to processes, but pipe has a limited capacity (e.g., 64KB in Linux. Please refer to http://man7.org/linux/man-pages/man7/pipe.7.html). Therefore, if we redirect a file, which is larger than the pipe capacity, to stdin, the current MPICH implementation is not handling it properly because write() does not succeed to write a large data (> the pipe capacity) to the pipe for stdin. I created a ticket for this issue (https://trac.mpich.org/projects/mpich/ticket/2336) but I'd recommend you to use file I/O in order to handle a large file instead of using stdin redirection. — Sangmin > On Jun 1, 2016, at 4:37 AM, Filippone, Salvatore <Salvatore.Filippone(a)cranfield.ac.uk> wrote: > > Hello, > I have found something I do not understand with mpich 3.2.0. The > problem started with an application, but to demonstrate it I have > written a very simple-minded program which I am including here. > The program simply reads lines from standard input and reprints them > on standard output from a second process. > > Now if I redirect stdin from a small(ish) file it works as expected: > ====================================================================== > [sfilippo@localhost MPI_cat]$ mpicc -v > mpicc for MPICH version 3.2 > Using built-in specs. > COLLECT_GCC=gcc > COLLECT_LTO_WRAPPER=/opt/gnu/5.3.0/libexec/gcc/x86_64-unknown-linux- > gnu/5.3.0/lto-wrapper > Target: x86_64-unknown-linux-gnu > Configured with: ../gcc-5.3.0/configure --prefix=/opt/gnu/5.3.0 -- > enable-languages=c,c++,fortran --with- > gmp=/usr/local/travel/GCC/BUILDS/gmp --with- > mpfr=/usr/local/travel/GCC/BUILDS/mpfr --with- > mpc=/usr/local/travel/GCC/BUILDS/mpc --with- > isl=/usr/local/travel/GCC/BUILDS/isl > Thread model: posix > gcc version 5.3.0 (GCC) > [sfilippo@localhost MPI_cat]$ mpicc -o mpicat mpicat.c > [sfilippo@localhost MPI_cat]$ head mpicat.c | mpirun -np 2 ./mpicat > #include <stdlib.h> > #include <stdio.h> > #include "mpi.h" > #define LNSZ 129 > #define TAGI 234 > #define TAGC 567 > int main(int argc, char *argv[] ) > { > char linebuf[LNSZ]; > int ierr, iam, np, itmp ; > [sfilippo@localhost MPI_cat]$ > ====================================================================== > However if I use a long(ish) file (such as a configure script) I get > either no output or an error. On another machine with GNU 4.9.3 I > always get the silent failure. > ====================================================================== > [sfilippo@localhost MPI_cat]$ mpirun -np 2 ./mpicat < configure > [sfilippo@localhost MPI_cat]$ mpirun -np 2 ./mpicat < configure > [proxy:0:[email protected]] HYD_pmcd_pmip_control_cmd_cb > (../../../../mpich-3.2/src/pm/hydra/pm/pmiserv/pmip_cb.c:937): process > reading stdin too slowly; can't keep up > [proxy:0:[email protected]] HYDT_dmxu_poll_wait_for_event > (../../../../mpich-3.2/src/pm/hydra/tools/demux/demux_poll.c:76): > callback returned error status > [proxy:0:[email protected]] main (../../../../mpich- > 3.2/src/pm/hydra/pm/pmiserv/pmip.c:206): demux engine error waiting for > event > [sfilippo@localhost MPI_cat]$ > ======================================================================= > > Am I missing something? > Is this supposed to work? I could find nothing relevant in the FAQ > > Thanks a lot > Salvatore > -- > Salvatore Filippone, PhD > Centre for Computational Engineering Sciences, > School of Aerospace, Transport and Manufacturing, Bldg 52 > Cranfield University > Cranfield > MK43 0AL > United Kingdom > tel: +44(0) 1234 758361 > > <mpicat.c>_______________________________________________ > discuss mailing list discuss(a)mpich.org > To manage subscription options or unsubscribe: > https://lists.mpich.org/mailman/listinfo/discuss _______________________________________________ discuss mailing list discuss(a)mpich.org To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss

1 0

Re: [mpich-discuss] MPI_Barrier segmentation fault
by Halim Amer 03 Jun '16

03 Jun '16

Eric, Thanks for the analysis. I confirmed your observations with Intel and GNU compilers. Also, I looked through the code, but I haven't found other instances of the wrong attribute placement. We plan to include this patch in a 3.2.x bug fix release. Note that this problem does not concern the master branch. The new code decouples the request structure definition (and its alignment) and the typedef declaration, which results in a correct alignment. Regards, --Halim www.mcs.anl.gov/~aamer On 5/27/16 5:57 PM, Eric A. Borisch wrote: > I believe that this line: (src/include/mpiimpl.h:1531) > > } MPID_Request ATTRIBUTE((__aligned__(32))); > > needs to be this: > > } ATTRIBUTE((__aligned__(32))) MPID_Request; > > From the GCC docs, the attribute needs to be just after the closing brace. > > As it is, it aligns single MPID_Request objects to be on a 32-byte > boundary, but it does make the sizeof(MPID_Request) a multiple of 32. > > This, in combination with the compiler optimizing for the > advertised-to-be-aligned singleton object with a movaps instruction > causes the crash. Changing the above line and re-compiling mpich fixes > the issue. > > There may be other instances of this issue in the codebase; I did not search... > > - Eric > > On Fri, May 27, 2016 at 12:42 AM, Ben Whale <ben(a)benwhale.com> wrote: >> Ha! Sorry didn’t spot your previous email about XCode. Thanks for the hard work >> >> I’ve had issues with XCode updates in the past. In the mean time while this is fixed I’ll try building with an old version. >> >> Ben > _______________________________________________ > discuss mailing list discuss(a)mpich.org > To manage subscription options or unsubscribe: > https://lists.mpich.org/mailman/listinfo/discuss > _______________________________________________ discuss mailing list discuss(a)mpich.org To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss

1 0

stdin redirection
by Filippone, Salvatore 01 Jun '16

01 Jun '16

Hello, I have found something I do not understand with mpich 3.2.0. The problem started with an application, but to demonstrate it I have written a very simple-minded program which I am including here. The program simply reads lines from standard input and reprints them on standard output from a second process. Now if I redirect stdin from a small(ish) file it works as expected: ====================================================================== [sfilippo@localhost MPI_cat]$ mpicc -v mpicc for MPICH version 3.2 Using built-in specs. COLLECT_GCC=gcc COLLECT_LTO_WRAPPER=/opt/gnu/5.3.0/libexec/gcc/x86_64-unknown-linux- gnu/5.3.0/lto-wrapper Target: x86_64-unknown-linux-gnu Configured with: ../gcc-5.3.0/configure --prefix=/opt/gnu/5.3.0 -- enable-languages=c,c++,fortran --with- gmp=/usr/local/travel/GCC/BUILDS/gmp --with- mpfr=/usr/local/travel/GCC/BUILDS/mpfr --with- mpc=/usr/local/travel/GCC/BUILDS/mpc --with- isl=/usr/local/travel/GCC/BUILDS/isl Thread model: posix gcc version 5.3.0 (GCC) [sfilippo@localhost MPI_cat]$ mpicc -o mpicat mpicat.c [sfilippo@localhost MPI_cat]$ head mpicat.c | mpirun -np 2 ./mpicat #include <stdlib.h> #include <stdio.h> #include "mpi.h" #define LNSZ 129 #define TAGI 234 #define TAGC 567 int main(int argc, char *argv[] ) { char linebuf[LNSZ]; int ierr, iam, np, itmp ; [sfilippo@localhost MPI_cat]$ ====================================================================== However if I use a long(ish) file (such as a configure script) I get either no output or an error. On another machine with GNU 4.9.3 I always get the silent failure. ====================================================================== [sfilippo@localhost MPI_cat]$ mpirun -np 2 ./mpicat < configure [sfilippo@localhost MPI_cat]$ mpirun -np 2 ./mpicat < configure [proxy:0:[email protected]] HYD_pmcd_pmip_control_cmd_cb (../../../../mpich-3.2/src/pm/hydra/pm/pmiserv/pmip_cb.c:937): process reading stdin too slowly; can't keep up [proxy:0:[email protected]] HYDT_dmxu_poll_wait_for_event (../../../../mpich-3.2/src/pm/hydra/tools/demux/demux_poll.c:76): callback returned error status [proxy:0:[email protected]] main (../../../../mpich- 3.2/src/pm/hydra/pm/pmiserv/pmip.c:206): demux engine error waiting for event [sfilippo@localhost MPI_cat]$ ======================================================================= Am I missing something? Is this supposed to work? I could find nothing relevant in the FAQ Thanks a lot Salvatore -- Salvatore Filippone, PhD Centre for Computational Engineering Sciences, School of Aerospace, Transport and Manufacturing, Bldg 52 Cranfield University Cranfield MK43 0AL United Kingdom tel: +44(0) 1234 758361 _______________________________________________ discuss mailing list discuss(a)mpich.org To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss

1 0