Re: [mpich-discuss] MPICH 3.2 on BlueGene/Q
Dominic, There were a bunch of fixes that went to PAMID since v3.1rc4. You could try a release from the 3.1 series (i.e. from 3.1 through 3.1.4). Regards, --Halim www.mcs.anl.gov/~aamer On 1/10/16 9:04 PM, Dominic Chien wrote:
Hi Rob and Pavan,
Thank you for your clarification.
If the MPI-3 functionalities works correctly for version 3.1rc4 on BG/Q, I may not need version 3.2. Have all MPI-3 features being tested and verified on BGQ? I just found that 3.1rc4 hang like a "deadlock" for for nonblocking test when n >2 . (maybe I should open another ticket for this issue.)
[chiensh@cumulus coll.bak]$ srun -n 2 nonblocking No errors [chiensh@cumulus coll.bak]$ srun -n 4 nonblocking (never return)
Thanks!
Regards, Dominic
On 9 Jan, 2016, at 12:14 am, Rob Latham <[email protected]> wrote:
On 01/08/2016 10:13 AM, Rob Latham wrote:
If there are 3.2 features you'd like to cherry pick into this fork, and they don't touch the device interface, or depend on patches that do, then we can definitely do that.
If you are working on Argonne's Blue Gene, I built and installed this fork to /soft/libraries/unsupported/mpich
Let me know if you run into any problems.
Oh, and as Pavan says, this is unsupported which means I'd like to know if you have problems, but I cannot promise that I'll be able to spend a lot of time debugging them.
==rob
Regards, Dominic
Here is the environment variables ====================================================================================
export CC=/opt/ibmcmp/vac/bg/12.1/bin/bgxlc_r export CXX=/opt/ibmcmp/vacpp/bg/12.1/bin/bgxlC_r export F77=/opt/ibmcmp/xlf/bg/14.1/bin/bgxlf_r export FC=/opt/ibmcmp/xlf/bg/14.1/bin/bgxlf90_r export AR=/bgsys/drivers/V1R2M0/ppc64/gnu-linux/powerpc64-bgq-linux/bin/ar export LD=/bgsys/drivers/V1R2M0/ppc64/gnu-linux/powerpc64-bgq-linux/bin/ld export RANLIB=/bgsys/drivers/V1R2M0/ppc64/gnu-linux/powerpc64-bgq-linux/bin/ranlib
export MPICHLIB_CXXFLAGS="-qhot -qinline=800 -qflag=i:i -qsaveopt -qsuppress=1506-236" export MPICHLIB_CFLAGS=${MPICHLIB_CXXFLAGS} export MPICHLIB_FFLAGS=${MPICHLIB_CXXFLAGS} export MPICHLIB_F90FLAGS=${MPICHLIB_CXXFLAGS} ====================================================================================
Here is the configure ====================================================================================
../configure --host=powerpc64-bgq-linux --with-device=pamid --with-file-system=gpfs:BGQ --with-bgq-install-dir=/bgsys/drivers/V1R2M0/ppc64 --with-pami=/bgsys/drivers/V1R2M0/ppc64/comm/sys --with-pami-include=/bgsys/drivers/V1R2M0/ppc64/comm/sys/include --with-pami-lib=/bgsys/drivers/V1R2M0/ppc64/comm/sys/lib --disable-wrapper-rpath --enable-fast=nochkmsg,notiming,O3 --with-assert-level=0 --disable-error-messages --disable-debuginfo --enable-thread-cs=per-object --with-atomic-primitives --enable-handle-allocation=tls --enable-refcount=lock-free --disable-predefined-refcount --with-cross-file=src/mpid/pamid/cross/bgq8 --prefix=/scratch/home/chiensh/apps/mpich/3.2.rc2 ====================================================================================
Here is the make log ====================================================================================
... CC src/mpi/attr/lib_libmpi_la-attr_delete.lo "/scratch/home/chiensh/mpich/mpich-3.2rc2/src/mpid/pamid/include/mpidi_thread.h", line 64.9: 1506-358 (I) "MPIU_THREAD_CS_ENTER" is defined on line 80 of ../src/util/thread/mpiu_thread_multiple.h. "/scratch/home/chiensh/mpich/mpich-3.2rc2/src/mpid/pamid/include/mpidi_thread.h", line 65.9: 1506-358 (I) "MPIU_THREAD_CS_EXIT" is defined on line 81 of ../src/util/thread/mpiu_thread_multiple.h. "/scratch/home/chiensh/mpich/mpich-3.2rc2/src/mpid/pamid/include/mpidi_thread.h", line 66.9: 1506-358 (I) "MPIU_THREAD_CS_YIELD" is defined on line 82 of ../src/util/thread/mpiu_thread_multiple.h. "../src/include/mpiimpl.h", line 1184.5: 1506-046 (S) Syntax error. "../src/include/mpiimpl.h", line 1481.5: 1506-046 (S) Syntax error. "../src/include/mpiimpl.h", line 1636.5: 1506-046 (S) Syntax error. "../src/include/mpiimpl.h", line 2785.5: 1506-343 (S) Redeclaration of MPID_Send differs from previous declaration on line 2760 of "../src/include/mpiimpl.h". "../src/include/mpiimpl.h", line 2785.5: 1506-377 (I) The type "int" of parameter 2 differs from the previous type "long". "../src/include/mpiimpl.h", line 2884.5: 1506-343 (S) Redeclaration of MPID_Isend differs from previous declaration on line 2865 of "../src/include/mpiimpl.h". "../src/include/mpiimpl.h", line 2884.5: 1506-377 (I) The type "int" of parameter 2 differs from the previous type "long". "../src/include/mpitimpl.h", line 245.5: 1506-046 (S) Syntax error. "../src/include/mpitimpl.h", line 900.40: 1506-022 (S) "total" is not a member of "struct {...}". "/scratch/home/chiensh/mpich/mpich-3.2rc2/src/mpid/pamid/include/../src/mpid_request.h", line 156.21: 1506-022 (S) "cc" is not a member of "struct MPID_Request". "/scratch/home/chiensh/mpich/mpich-3.2rc2/src/mpid/pamid/include/../src/mpid_request.h", line 157.8: 1506-022 (S) "cc_ptr" is not a member of "struct MPID_Request". "/scratch/home/chiensh/mpich/mpich-3.2rc2/src/mpid/pamid/include/../src/mpid_request.h", line 157.23: 1506-022 (S) "cc" is not a member of "struct MPID_Request". "/scratch/home/chiensh/mpich/mpich-3.2rc2/src/mpid/pamid/include/../src/mpid_request.h", line 283.62: 1506-099 (S) Unexpected argument. "/scratch/home/chiensh/mpich/mpich-3.2rc2/src/mpid/pamid/include/../src/mpid_request.h", line 326.23: 1506-022 (S) "cc_ptr" is not a member of "struct MPID_Request". "/scratch/home/chiensh/mpich/mpich-3.2rc2/src/mpid/pamid/include/../src/mpid_request.h", line 341.23: 1506-022 (S) "cc_ptr" is not a member of "struct MPID_Request". "/scratch/home/chiensh/mpich/mpich-3.2rc2/src/mpid/pamid/include/mpidpost.h", line 56.44: 1506-022 (S) "vcr" is not a member of "struct MPID_Comm". "/scratch/home/chiensh/mpich/mpich-3.2rc2/src/mpid/pamid/include/mpidpost.h", line 83.43: 1506-022 (S) "vcrt" is not a member of "struct MPID_Comm". "/scratch/home/chiensh/mpich/mpich-3.2rc2/src/mpid/pamid/include/mpidpost.h", line 84.37: 1506-022 (S) "vcrt" is not a member of "struct MPID_Comm". "/scratch/home/chiensh/mpich/mpich-3.2rc2/src/mpid/pamid/include/mpidpost.h", line 84.57: 1506-022 (S) "vcr" is not a member of "struct MPID_Comm". "/scratch/home/chiensh/mpich/mpich-3.2rc2/src/mpid/pamid/include/mpidpost.h", line 91.42: 1506-022 (S) "vcr" is not a member of "struct MPID_Comm". "/scratch/home/chiensh/mpich/mpich-3.2rc2/src/mpid/pamid/include/mpidpost.h", line 92.41: 1506-022 (S) "vcr" is not a member of "struct MPID_Comm". "../src/mpi/attr/attr_delete.c", line 65.26: 1506-045 (S) Undeclared identifier GLOBAL. make[2]: *** [src/mpi/attr/lib_libmpi_la-attr_delete.lo] Error 1 make[2]: Leaving directory `/scratch/home/chiensh/mpich/mpich-3.2rc2/build' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/scratch/home/chiensh/mpich/mpich-3.2rc2/build' make: *** [all] Error 2 ====================================================================================
_______________________________________________ discuss mailing list [email protected] To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss
_______________________________________________ discuss mailing list [email protected] To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss
discuss mailing list [email protected] To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss
_______________________________________________ discuss mailing list [email protected] To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss
_______________________________________________ discuss mailing list [email protected] To manage subscription options or unsubscribe: https://lists.mpich.org/mailman/listinfo/discuss
participants (1)
-
Halim Amer