June 2014 - discuss - mailman3.cels.anl.gov

Re: [mpich-discuss] Cluster with uneven CPU speeds
by Balaji, Pavan 05 Jun '14

05 Jun '14

Ron, In general, oversubscribing the cores of a node is a bad idea. MPI is optimized for the common case where each MPI process is on at least one core, which most applications use. This, however, adds a cost when you oversubscribe, and is not recommended. To deal with cores that operate at different speeds, the only good way is to restructure your algorithm to be more asynchronous in nature. For example, if a master-worker model is possible, that might work great. Some workers (which are running on faster cores) do more work than others. However, not all algorithms can be expressed in this model. There are other asynchronous models possible too. In short, I think it’s time to go back to the whiteboard and see if the algorithm used by the application is appropriate or not. — Pavan On Jun 5, 2014, at 7:42 PM, Ron Palmer <ron.palmer(a)pgcgroup.com.au> wrote: > I have a small cluster of computers with uneven clock speed CPUs and currently I am running with "-np" == total number of cores. However, it appears as if the fastest computer has to wait for the slower ones to finish at the end (at least I believe so). The most recent process took 65 hours so I am interested in finding ways to optimise the process. > > Is it possible to, say, use a larger "-np" and then increase the thread number for the faster CPUs in the machine file to make the faster computers do more work so, ideally, they all finish about the same time? Will it finish off the first batch then start on the next batch? Or, will the faster computers just get more concurrent jobs, possibly slowing down the processing? > > eg, if the single CPU of PC_A has twice the clock rating to that of single CPU PC_B, and both has quad cores, then use -np=12 and then have the following in the machinefile: > PC_A:8 > PC_B:4 > > Perhaps this is something better addressed with job scheduling software like GridEngine? Reuti? > > Thanks, > Ron > > > -- > Ron Palmer MSc MBA. > Principal Geophysicist > ron.palmer(a)pgcgroup.com.au > 0413 579 099 > 07 3103 4963 > > > _______________________________________________ > discuss mailing list discuss(a)mpich.org > To manage subscription options or unsubscribe: > https://lists.mpich.org/mailman/listinfo/discuss

1 0

Cluster with uneven CPU speeds
by Ron Palmer 05 Jun '14

05 Jun '14

I have a small cluster of computers with uneven clock speed CPUs and currently I am running with "-np" == total number of cores. However, it appears as if the fastest computer has to wait for the slower ones to finish at the end (at least I believe so). The most recent process took 65 hours so I am interested in finding ways to optimise the process. Is it possible to, say, use a larger "-np" and then increase the thread number for the faster CPUs in the machine file to make the faster computers do more work so, ideally, they all finish about the same time? Will it finish off the first batch then start on the next batch? Or, will the faster computers just get more concurrent jobs, possibly slowing down the processing? eg, if the single CPU of PC_A has twice the clock rating to that of single CPU PC_B, and both has quad cores, then use -np=12 and then have the following in the machinefile: PC_A:8 PC_B:4 Perhaps this is something better addressed with job scheduling software like GridEngine? Reuti? Thanks, Ron -- *Ron Palmer*MSc MBA. Principal Geophysicist ron.palmer(a)pgcgroup.com.au <mailto:[email protected]> 0413 579 099 07 3103 4963

1 0

Re: [mpich-discuss] process failing...
by Ron Palmer 05 Jun '14

05 Jun '14

Thanks Antonio, Pavan and others, your suggestions were forwarded to the programmers and it is now working! It took a little while to try it all out but I got a successful result this morning. I have another question as there is an uneven performance but I will start a new thread for that question. Thanks for your assistance. Regards, Ron On 25/05/2014 10:19, "Antonio J. Peï¿½a" wrote: > > Hi Ron, > > Depending on how the algorithm is structured, I may well be that the > faster computers are generating messages faster than the slow computer > is able to process them. As the problem size increases, the amount of > data in unprocessed messages may get too high for that computer. In a > very simple example (but note that there are many other possible > situations): > > Hosts A and B: > for(int i=0; i<n; i++) { > MPI_Send(buf, count, MPI_INT, host_c, 0, MPI_COMM_WORLD); > buf += count; > } > > Host C: > for(int i=0; i<2*n; i++) { > MPI_Recv(buf, count, MPI_INT, MPI_ANY_SOURCE, 0, MPI_COMM_WORLD, > &status); > process_data(buf); > } > > In that case the senders keep sending data to host_c faster than it's > calling MPI_Recv, and get received by MPICH as unexpected messages > (MPICH doesn't know where to place that data, and uses temporary > internal buffers). Note that this situation is not necessarily caused > by different processing speeds, since the culprit may well be the used > algorithm itself. A very simple solution to avoid the prior potential > problem could be: > > Host A and B: > MPI_Barrier(MPI_COMM_WORLD); > for(int i=0; i<n; i++) { > MPI_Send(buf, count, MPI_INT, host_c, 0, MPI_COMM_WORLD); > buf += n; > } > > Host C: > for(int i=0; i<2*n; i++) { > MPI_Irecv(buf, count, MPI_INT, MPI_ANY_SOURCE, 0, MPI_COMM_WORLD, > &requests[i]); > buf += count; > } > MPI_Barrier(MPI_COMM_WORLD); > for(int i=0; i<2*n; i++) { > MPI_Waitany(2*n, requests, &idx, &status); > process_data(buf+idx*count); > } > > Now the data is placed on its final destination, since it's guaranteed > that the MPI implementation knows its destination before receiving it. > That solution would assume that there is enough memory for > preallocating all receiving buffers, which may not be true and may > require, for example, implementing a high-level protocol (such as > based on credits) to synchronize the sends and receives to make sure > that there is room on the receiver for them. > > I hope this helps. > > Best, > Antonio > > > On 05/24/2014 02:00 AM, Ron Palmer wrote: >> Antonio, Rajeev and others, >> thanks for your replies and comments on possible causes for the error >> messages and failure, I have passed them on to the programmers of the >> underlying application. I must admit I do not understand what >> unexpected messages are (I am but a mere user), could you perhaps >> give examples of typical causes of them? Eg, the cluster it runs on >> consists of 3 dual xeon computers with varying cpu clock rating - >> could these error messages be due to getting out of synch, expecting >> results but not getting them from the slower computer? I have >> re-started the process but excluded the slowest computer (2.27GHz, >> the other two are running at 2.87 and 3.2) as I was running out of ideas. >> >> For your information, this runs well on smaller problems (few >> computations). >> >> Thanks, >> Ron >> >> On 24/05/2014 3:10 AM, Rajeev Thakur wrote: >>> Yes. The message below says some process has received 261,895 >>> messages for which no matching receives have been posted yet. >>> >>> >>> >>> Rajeev >>> >>> >>>> It looks like at least one of your processes is receiving too >>>> many unexpected messages, leading to get out of >>>> memory. Unexpected messages are those not matching a posted receive >>>> on the receiver side. You may check with the application developers >>>> to make them review the algorithm or look for any possible bug. >>>> >>>> Antonio >>> >>> >>> >>> _______________________________________________ >>> discuss mailing listdiscuss(a)mpich.org >>> To manage subscription options or unsubscribe: >>> https://lists.mpich.org/mailman/listinfo/discuss >> >> >> >> _______________________________________________ >> discuss mailing listdiscuss(a)mpich.org >> To manage subscription options or unsubscribe: >> https://lists.mpich.org/mailman/listinfo/discuss > > > -- > Antonio J. Peï¿½a > Postdoctoral Appointee > Mathematics and Computer Science Division > Argonne National Laboratory > 9700 South Cass Avenue, Bldg. 240, Of. 3148 > Argonne, IL 60439-4847 > apenya(a)mcs.anl.gov > www.mcs.anl.gov/~apenya > > > _______________________________________________ > discuss mailing list discuss(a)mpich.org > To manage subscription options or unsubscribe: > https://lists.mpich.org/mailman/listinfo/discuss -- *Ron Palmer*MSc MBA. Principal Geophysicist ron.palmer(a)pgcgroup.com.au <mailto:[email protected]> 0413 579 099 07 3103 4963

1 0

Fwd: suggestion for mpich diagnostic
by Rusty Lusk 04 Jun '14

04 Jun '14

Begin forwarded message: > From: "Steven C. Pieper" <spieper(a)anl.gov> > Subject: suggestion for mpich diagnostic > Date: June 4, 2014 at 3:14:09 PM CDT > To: Kenneth Raffenetti <raffenet(a)mcs.anl.gov>, Rusty Lusk <lusk(a)mcs.anl.gov> > Reply-To: <spieper(a)anl.gov> > > I have just found a bug in my mpi code. On blues the > bug resulted in the following single stderr line > > Fatal error in MPI_Recv: Message truncated > > with no clue as to where it happened. Fortunately I had > noticed that in the latest production mpich that I installed > (with Ken's help) on my cluster I get more info. Indeed > there I got the following: > > Fatal error in MPI_Recv: Message truncated, error stack: > MPI_Recv(184).......................: MPI_Recv(buf=0x4036510, count=1, dtype=USER<contig>, src=MPI_ANY_SOURCE, tag=101, comm=0x84000002, status=0xb3b920) failed > MPIDI_CH3U_Request_unpack_uebuf(605): Message truncated; 29292 bytes received but buffer size is 488 > > The tag=101 was enough in this case for me to locate the error. > But a little more info would be useful: > > 1) The rank of the process with the failing receive. > 2) The actual rank of the sending process. > 3) If at all possible, trigger a traceback and coredump of the > rank with the failing receive. > > Steve > -- > Steven C. Pieper: spieper(a)anl.gov > Argonne National Laboratory, Physics Division, Bldg. 203, Argonne, IL 60439 > Phone: 630-252-4232 Fax -6008 > Secretary, Debra Morrison, -4100

1 0

Re: [mpich-discuss] Internal Error: invalid error code 409e10 (Ring ids do not match)
by Gus Correa 02 Jun '14

02 Jun '14

Oh, I just replied to your previous email. On 06/02/2014 08:53 PM, Jakub Łuczyński wrote: > Solved, it was my error.. > int block_lengths[] = { 4, 2 }; > should be: > int block_lengths[] = { 4, 1 }; > Great that you solved it! That makes sense, it sounds as it may have caused some type of inadvertent buffer overlap. > Did not read man carefully. > > There was overflow all the time. On MPICH it caused error, on openmpi > and BGP it was silent. > I guess memory issues are not always reproducible across compilers, libraries, etc. > > On Tue, Jun 3, 2014 at 1:15 AM, Jakub Łuczyński <doubleloop(a)o2.pl > <mailto:[email protected]>> wrote: > > P.S. > for clarity > > typedef long long m_entry_t; > > > On Tue, Jun 3, 2014 at 1:09 AM, Jakub Łuczyński <doubleloop(a)o2.pl > <mailto:[email protected]>> wrote: > > After installation of current version (3.1) > > $ mpiexec -n 2 ~/tmp/opencl/msp-par.exe 10 10 1 > Fatal error in PMPI_Reduce: Internal MPI error!, error stack: > PMPI_Reduce(1259)........: MPI_Reduce(sbuf=0x7fff40ad30c8, > rbuf=0x7fff40ad30e0, count=1, dtype=USER<struct>, op=0x98000000, > root=0, MPI_COMM_WORLD) failed > MPIR_Reduce_impl(1071)...: > MPIR_Reduce_intra(822)...: > MPIR_Reduce_impl(1071)...: > MPIR_Reduce_intra(877)...: > MPIR_Reduce_binomial(130): > MPIR_Localcopy(123)......: memcpy arguments alias each other, > dst=0x7fff40ad30e0 src=0x7fff40ad30c8 len=32 > MPIR_Reduce_intra(842)...: > MPIR_Reduce_impl(1071)...: > MPIR_Reduce_intra(877)...: > MPIR_Reduce_binomial(246): Failure during collective > > > On Tue, Jun 3, 2014 at 12:25 AM, Gus Correa > <gus(a)ldeo.columbia.edu <mailto:[email protected]>> wrote: > > This is an old version of mpich. > Is it perhaps still using the mpd ring? > [If so, you need to start the mpd ring, if not already set, > before you launch the job. But that method was phased out.] > It may be worth updating to the latest mpich stable > and use the current mpiexec (hydra) to launch the job. > > http://www.mpich.org/__downloads/ > <http://www.mpich.org/downloads/> > http://www.mpich.org/__documentation/guides/ > <http://www.mpich.org/documentation/guides/> > http://wiki.mpich.org/mpich/__index.php/Using_the_Hydra___Process_Manager > <http://wiki.mpich.org/mpich/index.php/Using_the_Hydra_Process_Manager> > > > > On 06/02/2014 06:03 PM, Lu, Huiwei wrote: > > Hi Kuba, > > Since it works with both Open MPI and BGP, it is most > likely a problem of your MPICH installation or your > platform. > > We have stopped supporting the Windows platform a while > ago due to lack of developer resources. Please refer to > our FAQ for more information: > http://wiki.mpich.org/mpich/__index.php/Frequently_Asked___Questions#Q:_Why… > <http://wiki.mpich.org/mpich/index.php/Frequently_Asked_Questions#Q:_Why_can…> > > If it is on windows platform, we recommend you use > Microsoft MPI, which can be found here: > http://msdn.microsoft.com/en-__us/library/bb524831(v=vs.85).__aspx > <http://msdn.microsoft.com/en-us/library/bb524831(v=vs.85).aspx> > > We also encourage you to use the latest MPICH on Linux > or OSX platforms, which can be downloaded here: > http://www.mpich.org/__downloads/ > <http://www.mpich.org/downloads/> > > — > Huiwei > > On Jun 2, 2014, at 4:49 PM, Jakub Łuczyński > <doubleloop(a)o2.pl <mailto:[email protected]>> wrote: > > I wrote my assignment using MPI, and tested it both > locally on Open MPI (1.6.5) and on IBM Blue Gene/P > (with mpi implementation provided by IBM). > Everything worked fine. Turns out that our solutions > are tested also in our labs where MPICH, is installed: > > $ mpich2version > MPICH2 Version: 1.4.1p1 > > And when I run my solution there I get this strange > error: > $ mpirun -n 2 msp-par.exe 10 10 1 > Internal Error: invalid error code 409e10 (Ring ids > do not match) in MPIR_Reduce_impl:1087 > Fatal error in PMPI_Reduce: Other MPI error, error > stack: > PMPI_Reduce(1270).....: > MPI_Reduce(sbuf=__0x7fff693a92e8, > rbuf=0x7fff693a9300, count=1, dtype=USER<struct>, > op=0x98000000, root=0, MPI_COMM_WORLD) failed > MPIR_Reduce_impl(1087): > > I am literally out of ideas what is wrong! > > Below source code fragments (c++): > > struct msp_solution > { > int x1, y1, x2, y2; > m_entry_t max_sum; > msp_solution(); > msp_solution(const pair<int, int> &c1, const > pair<int, int> &c2, int max_sum); > friend bool operator<(const msp_solution &s1, > const msp_solution &s2); > }; > > void max_msp_solution(msp_solution *in, msp_solution > *inout, int, MPI_Datatype*) > { > *inout = max(*in, *inout); > } > > // somewhere in code > { > MPI_Datatype MPI_msp_solution_t; > MPI_Op max_msp_solution_op; > > // create MPI struct from msp_solution > MPI_Datatype types[] = { MPI_INT, > MPI_LONG_LONG_INT }; > int block_lengths[] = { 4, 2 }; > MPI_Aint base_addr, x1_addr, max_sum_addr; > MPI_Get_address(&collected___solution, > &base_addr); > MPI_Get_address(&collected___solution.x1, > &x1_addr); > MPI_Get_address(&collected___solution.max_sum, > &max_sum_addr); > > MPI_Aint displacements[] = > { > x1_addr - base_addr, > max_sum_addr - base_addr > }; > > MPI_Type_create_struct(2, block_lengths, > displacements, types, &MPI_msp_solution_t); > MPI_Type_commit(&MPI_msp___solution_t); > > // max reduction function > MPI_Op_create((MPI_User___function *) > max_msp_solution, 1, &max_msp_solution_op); > > ... > > msp_solution solution, received_solution; > MPI_Comm comm, > ... > // comm is created using MPI_Comm_split > // solution is initialized > MPI_Reduce(&solution, &received_solution, 1, > MPI_msp_solution_t, max_msp_solution_op , 0, > MPI_COMM_WORLD); > // ERROR above!!! > } > > > Is there some error in this? How can I make it run? > P.S. MPI_Send and MPI_Recv on my struct > MPI_msp_solution_t seems to work fine > > Thanks in advance! > Best regards, > Kuba > _________________________________________________ > discuss mailing list discuss(a)mpich.org > <mailto:[email protected]> > To manage subscription options or unsubscribe: > https://lists.mpich.org/__mailman/listinfo/discuss > <https://lists.mpich.org/mailman/listinfo/discuss> > > > _________________________________________________ > discuss mailing list discuss(a)mpich.org > <mailto:[email protected]> > To manage subscription options or unsubscribe: > https://lists.mpich.org/__mailman/listinfo/discuss > <https://lists.mpich.org/mailman/listinfo/discuss> > > > _________________________________________________ > discuss mailing list discuss(a)mpich.org > <mailto:[email protected]> > To manage subscription options or unsubscribe: > https://lists.mpich.org/__mailman/listinfo/discuss > <https://lists.mpich.org/mailman/listinfo/discuss> > > > > > > > _______________________________________________ > discuss mailing list discuss(a)mpich.org > To manage subscription options or unsubscribe: > https://lists.mpich.org/mailman/listinfo/discuss >

1 0

Re: [mpich-discuss] Internal Error: invalid error code 409e10 (Ring ids do not match)
by Gus Correa 02 Jun '14

02 Jun '14

Sorry, C++ is just wild guesswork for me ... Do your send and recv buffers in MPI_Reduce (&solution, &received_solution) overlap or are the same on root (0) ? > MPIR_Localcopy(123)......: memcpy arguments alias each other, > dst=0x7fff40ad30e0 src=0x7fff40ad30c8 len=32 I guess you need to replace the send buffer by MPI_IN_PLACE on root, when using a single buffer. Or perhaps use different buffers. On 06/02/2014 07:15 PM, Jakub Łuczyński wrote: > P.S. > for clarity > > typedef long long m_entry_t; > > > On Tue, Jun 3, 2014 at 1:09 AM, Jakub Łuczyński <doubleloop(a)o2.pl > <mailto:[email protected]>> wrote: > > After installation of current version (3.1) > > $ mpiexec -n 2 ~/tmp/opencl/msp-par.exe 10 10 1 > Fatal error in PMPI_Reduce: Internal MPI error!, error stack: > PMPI_Reduce(1259)........: MPI_Reduce(sbuf=0x7fff40ad30c8, > rbuf=0x7fff40ad30e0, count=1, dtype=USER<struct>, op=0x98000000, > root=0, MPI_COMM_WORLD) failed > MPIR_Reduce_impl(1071)...: > MPIR_Reduce_intra(822)...: > MPIR_Reduce_impl(1071)...: > MPIR_Reduce_intra(877)...: > MPIR_Reduce_binomial(130): > MPIR_Localcopy(123)......: memcpy arguments alias each other, > dst=0x7fff40ad30e0 src=0x7fff40ad30c8 len=32 > MPIR_Reduce_intra(842)...: > MPIR_Reduce_impl(1071)...: > MPIR_Reduce_intra(877)...: > MPIR_Reduce_binomial(246): Failure during collective > > > On Tue, Jun 3, 2014 at 12:25 AM, Gus Correa <gus(a)ldeo.columbia.edu > <mailto:[email protected]>> wrote: > > This is an old version of mpich. > Is it perhaps still using the mpd ring? > [If so, you need to start the mpd ring, if not already set, > before you launch the job. But that method was phased out.] > It may be worth updating to the latest mpich stable > and use the current mpiexec (hydra) to launch the job. > > http://www.mpich.org/__downloads/ <http://www.mpich.org/downloads/> > http://www.mpich.org/__documentation/guides/ > <http://www.mpich.org/documentation/guides/> > http://wiki.mpich.org/mpich/__index.php/Using_the_Hydra___Process_Manager > <http://wiki.mpich.org/mpich/index.php/Using_the_Hydra_Process_Manager> > > > > On 06/02/2014 06:03 PM, Lu, Huiwei wrote: > > Hi Kuba, > > Since it works with both Open MPI and BGP, it is most likely > a problem of your MPICH installation or your platform. > > We have stopped supporting the Windows platform a while ago > due to lack of developer resources. Please refer to our FAQ > for more information: > http://wiki.mpich.org/mpich/__index.php/Frequently_Asked___Questions#Q:_Why… > <http://wiki.mpich.org/mpich/index.php/Frequently_Asked_Questions#Q:_Why_can…> > > If it is on windows platform, we recommend you use Microsoft > MPI, which can be found here: > http://msdn.microsoft.com/en-__us/library/bb524831(v=vs.85).__aspx > <http://msdn.microsoft.com/en-us/library/bb524831(v=vs.85).aspx> > > We also encourage you to use the latest MPICH on Linux or > OSX platforms, which can be downloaded here: > http://www.mpich.org/__downloads/ > <http://www.mpich.org/downloads/> > > — > Huiwei > > On Jun 2, 2014, at 4:49 PM, Jakub Łuczyński > <doubleloop(a)o2.pl <mailto:[email protected]>> wrote: > > I wrote my assignment using MPI, and tested it both > locally on Open MPI (1.6.5) and on IBM Blue Gene/P (with > mpi implementation provided by IBM). Everything worked > fine. Turns out that our solutions are tested also in > our labs where MPICH, is installed: > > $ mpich2version > MPICH2 Version: 1.4.1p1 > > And when I run my solution there I get this strange error: > $ mpirun -n 2 msp-par.exe 10 10 1 > Internal Error: invalid error code 409e10 (Ring ids do > not match) in MPIR_Reduce_impl:1087 > Fatal error in PMPI_Reduce: Other MPI error, error stack: > PMPI_Reduce(1270).....: > MPI_Reduce(sbuf=__0x7fff693a92e8, rbuf=0x7fff693a9300, > count=1, dtype=USER<struct>, op=0x98000000, root=0, > MPI_COMM_WORLD) failed > MPIR_Reduce_impl(1087): > > I am literally out of ideas what is wrong! > > Below source code fragments (c++): > > struct msp_solution > { > int x1, y1, x2, y2; > m_entry_t max_sum; > msp_solution(); > msp_solution(const pair<int, int> &c1, const > pair<int, int> &c2, int max_sum); > friend bool operator<(const msp_solution &s1, const > msp_solution &s2); > }; > > void max_msp_solution(msp_solution *in, msp_solution > *inout, int, MPI_Datatype*) > { > *inout = max(*in, *inout); > } > > // somewhere in code > { > MPI_Datatype MPI_msp_solution_t; > MPI_Op max_msp_solution_op; > > // create MPI struct from msp_solution > MPI_Datatype types[] = { MPI_INT, MPI_LONG_LONG_INT }; > int block_lengths[] = { 4, 2 }; > MPI_Aint base_addr, x1_addr, max_sum_addr; > MPI_Get_address(&collected___solution, &base_addr); > MPI_Get_address(&collected___solution.x1, &x1_addr); > MPI_Get_address(&collected___solution.max_sum, > &max_sum_addr); > > MPI_Aint displacements[] = > { > x1_addr - base_addr, > max_sum_addr - base_addr > }; > > MPI_Type_create_struct(2, block_lengths, > displacements, types, &MPI_msp_solution_t); > MPI_Type_commit(&MPI_msp___solution_t); > > // max reduction function > MPI_Op_create((MPI_User___function *) > max_msp_solution, 1, &max_msp_solution_op); > > ... > > msp_solution solution, received_solution; > MPI_Comm comm, > ... > // comm is created using MPI_Comm_split > // solution is initialized > MPI_Reduce(&solution, &received_solution, 1, > MPI_msp_solution_t, max_msp_solution_op , 0, > MPI_COMM_WORLD); > // ERROR above!!! > } > > > Is there some error in this? How can I make it run? > P.S. MPI_Send and MPI_Recv on my struct > MPI_msp_solution_t seems to work fine > > Thanks in advance! > Best regards, > Kuba > _________________________________________________ > discuss mailing list discuss(a)mpich.org > <mailto:[email protected]> > To manage subscription options or unsubscribe: > https://lists.mpich.org/__mailman/listinfo/discuss > <https://lists.mpich.org/mailman/listinfo/discuss> > > > _________________________________________________ > discuss mailing list discuss(a)mpich.org > <mailto:[email protected]> > To manage subscription options or unsubscribe: > https://lists.mpich.org/__mailman/listinfo/discuss > <https://lists.mpich.org/mailman/listinfo/discuss> > > > _________________________________________________ > discuss mailing list discuss(a)mpich.org <mailto:[email protected]> > To manage subscription options or unsubscribe: > https://lists.mpich.org/__mailman/listinfo/discuss > <https://lists.mpich.org/mailman/listinfo/discuss> > > > > > > _______________________________________________ > discuss mailing list discuss(a)mpich.org > To manage subscription options or unsubscribe: > https://lists.mpich.org/mailman/listinfo/discuss >

1 0

Re: [mpich-discuss] Internal Error: invalid error code 409e10 (Ring ids do not match)
by Jakub Łuczyński 02 Jun '14

02 Jun '14

Solved, it was my error.. int block_lengths[] = { 4, 2 }; should be: int block_lengths[] = { 4, 1 }; Did not read man carefully. There was overflow all the time. On MPICH it caused error, on openmpi and BGP it was silent. On Tue, Jun 3, 2014 at 1:15 AM, Jakub Łuczyński <doubleloop(a)o2.pl> wrote: > P.S. > for clarity > > typedef long long m_entry_t; > > > On Tue, Jun 3, 2014 at 1:09 AM, Jakub Łuczyński <doubleloop(a)o2.pl> wrote: > >> After installation of current version (3.1) >> >> $ mpiexec -n 2 ~/tmp/opencl/msp-par.exe 10 10 1 >> Fatal error in PMPI_Reduce: Internal MPI error!, error stack: >> PMPI_Reduce(1259)........: MPI_Reduce(sbuf=0x7fff40ad30c8, >> rbuf=0x7fff40ad30e0, count=1, dtype=USER<struct>, op=0x98000000, root=0, >> MPI_COMM_WORLD) failed >> MPIR_Reduce_impl(1071)...: >> MPIR_Reduce_intra(822)...: >> MPIR_Reduce_impl(1071)...: >> MPIR_Reduce_intra(877)...: >> MPIR_Reduce_binomial(130): >> MPIR_Localcopy(123)......: memcpy arguments alias each other, >> dst=0x7fff40ad30e0 src=0x7fff40ad30c8 len=32 >> MPIR_Reduce_intra(842)...: >> MPIR_Reduce_impl(1071)...: >> MPIR_Reduce_intra(877)...: >> MPIR_Reduce_binomial(246): Failure during collective >> >> >> On Tue, Jun 3, 2014 at 12:25 AM, Gus Correa <gus(a)ldeo.columbia.edu> >> wrote: >> >>> This is an old version of mpich. >>> Is it perhaps still using the mpd ring? >>> [If so, you need to start the mpd ring, if not already set, >>> before you launch the job. But that method was phased out.] >>> It may be worth updating to the latest mpich stable >>> and use the current mpiexec (hydra) to launch the job. >>> >>> http://www.mpich.org/downloads/ >>> http://www.mpich.org/documentation/guides/ >>> http://wiki.mpich.org/mpich/index.php/Using_the_Hydra_Process_Manager >>> >>> >>> >>> On 06/02/2014 06:03 PM, Lu, Huiwei wrote: >>> >>>> Hi Kuba, >>>> >>>> Since it works with both Open MPI and BGP, it is most likely a problem >>>> of your MPICH installation or your platform. >>>> >>>> We have stopped supporting the Windows platform a while ago due to lack >>>> of developer resources. Please refer to our FAQ for more information: >>>> http://wiki.mpich.org/mpich/index.php/Frequently_Asked_ >>>> Questions#Q:_Why_can.27t_I_build_MPICH_on_Windows_anymore.3F >>>> >>>> If it is on windows platform, we recommend you use Microsoft MPI, which >>>> can be found here: http://msdn.microsoft.com/en- >>>> us/library/bb524831(v=vs.85).aspx >>>> >>>> We also encourage you to use the latest MPICH on Linux or OSX >>>> platforms, which can be downloaded here: http://www.mpich.org/ >>>> downloads/ >>>> >>>> — >>>> Huiwei >>>> >>>> On Jun 2, 2014, at 4:49 PM, Jakub Łuczyński <doubleloop(a)o2.pl> wrote: >>>> >>>> I wrote my assignment using MPI, and tested it both locally on Open >>>>> MPI (1.6.5) and on IBM Blue Gene/P (with mpi implementation provided by >>>>> IBM). Everything worked fine. Turns out that our solutions are tested also >>>>> in our labs where MPICH, is installed: >>>>> >>>>> $ mpich2version >>>>> MPICH2 Version: 1.4.1p1 >>>>> >>>>> And when I run my solution there I get this strange error: >>>>> $ mpirun -n 2 msp-par.exe 10 10 1 >>>>> Internal Error: invalid error code 409e10 (Ring ids do not match) in >>>>> MPIR_Reduce_impl:1087 >>>>> Fatal error in PMPI_Reduce: Other MPI error, error stack: >>>>> PMPI_Reduce(1270).....: MPI_Reduce(sbuf=0x7fff693a92e8, >>>>> rbuf=0x7fff693a9300, count=1, dtype=USER<struct>, op=0x98000000, root=0, >>>>> MPI_COMM_WORLD) failed >>>>> MPIR_Reduce_impl(1087): >>>>> >>>>> I am literally out of ideas what is wrong! >>>>> >>>>> Below source code fragments (c++): >>>>> >>>>> struct msp_solution >>>>> { >>>>> int x1, y1, x2, y2; >>>>> m_entry_t max_sum; >>>>> msp_solution(); >>>>> msp_solution(const pair<int, int> &c1, const pair<int, int> &c2, >>>>> int max_sum); >>>>> friend bool operator<(const msp_solution &s1, const msp_solution >>>>> &s2); >>>>> }; >>>>> >>>>> void max_msp_solution(msp_solution *in, msp_solution *inout, int, >>>>> MPI_Datatype*) >>>>> { >>>>> *inout = max(*in, *inout); >>>>> } >>>>> >>>>> // somewhere in code >>>>> { >>>>> MPI_Datatype MPI_msp_solution_t; >>>>> MPI_Op max_msp_solution_op; >>>>> >>>>> // create MPI struct from msp_solution >>>>> MPI_Datatype types[] = { MPI_INT, MPI_LONG_LONG_INT }; >>>>> int block_lengths[] = { 4, 2 }; >>>>> MPI_Aint base_addr, x1_addr, max_sum_addr; >>>>> MPI_Get_address(&collected_solution, &base_addr); >>>>> MPI_Get_address(&collected_solution.x1, &x1_addr); >>>>> MPI_Get_address(&collected_solution.max_sum, &max_sum_addr); >>>>> >>>>> MPI_Aint displacements[] = >>>>> { >>>>> x1_addr - base_addr, >>>>> max_sum_addr - base_addr >>>>> }; >>>>> >>>>> MPI_Type_create_struct(2, block_lengths, displacements, types, >>>>> &MPI_msp_solution_t); >>>>> MPI_Type_commit(&MPI_msp_solution_t); >>>>> >>>>> // max reduction function >>>>> MPI_Op_create((MPI_User_function *) max_msp_solution, 1, >>>>> &max_msp_solution_op); >>>>> >>>>> ... >>>>> >>>>> msp_solution solution, received_solution; >>>>> MPI_Comm comm, >>>>> ... >>>>> // comm is created using MPI_Comm_split >>>>> // solution is initialized >>>>> MPI_Reduce(&solution, &received_solution, 1, MPI_msp_solution_t, >>>>> max_msp_solution_op , 0, MPI_COMM_WORLD); >>>>> // ERROR above!!! >>>>> } >>>>> >>>>> >>>>> Is there some error in this? How can I make it run? >>>>> P.S. MPI_Send and MPI_Recv on my struct MPI_msp_solution_t seems to >>>>> work fine >>>>> >>>>> Thanks in advance! >>>>> Best regards, >>>>> Kuba >>>>> _______________________________________________ >>>>> discuss mailing list discuss(a)mpich.org >>>>> To manage subscription options or unsubscribe: >>>>> https://lists.mpich.org/mailman/listinfo/discuss >>>>> >>>> >>>> _______________________________________________ >>>> discuss mailing list discuss(a)mpich.org >>>> To manage subscription options or unsubscribe: >>>> https://lists.mpich.org/mailman/listinfo/discuss >>>> >>>> >>> _______________________________________________ >>> discuss mailing list discuss(a)mpich.org >>> To manage subscription options or unsubscribe: >>> https://lists.mpich.org/mailman/listinfo/discuss >>> >> >> >

1 0

Re: [mpich-discuss] Internal Error: invalid error code 409e10 (Ring ids do not match)
by Jakub Łuczyński 02 Jun '14

02 Jun '14

P.S. for clarity typedef long long m_entry_t; On Tue, Jun 3, 2014 at 1:09 AM, Jakub Łuczyński <doubleloop(a)o2.pl> wrote: > After installation of current version (3.1) > > $ mpiexec -n 2 ~/tmp/opencl/msp-par.exe 10 10 1 > Fatal error in PMPI_Reduce: Internal MPI error!, error stack: > PMPI_Reduce(1259)........: MPI_Reduce(sbuf=0x7fff40ad30c8, > rbuf=0x7fff40ad30e0, count=1, dtype=USER<struct>, op=0x98000000, root=0, > MPI_COMM_WORLD) failed > MPIR_Reduce_impl(1071)...: > MPIR_Reduce_intra(822)...: > MPIR_Reduce_impl(1071)...: > MPIR_Reduce_intra(877)...: > MPIR_Reduce_binomial(130): > MPIR_Localcopy(123)......: memcpy arguments alias each other, > dst=0x7fff40ad30e0 src=0x7fff40ad30c8 len=32 > MPIR_Reduce_intra(842)...: > MPIR_Reduce_impl(1071)...: > MPIR_Reduce_intra(877)...: > MPIR_Reduce_binomial(246): Failure during collective > > > On Tue, Jun 3, 2014 at 12:25 AM, Gus Correa <gus(a)ldeo.columbia.edu> wrote: > >> This is an old version of mpich. >> Is it perhaps still using the mpd ring? >> [If so, you need to start the mpd ring, if not already set, >> before you launch the job. But that method was phased out.] >> It may be worth updating to the latest mpich stable >> and use the current mpiexec (hydra) to launch the job. >> >> http://www.mpich.org/downloads/ >> http://www.mpich.org/documentation/guides/ >> http://wiki.mpich.org/mpich/index.php/Using_the_Hydra_Process_Manager >> >> >> >> On 06/02/2014 06:03 PM, Lu, Huiwei wrote: >> >>> Hi Kuba, >>> >>> Since it works with both Open MPI and BGP, it is most likely a problem >>> of your MPICH installation or your platform. >>> >>> We have stopped supporting the Windows platform a while ago due to lack >>> of developer resources. Please refer to our FAQ for more information: >>> http://wiki.mpich.org/mpich/index.php/Frequently_Asked_ >>> Questions#Q:_Why_can.27t_I_build_MPICH_on_Windows_anymore.3F >>> >>> If it is on windows platform, we recommend you use Microsoft MPI, which >>> can be found here: http://msdn.microsoft.com/en- >>> us/library/bb524831(v=vs.85).aspx >>> >>> We also encourage you to use the latest MPICH on Linux or OSX platforms, >>> which can be downloaded here: http://www.mpich.org/downloads/ >>> >>> — >>> Huiwei >>> >>> On Jun 2, 2014, at 4:49 PM, Jakub Łuczyński <doubleloop(a)o2.pl> wrote: >>> >>> I wrote my assignment using MPI, and tested it both locally on Open MPI >>>> (1.6.5) and on IBM Blue Gene/P (with mpi implementation provided by IBM). >>>> Everything worked fine. Turns out that our solutions are tested also in our >>>> labs where MPICH, is installed: >>>> >>>> $ mpich2version >>>> MPICH2 Version: 1.4.1p1 >>>> >>>> And when I run my solution there I get this strange error: >>>> $ mpirun -n 2 msp-par.exe 10 10 1 >>>> Internal Error: invalid error code 409e10 (Ring ids do not match) in >>>> MPIR_Reduce_impl:1087 >>>> Fatal error in PMPI_Reduce: Other MPI error, error stack: >>>> PMPI_Reduce(1270).....: MPI_Reduce(sbuf=0x7fff693a92e8, >>>> rbuf=0x7fff693a9300, count=1, dtype=USER<struct>, op=0x98000000, root=0, >>>> MPI_COMM_WORLD) failed >>>> MPIR_Reduce_impl(1087): >>>> >>>> I am literally out of ideas what is wrong! >>>> >>>> Below source code fragments (c++): >>>> >>>> struct msp_solution >>>> { >>>> int x1, y1, x2, y2; >>>> m_entry_t max_sum; >>>> msp_solution(); >>>> msp_solution(const pair<int, int> &c1, const pair<int, int> &c2, >>>> int max_sum); >>>> friend bool operator<(const msp_solution &s1, const msp_solution >>>> &s2); >>>> }; >>>> >>>> void max_msp_solution(msp_solution *in, msp_solution *inout, int, >>>> MPI_Datatype*) >>>> { >>>> *inout = max(*in, *inout); >>>> } >>>> >>>> // somewhere in code >>>> { >>>> MPI_Datatype MPI_msp_solution_t; >>>> MPI_Op max_msp_solution_op; >>>> >>>> // create MPI struct from msp_solution >>>> MPI_Datatype types[] = { MPI_INT, MPI_LONG_LONG_INT }; >>>> int block_lengths[] = { 4, 2 }; >>>> MPI_Aint base_addr, x1_addr, max_sum_addr; >>>> MPI_Get_address(&collected_solution, &base_addr); >>>> MPI_Get_address(&collected_solution.x1, &x1_addr); >>>> MPI_Get_address(&collected_solution.max_sum, &max_sum_addr); >>>> >>>> MPI_Aint displacements[] = >>>> { >>>> x1_addr - base_addr, >>>> max_sum_addr - base_addr >>>> }; >>>> >>>> MPI_Type_create_struct(2, block_lengths, displacements, types, >>>> &MPI_msp_solution_t); >>>> MPI_Type_commit(&MPI_msp_solution_t); >>>> >>>> // max reduction function >>>> MPI_Op_create((MPI_User_function *) max_msp_solution, 1, >>>> &max_msp_solution_op); >>>> >>>> ... >>>> >>>> msp_solution solution, received_solution; >>>> MPI_Comm comm, >>>> ... >>>> // comm is created using MPI_Comm_split >>>> // solution is initialized >>>> MPI_Reduce(&solution, &received_solution, 1, MPI_msp_solution_t, >>>> max_msp_solution_op , 0, MPI_COMM_WORLD); >>>> // ERROR above!!! >>>> } >>>> >>>> >>>> Is there some error in this? How can I make it run? >>>> P.S. MPI_Send and MPI_Recv on my struct MPI_msp_solution_t seems to >>>> work fine >>>> >>>> Thanks in advance! >>>> Best regards, >>>> Kuba >>>> _______________________________________________ >>>> discuss mailing list discuss(a)mpich.org >>>> To manage subscription options or unsubscribe: >>>> https://lists.mpich.org/mailman/listinfo/discuss >>>> >>> >>> _______________________________________________ >>> discuss mailing list discuss(a)mpich.org >>> To manage subscription options or unsubscribe: >>> https://lists.mpich.org/mailman/listinfo/discuss >>> >>> >> _______________________________________________ >> discuss mailing list discuss(a)mpich.org >> To manage subscription options or unsubscribe: >> https://lists.mpich.org/mailman/listinfo/discuss >> > >

1 0

Re: [mpich-discuss] Internal Error: invalid error code 409e10 (Ring ids do not match)
by Jakub Łuczyński 02 Jun '14

02 Jun '14

After installation of current version (3.1) $ mpiexec -n 2 ~/tmp/opencl/msp-par.exe 10 10 1 Fatal error in PMPI_Reduce: Internal MPI error!, error stack: PMPI_Reduce(1259)........: MPI_Reduce(sbuf=0x7fff40ad30c8, rbuf=0x7fff40ad30e0, count=1, dtype=USER<struct>, op=0x98000000, root=0, MPI_COMM_WORLD) failed MPIR_Reduce_impl(1071)...: MPIR_Reduce_intra(822)...: MPIR_Reduce_impl(1071)...: MPIR_Reduce_intra(877)...: MPIR_Reduce_binomial(130): MPIR_Localcopy(123)......: memcpy arguments alias each other, dst=0x7fff40ad30e0 src=0x7fff40ad30c8 len=32 MPIR_Reduce_intra(842)...: MPIR_Reduce_impl(1071)...: MPIR_Reduce_intra(877)...: MPIR_Reduce_binomial(246): Failure during collective On Tue, Jun 3, 2014 at 12:25 AM, Gus Correa <gus(a)ldeo.columbia.edu> wrote: > This is an old version of mpich. > Is it perhaps still using the mpd ring? > [If so, you need to start the mpd ring, if not already set, > before you launch the job. But that method was phased out.] > It may be worth updating to the latest mpich stable > and use the current mpiexec (hydra) to launch the job. > > http://www.mpich.org/downloads/ > http://www.mpich.org/documentation/guides/ > http://wiki.mpich.org/mpich/index.php/Using_the_Hydra_Process_Manager > > > > On 06/02/2014 06:03 PM, Lu, Huiwei wrote: > >> Hi Kuba, >> >> Since it works with both Open MPI and BGP, it is most likely a problem of >> your MPICH installation or your platform. >> >> We have stopped supporting the Windows platform a while ago due to lack >> of developer resources. Please refer to our FAQ for more information: >> http://wiki.mpich.org/mpich/index.php/Frequently_Asked_ >> Questions#Q:_Why_can.27t_I_build_MPICH_on_Windows_anymore.3F >> >> If it is on windows platform, we recommend you use Microsoft MPI, which >> can be found here: http://msdn.microsoft.com/en- >> us/library/bb524831(v=vs.85).aspx >> >> We also encourage you to use the latest MPICH on Linux or OSX platforms, >> which can be downloaded here: http://www.mpich.org/downloads/ >> >> — >> Huiwei >> >> On Jun 2, 2014, at 4:49 PM, Jakub Łuczyński <doubleloop(a)o2.pl> wrote: >> >> I wrote my assignment using MPI, and tested it both locally on Open MPI >>> (1.6.5) and on IBM Blue Gene/P (with mpi implementation provided by IBM). >>> Everything worked fine. Turns out that our solutions are tested also in our >>> labs where MPICH, is installed: >>> >>> $ mpich2version >>> MPICH2 Version: 1.4.1p1 >>> >>> And when I run my solution there I get this strange error: >>> $ mpirun -n 2 msp-par.exe 10 10 1 >>> Internal Error: invalid error code 409e10 (Ring ids do not match) in >>> MPIR_Reduce_impl:1087 >>> Fatal error in PMPI_Reduce: Other MPI error, error stack: >>> PMPI_Reduce(1270).....: MPI_Reduce(sbuf=0x7fff693a92e8, >>> rbuf=0x7fff693a9300, count=1, dtype=USER<struct>, op=0x98000000, root=0, >>> MPI_COMM_WORLD) failed >>> MPIR_Reduce_impl(1087): >>> >>> I am literally out of ideas what is wrong! >>> >>> Below source code fragments (c++): >>> >>> struct msp_solution >>> { >>> int x1, y1, x2, y2; >>> m_entry_t max_sum; >>> msp_solution(); >>> msp_solution(const pair<int, int> &c1, const pair<int, int> &c2, int >>> max_sum); >>> friend bool operator<(const msp_solution &s1, const msp_solution >>> &s2); >>> }; >>> >>> void max_msp_solution(msp_solution *in, msp_solution *inout, int, >>> MPI_Datatype*) >>> { >>> *inout = max(*in, *inout); >>> } >>> >>> // somewhere in code >>> { >>> MPI_Datatype MPI_msp_solution_t; >>> MPI_Op max_msp_solution_op; >>> >>> // create MPI struct from msp_solution >>> MPI_Datatype types[] = { MPI_INT, MPI_LONG_LONG_INT }; >>> int block_lengths[] = { 4, 2 }; >>> MPI_Aint base_addr, x1_addr, max_sum_addr; >>> MPI_Get_address(&collected_solution, &base_addr); >>> MPI_Get_address(&collected_solution.x1, &x1_addr); >>> MPI_Get_address(&collected_solution.max_sum, &max_sum_addr); >>> >>> MPI_Aint displacements[] = >>> { >>> x1_addr - base_addr, >>> max_sum_addr - base_addr >>> }; >>> >>> MPI_Type_create_struct(2, block_lengths, displacements, types, >>> &MPI_msp_solution_t); >>> MPI_Type_commit(&MPI_msp_solution_t); >>> >>> // max reduction function >>> MPI_Op_create((MPI_User_function *) max_msp_solution, 1, >>> &max_msp_solution_op); >>> >>> ... >>> >>> msp_solution solution, received_solution; >>> MPI_Comm comm, >>> ... >>> // comm is created using MPI_Comm_split >>> // solution is initialized >>> MPI_Reduce(&solution, &received_solution, 1, MPI_msp_solution_t, >>> max_msp_solution_op , 0, MPI_COMM_WORLD); >>> // ERROR above!!! >>> } >>> >>> >>> Is there some error in this? How can I make it run? >>> P.S. MPI_Send and MPI_Recv on my struct MPI_msp_solution_t seems to work >>> fine >>> >>> Thanks in advance! >>> Best regards, >>> Kuba >>> _______________________________________________ >>> discuss mailing list discuss(a)mpich.org >>> To manage subscription options or unsubscribe: >>> https://lists.mpich.org/mailman/listinfo/discuss >>> >> >> _______________________________________________ >> discuss mailing list discuss(a)mpich.org >> To manage subscription options or unsubscribe: >> https://lists.mpich.org/mailman/listinfo/discuss >> >> > _______________________________________________ > discuss mailing list discuss(a)mpich.org > To manage subscription options or unsubscribe: > https://lists.mpich.org/mailman/listinfo/discuss >

1 0

Re: [mpich-discuss] Internal Error: invalid error code 409e10 (Ring ids do not match)
by Gus Correa 02 Jun '14

02 Jun '14

This is an old version of mpich. Is it perhaps still using the mpd ring? [If so, you need to start the mpd ring, if not already set, before you launch the job. But that method was phased out.] It may be worth updating to the latest mpich stable and use the current mpiexec (hydra) to launch the job. http://www.mpich.org/downloads/ http://www.mpich.org/documentation/guides/ http://wiki.mpich.org/mpich/index.php/Using_the_Hydra_Process_Manager On 06/02/2014 06:03 PM, Lu, Huiwei wrote: > Hi Kuba, > > Since it works with both Open MPI and BGP, it is most likely a problem of your MPICH installation or your platform. > > We have stopped supporting the Windows platform a while ago due to lack of developer resources. Please refer to our FAQ for more information: > http://wiki.mpich.org/mpich/index.php/Frequently_Asked_Questions#Q:_Why_can… > > If it is on windows platform, we recommend you use Microsoft MPI, which can be found here: http://msdn.microsoft.com/en-us/library/bb524831(v=vs.85).aspx > > We also encourage you to use the latest MPICH on Linux or OSX platforms, which can be downloaded here: http://www.mpich.org/downloads/ > > — > Huiwei > > On Jun 2, 2014, at 4:49 PM, Jakub Łuczyński <doubleloop(a)o2.pl> wrote: > >> I wrote my assignment using MPI, and tested it both locally on Open MPI (1.6.5) and on IBM Blue Gene/P (with mpi implementation provided by IBM). Everything worked fine. Turns out that our solutions are tested also in our labs where MPICH, is installed: >> >> $ mpich2version >> MPICH2 Version: 1.4.1p1 >> >> And when I run my solution there I get this strange error: >> $ mpirun -n 2 msp-par.exe 10 10 1 >> Internal Error: invalid error code 409e10 (Ring ids do not match) in MPIR_Reduce_impl:1087 >> Fatal error in PMPI_Reduce: Other MPI error, error stack: >> PMPI_Reduce(1270).....: MPI_Reduce(sbuf=0x7fff693a92e8, rbuf=0x7fff693a9300, count=1, dtype=USER<struct>, op=0x98000000, root=0, MPI_COMM_WORLD) failed >> MPIR_Reduce_impl(1087): >> >> I am literally out of ideas what is wrong! >> >> Below source code fragments (c++): >> >> struct msp_solution >> { >> int x1, y1, x2, y2; >> m_entry_t max_sum; >> msp_solution(); >> msp_solution(const pair<int, int> &c1, const pair<int, int> &c2, int max_sum); >> friend bool operator<(const msp_solution &s1, const msp_solution &s2); >> }; >> >> void max_msp_solution(msp_solution *in, msp_solution *inout, int, MPI_Datatype*) >> { >> *inout = max(*in, *inout); >> } >> >> // somewhere in code >> { >> MPI_Datatype MPI_msp_solution_t; >> MPI_Op max_msp_solution_op; >> >> // create MPI struct from msp_solution >> MPI_Datatype types[] = { MPI_INT, MPI_LONG_LONG_INT }; >> int block_lengths[] = { 4, 2 }; >> MPI_Aint base_addr, x1_addr, max_sum_addr; >> MPI_Get_address(&collected_solution, &base_addr); >> MPI_Get_address(&collected_solution.x1, &x1_addr); >> MPI_Get_address(&collected_solution.max_sum, &max_sum_addr); >> >> MPI_Aint displacements[] = >> { >> x1_addr - base_addr, >> max_sum_addr - base_addr >> }; >> >> MPI_Type_create_struct(2, block_lengths, displacements, types, &MPI_msp_solution_t); >> MPI_Type_commit(&MPI_msp_solution_t); >> >> // max reduction function >> MPI_Op_create((MPI_User_function *) max_msp_solution, 1, &max_msp_solution_op); >> >> ... >> >> msp_solution solution, received_solution; >> MPI_Comm comm, >> ... >> // comm is created using MPI_Comm_split >> // solution is initialized >> MPI_Reduce(&solution, &received_solution, 1, MPI_msp_solution_t, max_msp_solution_op , 0, MPI_COMM_WORLD); >> // ERROR above!!! >> } >> >> >> Is there some error in this? How can I make it run? >> P.S. MPI_Send and MPI_Recv on my struct MPI_msp_solution_t seems to work fine >> >> Thanks in advance! >> Best regards, >> Kuba >> _______________________________________________ >> discuss mailing list discuss(a)mpich.org >> To manage subscription options or unsubscribe: >> https://lists.mpich.org/mailman/listinfo/discuss > > _______________________________________________ > discuss mailing list discuss(a)mpich.org > To manage subscription options or unsubscribe: > https://lists.mpich.org/mailman/listinfo/discuss >

1 0