Something broke; I think I see what it is from your logs. I'll fix it. - Peter On Mon, Aug 13, 2012 at 9:17 PM, Barry Smith <[email protected]> wrote:
What's up with this stuff? Are they bugs? Bad algorithms? What? It is hard to make a major change to PETSc (and use alltests to check that you haven't broken anything) when this crap comes up constantly.
Is there a plan to deal with this or are we just screwed forever?
Barry
1 SNES Function norm 59.1937
[0]PETSC ERROR: --------------------- Error Message
[0]PETSC ERROR: Floating point exception! [0]PETSC ERROR: Vec entry at local location 83 is not-a-number or infinite at end of function: Parameter number 3! [0]PETSC ERROR:
[0]PETSC ERROR: Petsc Development HG revision: bd03fdcd3cf87c5b29ea28a5f4737ae936d9df04 HG Date: Sat Aug 11 20:22:42 2012 -0500 [0]PETSC ERROR: See docs/changes/index.html for recent updates. [0]PETSC ERROR: See docs/faq.html for hints about trouble shooting. [0]PETSC ERROR: See docs/index.html for manual pages. [0]PETSC ERROR:
[0]PETSC ERROR: ./ex5 on a arch-gnu named Barrys-MacBook-Pro.local by barrysmith Mon Aug 13 21:12:18 2012 [0]PETSC ERROR: Libraries linked from /Users/barrysmith/Src/petsc-dev/arch-gnu/lib [0]PETSC ERROR: Configure run at Sat Aug 11 20:25:02 2012 [0]PETSC ERROR: Configure options --download-blacs --download-fftw --download-hypre --download-libyaml --download-metis --download-ml --download-mpich --download-mumps --download-parmetis --download-ptscotch --download-scalapack --download-superlu --download-superlu_dist --download-triangle --download-yaml --with-ams-dir=/Users/barrysmith/Src/ams-dev --with-java --with-openmp --with-server --with-shared-libraries PETSC_ARCH=arch-gnu [0]PETSC ERROR:
[0]PETSC ERROR: SNESComputeFunction() line 1927 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: SNESLineSearchApply_Basic() line 41 in /Users/barrysmith/Src/petsc-dev/src/snes/linesearch/impls/basic/linesearchbasic.c [0]PETSC ERROR: SNESLineSearchApply() line 506 in /Users/barrysmith/Src/petsc-dev/src/snes/linesearch/interface/linesearch.c [0]PETSC ERROR: SNESSolve_NRichardson() line 181 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/richardson/snesrichardson.c [0]PETSC ERROR: SNESSolve() line 3570 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: SNESSolve_NGMRES() line 259 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/ngmres/snesngmres.c [0]PETSC ERROR: SNESSolve() line 3570 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: main() line 152 in src/snes/examples/tutorials/ex5.c application called MPI_Abort(MPI_COMM_WORLD, 72) - process 0 [cli_0]: aborting job: application called MPI_Abort(MPI_COMM_WORLD, 72) - process 0 /Users/barrysmith/Src/petsc-dev/src/snes/examples/tutorials Possible problem with with ex5_5_ngmres_richardson, diffs above ========================================= 2,21c2,44 < 1 SNES Function norm 0.18208 < 2 SNES Function norm 0.0272102 < 3 SNES Function norm 0.00491305 < 4 SNES Function norm 0.000996383 < 5 SNES Function norm 0.000243372 < 6 SNES Function norm 6.53869e-05 < 7 SNES Function norm 1.84573e-05 < 8 SNES Function norm 5.30014e-06 < 9 SNES Function norm 1.5228e-06 < 10 SNES Function norm 4.34313e-07 < 11 SNES Function norm 1.22592e-07 < 12 SNES Function norm 3.42365e-08 < 13 SNES Function norm 9.46937e-09 < 14 SNES Function norm 2.59769e-09 < 15 SNES Function norm 7.078e-10 < 16 SNES Function norm 1.918e-10 < 17 SNES Function norm 5.173e-11 < 18 SNES Function norm 1.390e-11 < 19 SNES Function norm < 1.e-11 < 20 SNES Function norm < 1.e-11
[0]PETSC ERROR: --------------------- Error Message
[0]PETSC ERROR: Floating point exception! [0]PETSC ERROR: Vec entry at local location 14 is not-a-number or infinite at end of function: Parameter number 3! [0]PETSC ERROR:
[0]PETSC ERROR: Petsc Development HG revision: bd03fdcd3cf87c5b29ea28a5f4737ae936d9df04 HG Date: Sat Aug 11 20:22:42 2012 -0500 [0]PETSC ERROR: See docs/changes/index.html for recent updates. [0]PETSC ERROR: See docs/faq.html for hints about trouble shooting. [0]PETSC ERROR: See docs/index.html for manual pages. [0]PETSC ERROR:
[0]PETSC ERROR: ./ex5 on a arch-gnu named Barrys-MacBook-Pro.local by barrysmith Mon Aug 13 21:12:19 2012 [0]PETSC ERROR: Libraries linked from /Users/barrysmith/Src/petsc-dev/arch-gnu/lib [0]PETSC ERROR: Configure run at Sat Aug 11 20:25:02 2012 [0]PETSC ERROR: Configure options --download-blacs --download-fftw --download-hypre --download-libyaml --download-metis --download-ml --download-mpich --download-mumps --download-parmetis --download-ptscotch --download-scalapack --download-superlu --download-superlu_dist --download-triangle --download-yaml --with-ams-dir=/Users/barrysmith/Src/ams-dev --with-java --with-openmp --with-server --with-shared-libraries PETSC_ARCH=arch-gnu [0]PETSC ERROR:
[0]PETSC ERROR: SNESComputeFunction() line 1927 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: SNESLineSearchApply_Basic() line 41 in /Users/barrysmith/Src/petsc-dev/src/snes/linesearch/impls/basic/linesearchbasic.c [0]PETSC ERROR: SNESLineSearchApply() line 506 in /Users/barrysmith/Src/petsc-dev/src/snes/linesearch/interface/linesearch.c [0]PETSC ERROR: SNESSolve_NRichardson() line 181 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/richardson/snesrichardson.c [0]PETSC ERROR: SNESSolve() line 3570 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: SNESFASUpSmooth_Private() line 447 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESFASCycle_Multiplicative() line 695 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve_FAS() line 774 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve() line 3570 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: SNESFASCoarseCorrection() line 567 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESFASCycle_Multiplicative() line 694 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve_FAS() line 774 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve() line 3570 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: SNESFASCoarseCorrection() line 567 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESFASCycle_Multiplicative() line 694 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve_FAS() line 774 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve() line 3570 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: SNESFASCoarseCorrection() line 567 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESFASCycle_Multiplicative() line 694 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve_FAS() line 774 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve() line 3570 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: SNESFASCoarseCorrection() line 567 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESFASCycle_Multiplicative() line 694 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve_FAS() line 774 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve() line 3570 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: main() line 152 in src/snes/examples/tutorials/ex5.c application called MPI_Abort(MPI_COMM_WORLD, 72) - process 0 [cli_0]: aborting job: application called MPI_Abort(MPI_COMM_WORLD, 72) - process 0 /Users/barrysmith/Src/petsc-dev/src/snes/examples/tutorials Possible problem with with ex5_5_fas, diffs above ========================================= 2,11c2,46 < 1 SNES Function norm 0.156469 < 2 SNES Function norm 0.0115623 < 3 SNES Function norm 0.00145395 < 4 SNES Function norm 0.000151214 < 5 SNES Function norm 1.97033e-05 < 6 SNES Function norm 2.60149e-06 < 7 SNES Function norm 3.26556e-07 < 8 SNES Function norm 4.31521e-08 < 9 SNES Function norm 5.41224e-09 < 10 SNES Function norm 1.18135e-09
[0]PETSC ERROR: --------------------- Error Message
[0]PETSC ERROR: Floating point exception! [0]PETSC ERROR: Vec entry at local location 14 is not-a-number or infinite at end of function: Parameter number 3! [0]PETSC ERROR:
[0]PETSC ERROR: Petsc Development HG revision: bd03fdcd3cf87c5b29ea28a5f4737ae936d9df04 HG Date: Sat Aug 11 20:22:42 2012 -0500 [0]PETSC ERROR: See docs/changes/index.html for recent updates. [0]PETSC ERROR: See docs/faq.html for hints about trouble shooting. [0]PETSC ERROR: See docs/index.html for manual pages. [0]PETSC ERROR:
[0]PETSC ERROR: ./ex5 on a arch-gnu named Barrys-MacBook-Pro.local by barrysmith Mon Aug 13 21:12:20 2012 [0]PETSC ERROR: Libraries linked from /Users/barrysmith/Src/petsc-dev/arch-gnu/lib [0]PETSC ERROR: Configure run at Sat Aug 11 20:25:02 2012 [0]PETSC ERROR: Configure options --download-blacs --download-fftw --download-hypre --download-libyaml --download-metis --download-ml --download-mpich --download-mumps --download-parmetis --download-ptscotch --download-scalapack --download-superlu --download-superlu_dist --download-triangle --download-yaml --with-ams-dir=/Users/barrysmith/Src/ams-dev --with-java --with-openmp --with-server --with-shared-libraries PETSC_ARCH=arch-gnu [0]PETSC ERROR:
[0]PETSC ERROR: SNESComputeFunction() line 1927 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: SNESLineSearchApply_Basic() line 41 in /Users/barrysmith/Src/petsc-dev/src/snes/linesearch/impls/basic/linesearchbasic.c [0]PETSC ERROR: SNESLineSearchApply() line 506 in /Users/barrysmith/Src/petsc-dev/src/snes/linesearch/interface/linesearch.c [0]PETSC ERROR: SNESSolve_NRichardson() line 181 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/richardson/snesrichardson.c [0]PETSC ERROR: SNESSolve() line 3570 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: SNESFASUpSmooth_Private() line 447 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESFASCycle_Multiplicative() line 695 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve_FAS() line 774 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve() line 3570 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: SNESFASCoarseCorrection() line 567 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESFASCycle_Multiplicative() line 694 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve_FAS() line 774 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve() line 3570 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: SNESFASCoarseCorrection() line 567 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESFASCycle_Multiplicative() line 694 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve_FAS() line 774 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve() line 3570 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: SNESFASCoarseCorrection() line 567 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESFASCycle_Multiplicative() line 694 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve_FAS() line 774 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve() line 3570 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: SNESFASCoarseCorrection() line 567 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESFASCycle_Multiplicative() line 694 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve_FAS() line 774 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve() line 3570 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: SNESSolve_NGMRES() line 259 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/ngmres/snesngmres.c [0]PETSC ERROR: SNESSolve() line 3570 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: main() line 152 in src/snes/examples/tutorials/ex5.c application called MPI_Abort(MPI_COMM_WORLD, 72) - process 0 [cli_0]: aborting job: application called MPI_Abort(MPI_COMM_WORLD, 72) - process 0 /Users/barrysmith/Src/petsc-dev/src/snes/examples/tutorials Possible problem with with ex5_5_ngmres_fas, diffs above ========================================= 2,51c2,46 < 1 SNES Function norm 0.648993 < 2 SNES Function norm 0.518893 < 3 SNES Function norm 0.439196 < 4 SNES Function norm 0.386902 < 5 SNES Function norm 0.350239 < 6 SNES Function norm 0.322173 < 7 SNES Function norm 0.298913 < 8 SNES Function norm 0.279868 < 9 SNES Function norm 0.26322 < 10 SNES Function norm 0.249106 < 11 SNES Function norm 0.236341 < 12 SNES Function norm 0.225242 < 13 SNES Function norm 0.214976 < 14 SNES Function norm 0.205853 < 15 SNES Function norm 0.168755 < 16 SNES Function norm 0.150005 < 17 SNES Function norm 0.146453 < 18 SNES Function norm 0.122221 < 19 SNES Function norm 0.109397 < 20 SNES Function norm 0.107737 < 21 SNES Function norm 0.106311 < 22 SNES Function norm 0.0907226 < 23 SNES Function norm 0.0813505 < 24 SNES Function norm 0.0796973 < 25 SNES Function norm 0.0782834 < 26 SNES Function norm 0.0770559 < 27 SNES Function norm 0.0758003 < 28 SNES Function norm 0.0746744 < 29 SNES Function norm 0.0740446 < 30 SNES Function norm 0.061927 < 31 SNES Function norm 0.0549197 < 32 SNES Function norm 0.054583 < 33 SNES Function norm 0.0519673 < 34 SNES Function norm 0.0498744 < 35 SNES Function norm 0.0491159 < 36 SNES Function norm 0.0482318 < 37 SNES Function norm 0.047538 < 38 SNES Function norm 0.0468002 < 39 SNES Function norm 0.0461691 < 40 SNES Function norm 0.0459809 < 41 SNES Function norm 0.0420109 < 42 SNES Function norm 0.0389469 < 43 SNES Function norm 0.0383224 < 44 SNES Function norm 0.0378171 < 45 SNES Function norm 0.0375595 < 46 SNES Function norm 0.0373267 < 47 SNES Function norm 0.0370906 < 48 SNES Function norm 0.0368703 < 49 SNES Function norm 0.0366439 < 50 SNES Function norm 0.0364308
1 SNES Function norm 1.73715 2 SNES Function norm 44.1655 3 SNES Function norm 2.72388e+10 [0]PETSC ERROR: --------------------- Error Message
[0]PETSC ERROR: Floating point exception! [0]PETSC ERROR: Vec entry at local location 8 is not-a-number or infinite at end of function: Parameter number 3! [0]PETSC ERROR:
[0]PETSC ERROR: Petsc Development HG revision: bd03fdcd3cf87c5b29ea28a5f4737ae936d9df04 HG Date: Sat Aug 11 20:22:42 2012 -0500 [0]PETSC ERROR: See docs/changes/index.html for recent updates. [0]PETSC ERROR: See docs/faq.html for hints about trouble shooting. [0]PETSC ERROR: See docs/index.html for manual pages. [0]PETSC ERROR:
[0]PETSC ERROR: ./ex5 on a arch-gnu named Barrys-MacBook-Pro.local by barrysmith Mon Aug 13 21:12:21 2012 [0]PETSC ERROR: Libraries linked from /Users/barrysmith/Src/petsc-dev/arch-gnu/lib [0]PETSC ERROR: Configure run at Sat Aug 11 20:25:02 2012 [0]PETSC ERROR: Configure options --download-blacs --download-fftw --download-hypre --download-libyaml --download-metis --download-ml --download-mpich --download-mumps --download-parmetis --download-ptscotch --download-scalapack --download-superlu --download-superlu_dist --download-triangle --download-yaml --with-ams-dir=/Users/barrysmith/Src/ams-dev --with-java --with-openmp --with-server --with-shared-libraries PETSC_ARCH=arch-gnu [0]PETSC ERROR:
[0]PETSC ERROR: SNESComputeFunction() line 1927 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: SNESLineSearchApply_Basic() line 41 in /Users/barrysmith/Src/petsc-dev/src/snes/linesearch/impls/basic/linesearchbasic.c [0]PETSC ERROR: SNESLineSearchApply() line 506 in /Users/barrysmith/Src/petsc-dev/src/snes/linesearch/interface/linesearch.c [0]PETSC ERROR: SNESSolve_NRichardson() line 181 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/richardson/snesrichardson.c [0]PETSC ERROR: SNESSolve() line 3570 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: SNESFASDownSmooth_Private() line 420 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESFASCycle_Additive() line 638 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve_FAS() line 776 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve() line 3570 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: SNESFASCycle_Additive() line 635 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve_FAS() line 776 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve() line 3570 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: SNESFASCycle_Additive() line 635 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve_FAS() line 776 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve() line 3570 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: SNESFASCycle_Additive() line 635 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve_FAS() line 776 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve() line 3570 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: SNESFASCycle_Additive() line 635 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve_FAS() line 776 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve() line 3570 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: SNESFASCycle_Additive() line 635 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve_FAS() line 776 in /Users/barrysmith/Src/petsc-dev/src/snes/impls/fas/fas.c [0]PETSC ERROR: SNESSolve() line 3570 in /Users/barrysmith/Src/petsc-dev/src/snes/interface/snes.c [0]PETSC ERROR: main() line 152 in src/snes/examples/tutorials/ex5.c application called MPI_Abort(MPI_COMM_WORLD, 72) - process 0 [cli_0]: aborting job: application called MPI_Abort(MPI_COMM_WORLD, 72) - process 0 /Users/barrysmith/Src/petsc-dev/src/snes/examples/tutorials Possible problem with with ex5_5_fas_additive, diffs above