March 2011 - petsc-dev - mailman3.cels.anl.gov

Builder update
by Matthew Knepley 19 Mar '11

19 Mar '11

I fixed some bugs having to do with builds that break. I am using it for every day building now. I am experimenting with the Mercurial interface. I have a very preliminary thing going in config/builder2.py: python ./config/builder2.py stubs fortran python ./config/buidler2.py check python ./config/builder2.py help Matt -- What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead. -- Norbert Wiener

1 0

Re: [petsc-dev] Should pARMS converge in parallel?
by Jed Brown 18 Mar '11

18 Mar '11

On Fri, Mar 18, 2011 at 19:14, Jose E. Roman <jroman(a)dsic.upv.es> wrote: > I am attaching a patch that sets default values that should work > irrespective of the number of processors, even without flexible solvers. > > Jed, can you commit the changes? > Thanks, pushed.

1 0

Re: [petsc-dev] Should pARMS converge in parallel?
by Jose E. Roman 18 Mar '11

18 Mar '11

El 16/03/2011, a las 21:54, Jed Brown escribió: > On Wed, Mar 16, 2011 at 21:49, Jose E. Roman <jroman(a)dsic.upv.es> wrote: > Yes, I am aware of this. I added a note to the PCPARMS manpage stating that this preconditioner should be used with flexible methods (fgmres, gcr). > > Aha, I should have read it. Still seems like a common gotcha so defaulting to linear would be nice. I am attaching a patch that sets default values that should work irrespective of the number of processors, even without flexible solvers. Jed, can you commit the changes? Thanks. Jose

1 0

Re: [petsc-dev] Using PCFieldSplitSetIS
by Barry Smith 18 Mar '11

18 Mar '11

On Mar 18, 2011, at 6:23 AM, Thomas Witkowski wrote: > Barry Smith wrote: >> Did you get a chance to run as I requested with "Please run with -ksp_view and send the output." >> >> > Yes, the problem with the second iteration occurs only when I make use of bcgs for the outer iteration OK, then everything is FINE. BCGS applies the operator and preconditioner twice per iteration, so this is the expected behavior. Barry > (which is set in my code as the standard solver). When using richardson or gmres, I get the expected output. Here is the output for -ksp_type bcgs and -ksp_view > > Residual norms for fieldsplit_boundary_ solve. > 0 KSP Residual norm 1.238748554482e+02 > 1 KSP Residual norm 1.712708691574e+01 > 2 KSP Residual norm 5.537715643639e+00 > 3 KSP Residual norm 2.767431394864e+00 > 4 KSP Residual norm 2.308410861046e+00 > 5 KSP Residual norm 1.225474327957e+00 > 6 KSP Residual norm 4.705888493777e-01 > 7 KSP Residual norm 4.476449896581e-01 > 8 KSP Residual norm 1.859190943730e-01 > 9 KSP Residual norm 9.038347953900e-02 > 10 KSP Residual norm 7.545891428899e-02 > 11 KSP Residual norm 4.046165237615e-02 > 12 KSP Residual norm 1.499755811468e-02 > 13 KSP Residual norm 1.100288579779e-02 > 14 KSP Residual norm 4.530437449505e-03 > 15 KSP Residual norm 2.511112676997e-03 > 16 KSP Residual norm 1.425956836799e-03 > 17 KSP Residual norm 1.008189124008e-03 > 18 KSP Residual norm 4.759971096889e-04 > 19 KSP Residual norm 2.418445744584e-04 > 20 KSP Residual norm 1.345530122184e-04 > 21 KSP Residual norm 6.618130426631e-05 > 22 KSP Residual norm 3.502075214549e-05 > 23 KSP Residual norm 2.093145547362e-05 > 24 KSP Residual norm 1.426936785120e-05 > 25 KSP Residual norm 6.716866486925e-06 > 26 KSP Residual norm 2.938650130672e-06 > 27 KSP Residual norm 1.194333200607e-06 > 28 KSP Residual norm 8.117544753927e-07 > 29 KSP Residual norm 4.436526804864e-07 > 30 KSP Residual norm 2.619889310859e-07 > 31 KSP Residual norm 2.608365614137e-07 > 32 KSP Residual norm 2.502840136682e-07 > 33 KSP Residual norm 2.108068726014e-07 > 34 KSP Residual norm 1.190606661068e-07 > 35 KSP Residual norm 8.587022449664e-08 > 36 KSP Residual norm 2.657505256794e-08 > 37 KSP Residual norm 1.091795047578e-08 > 38 KSP Residual norm 5.622627482150e-09 > Linear solve converged due to CONVERGED_ATOL iterations 38 > 0 KSP preconditioned resid norm 1.039480141214e+02 true resid norm 2.318397033201e+03 ||r(i)||/||b|| 1.000000000000e+00 > Residual norms for fieldsplit_boundary_ solve. > 0 KSP Residual norm 1.238748554488e+02 > 1 KSP Residual norm 1.712708691920e+01 > 2 KSP Residual norm 5.537715644318e+00 > 3 KSP Residual norm 2.767431394929e+00 > 4 KSP Residual norm 2.308410861005e+00 > 5 KSP Residual norm 1.225474328165e+00 > 6 KSP Residual norm 4.705888492572e-01 > 7 KSP Residual norm 4.476449894826e-01 > 8 KSP Residual norm 1.859190943717e-01 > 9 KSP Residual norm 9.038347954447e-02 > 10 KSP Residual norm 7.545891428241e-02 > 11 KSP Residual norm 4.046165236351e-02 > 12 KSP Residual norm 1.499755811079e-02 > 13 KSP Residual norm 1.100288580023e-02 > 14 KSP Residual norm 4.530437448754e-03 > 15 KSP Residual norm 2.511112675547e-03 > 16 KSP Residual norm 1.425956832972e-03 > 17 KSP Residual norm 1.008189121211e-03 > 18 KSP Residual norm 4.759971083063e-04 > 19 KSP Residual norm 2.418445729000e-04 > 20 KSP Residual norm 1.345530095639e-04 > 21 KSP Residual norm 6.618130177611e-05 > 22 KSP Residual norm 3.502074795980e-05 > 23 KSP Residual norm 2.093145116748e-05 > 24 KSP Residual norm 1.426936277614e-05 > 25 KSP Residual norm 6.716863232176e-06 > 26 KSP Residual norm 2.938647588875e-06 > 27 KSP Residual norm 1.194330143586e-06 > 28 KSP Residual norm 8.117422448346e-07 > 29 KSP Residual norm 4.436425441849e-07 > 30 KSP Residual norm 2.619889078643e-07 > 31 KSP Residual norm 2.608368186135e-07 > 32 KSP Residual norm 2.502849238080e-07 > 33 KSP Residual norm 2.108123763958e-07 > 34 KSP Residual norm 1.190912989234e-07 > 35 KSP Residual norm 8.589705060827e-08 > 36 KSP Residual norm 2.657654667253e-08 > 37 KSP Residual norm 1.091743530704e-08 > 38 KSP Residual norm 5.623018769513e-09 > Linear solve converged due to CONVERGED_ATOL iterations 38 > Residual norms for fieldsplit_boundary_ solve. > 0 KSP Residual norm 5.628142396422e-09 > Linear solve converged due to CONVERGED_ATOL iterations 0 > 1 KSP preconditioned resid norm 2.834168769772e-08 true resid norm 5.737810813629e-09 ||r(i)||/||b|| 2.474904311669e-12 > Residual norms for fieldsplit_boundary_ solve. > 0 KSP Residual norm 5.626350752150e-09 > Linear solve converged due to CONVERGED_ATOL iterations 0 > Residual norms for fieldsplit_boundary_ solve. > 0 KSP Residual norm 5.628142396422e-09 > Linear solve converged due to CONVERGED_ATOL iterations 0 > 2 KSP preconditioned resid norm 2.834287716574e-08 true resid norm 1.921317696012e-06 ||r(i)||/||b|| 8.287267747921e-10 > Residual norms for fieldsplit_boundary_ solve. > 0 KSP Residual norm 6.360593934279e-07 > 1 KSP Residual norm 6.207657513778e-07 > 2 KSP Residual norm 4.595521952584e-07 > 3 KSP Residual norm 2.353791066544e-07 > 4 KSP Residual norm 1.659055771510e-07 > 5 KSP Residual norm 1.057381480368e-07 > 6 KSP Residual norm 2.733159212163e-08 > 7 KSP Residual norm 1.685966550943e-08 > 8 KSP Residual norm 5.250226264235e-09 > Linear solve converged due to CONVERGED_ATOL iterations 8 > Residual norms for fieldsplit_boundary_ solve. > 0 KSP Residual norm 5.314638497757e-10 > Linear solve converged due to CONVERGED_ATOL iterations 0 > 3 KSP preconditioned resid norm 2.418607617684e-09 true resid norm 1.943729846844e-06 ||r(i)||/||b|| 8.383938639538e-10 > KSP Object: > type: bcgs > maximum iterations=10000, initial guess is zero > tolerances: relative=0, absolute=1e-08, divergence=10000 > left preconditioning > using PRECONDITIONED norm type for convergence test > PC Object: > type: fieldsplit > FieldSplit with Schur preconditioner, blocksize = -1, factorization FULL > Split info: > Split number 0 Defined by IS > Split number 1 Defined by IS > KSP solver for A00 block > KSP Object: (fieldsplit_interior_) type: preonly > maximum iterations=10000, initial guess is zero > tolerances: relative=1e-05, absolute=1e-50, divergence=10000 > left preconditioning > using PRECONDITIONED norm type for convergence test > PC Object: (fieldsplit_interior_) type: bjacobi > block Jacobi: number of blocks = 2 > Local solve is same for all blocks, in the following KSP and PC objects: > KSP Object: (fieldsplit_interior_sub_) type: preonly > maximum iterations=10000, initial guess is zero > tolerances: relative=1e-05, absolute=1e-50, divergence=10000 > left preconditioning > using PRECONDITIONED norm type for convergence test > PC Object: (fieldsplit_interior_sub_) type: lu > LU: out-of-place factorization > tolerance for zero pivot 1e-12 > matrix ordering: nd > factor fill ratio given 0, needed 0 > Factored matrix follows: > Matrix Object: type: seqaij > rows=12336, cols=12336 > package used to perform factorization: umfpack > total: nonzeros=0, allocated nonzeros=0 > total number of mallocs used during MatSetValues calls =0 > not using I-node routines > UMFPACK run parameters: > Control[UMFPACK_PRL]: 1 > Control[UMFPACK_STRATEGY]: 0 > Control[UMFPACK_DENSE_COL]: 0.2 > Control[UMFPACK_DENSE_ROW]: 0.2 > Control[UMFPACK_AMD_DENSE]: 10 > Control[UMFPACK_BLOCK_SIZE]: 32 > Control[UMFPACK_2BY2_TOLERANCE]: 0.01 > Control[UMFPACK_FIXQ]: 0 > Control[UMFPACK_AGGRESSIVE]: 1 > Control[UMFPACK_PIVOT_TOLERANCE]: 0.1 > Control[UMFPACK_SYM_PIVOT_TOLERANCE]: 0.001 > Control[UMFPACK_SCALE]: 1 > Control[UMFPACK_ALLOC_INIT]: 0.7 > Control[UMFPACK_DROPTOL]: 0 > Control[UMFPACK_IRSTEP]: 0 > UMFPACK default matrix ordering is used (not the PETSc matrix ordering) > linear system matrix = precond matrix: > Matrix Object: type: seqaij > rows=12336, cols=12336 > total: nonzeros=173608, allocated nonzeros=173608 > total number of mallocs used during MatSetValues calls =0 > not using I-node routines > linear system matrix = precond matrix: > Matrix Object: type: mpiaij > rows=24672, cols=24672 > total: nonzeros=347216, allocated nonzeros=347216 > total number of mallocs used during MatSetValues calls =0 > not using I-node (on process 0) routines > KSP solver for S = A11 - A10 inv(A00) A01 > KSP Object: (fieldsplit_boundary_) type: gmres > GMRES: restart=30, using Classical (unmodified) Gram-Schmidt Orthogonalization with no iterative refinement > GMRES: happy breakdown tolerance 1e-30 > maximum iterations=10000, initial guess is zero > tolerances: relative=1e-50, absolute=1e-08, divergence=10000 > left preconditioning > using PRECONDITIONED norm type for convergence test > PC Object: (fieldsplit_boundary_) type: bjacobi > block Jacobi: number of blocks = 2 > Local solve is same for all blocks, in the following KSP and PC objects: > KSP Object: (fieldsplit_boundary_sub_) type: preonly > maximum iterations=10000, initial guess is zero > tolerances: relative=1e-05, absolute=1e-50, divergence=10000 > left preconditioning > using PRECONDITIONED norm type for convergence test > PC Object: (fieldsplit_boundary_sub_) type: ilu > ILU: out-of-place factorization > 0 levels of fill > tolerance for zero pivot 1e-12 > using diagonal shift to prevent zero pivot > matrix ordering: natural > factor fill ratio given 1, needed 1 > Factored matrix follows: > Matrix Object: type: seqaij > rows=0, cols=0 > package used to perform factorization: petsc > total: nonzeros=0, allocated nonzeros=0 > total number of mallocs used during MatSetValues calls =0 > not using I-node routines > linear system matrix = precond matrix: > Matrix Object: type: seqaij > rows=0, cols=0 > total: nonzeros=0, allocated nonzeros=0 > total number of mallocs used during MatSetValues calls =0 > not using I-node routines > linear system matrix followed by preconditioner matrix: > Matrix Object: type: schurcomplement > rows=291, cols=291 > Schur complement A11 - A10 inv(A00) A01 > A11 > Matrix Object: type: mpiaij > rows=291, cols=291 > total: nonzeros=1831, allocated nonzeros=1831 > total number of mallocs used during MatSetValues calls =0 > not using I-node (on process 0) routines > A10 > Matrix Object: type: mpiaij > rows=291, cols=24672 > total: nonzeros=2568, allocated nonzeros=2568 > total number of mallocs used during MatSetValues calls =0 > not using I-node (on process 0) routines > KSP of A00 > KSP Object: (fieldsplit_interior_) type: preonly > maximum iterations=10000, initial guess is zero > tolerances: relative=1e-05, absolute=1e-50, divergence=10000 > left preconditioning > using PRECONDITIONED norm type for convergence test > PC Object: (fieldsplit_interior_) type: bjacobi > block Jacobi: number of blocks = 2 > Local solve is same for all blocks, in the following KSP and PC objects: > KSP Object: (fieldsplit_interior_sub_) type: preonly > maximum iterations=10000, initial guess is zero > tolerances: relative=1e-05, absolute=1e-50, divergence=10000 > left preconditioning > using PRECONDITIONED norm type for convergence test > PC Object: (fieldsplit_interior_sub_) type: lu > LU: out-of-place factorization > tolerance for zero pivot 1e-12 > matrix ordering: nd > factor fill ratio given 0, needed 0 > Factored matrix follows: > Matrix Object: type: seqaij > rows=12336, cols=12336 > package used to perform factorization: umfpack > total: nonzeros=0, allocated nonzeros=0 > total number of mallocs used during MatSetValues calls =0 > not using I-node routines > UMFPACK run parameters: > Control[UMFPACK_PRL]: 1 > Control[UMFPACK_STRATEGY]: 0 > Control[UMFPACK_DENSE_COL]: 0.2 > Control[UMFPACK_DENSE_ROW]: 0.2 > Control[UMFPACK_AMD_DENSE]: 10 > Control[UMFPACK_BLOCK_SIZE]: 32 > Control[UMFPACK_2BY2_TOLERANCE]: 0.01 > Control[UMFPACK_FIXQ]: 0 > Control[UMFPACK_AGGRESSIVE]: 1 > Control[UMFPACK_PIVOT_TOLERANCE]: 0.1 > Control[UMFPACK_SYM_PIVOT_TOLERANCE]: 0.001 > Control[UMFPACK_SCALE]: 1 > Control[UMFPACK_ALLOC_INIT]: 0.7 > Control[UMFPACK_DROPTOL]: 0 > Control[UMFPACK_IRSTEP]: 0 > UMFPACK default matrix ordering is used (not the PETSc matrix ordering) > linear system matrix = precond matrix: > Matrix Object: type: seqaij > rows=12336, cols=12336 > total: nonzeros=173608, allocated nonzeros=173608 > total number of mallocs used during MatSetValues calls =0 > not using I-node routines > linear system matrix = precond matrix: > Matrix Object: type: mpiaij > rows=24672, cols=24672 > total: nonzeros=347216, allocated nonzeros=347216 > total number of mallocs used during MatSetValues calls =0 > not using I-node (on process 0) routines > A01 > Matrix Object: type: mpiaij > rows=24672, cols=291 > total: nonzeros=2568, allocated nonzeros=2568 > total number of mallocs used during MatSetValues calls =0 > using I-node (on process 0) routines: found 2468 nodes, limit used is 5 > Matrix Object: type: mpiaij > rows=291, cols=291 > total: nonzeros=1831, allocated nonzeros=1831 > total number of mallocs used during MatSetValues calls =0 > not using I-node (on process 0) routines > linear system matrix = precond matrix: > Matrix Object: type: mpiaij > rows=24963, cols=24963 > total: nonzeros=354183, allocated nonzeros=356014 > total number of mallocs used during MatSetValues calls =0 > not using I-node (on process 0) routines > > > Thomas > >> We are eager to determine the problem. >> >> Barry >> >> On Mar 16, 2011, at 11:03 AM, Barry Smith wrote: >> >> >>> On Mar 16, 2011, at 8:57 AM, Thomas Witkowski wrote: >>> >>> -pc_fieldsplit_type schur -fieldsplit_interior_ksp_type preonly -fieldsplit_interior_pc_type bjacobi -fieldsplit_interior_sub_pc_type lu -fieldsplit_boundary_ksp_monitor -ksp_monitor_true_residual >>> >>> >>>> Residual norms for fieldsplit_boundary_ solve. >>>> 0 KSP Residual norm 1.790059331071e-04 >>>> ..... >>>> 18 KSP Residual norm 1.593454221996e-09 >>>> 0 KSP preconditioned resid norm 5.745043818120e-01 true resid norm 1.584249437360e-01 ||r(i)||/||b|| 1.000000000000e+00 >>> This is the norms on the outer iteration variables >>> >>>> Residual norms for fieldsplit_boundary_ solve. >>>> 0 KSP Residual norm 1.790059331000e-04 >>>> >>> This is the norms on the Schur complement iteration >>> >>>> .... >>>> 18 KSP Residual norm 1.593449602302e-09 >>>> >>> It is unclear to me why it starts up another solve here, starting basically where it left off. I think it should just kick out to print the norm of the residual of the outer iteration. >>> >>> >>>> Residual norms for fieldsplit_boundary_ solve. >>>> 0 KSP Residual norm 1.593449603155e-09 >>>> ... >>>> 18 KSP Residual norm 1.335744434252e-14 >>>> 1 KSP preconditioned resid norm 2.608069232839e-13 true resid norm 1.449869994655e-13 ||r(i)||/||b|| 9.151778504469e-13 >>>> >>>> >>> Are you running with petsc-dev? >>> >>> Please run with -ksp_view and send the output. >>> >>> When I run tutorials/multiphysics/mp.c with the options ./mp -couple -snes_monitor_short -pc_type fieldsplit -ksp_monitor -pc_fieldsplit_type schur -fieldsplit_ksp_monitor -fieldsplit_1_ksp_type fgmres -fieldsplit_0_ksp_type gmres -snes_view I do not see the "double" iteration business. >>> Barry >>> >>> >>> >>> >>>> So, are there now two or one outer iterations? >>>> >>>> Thomas >>>> >>>> >>>> >>>> >>>> Matthew Knepley wrote: >>>> >>>>> On Wed, Mar 16, 2011 at 8:27 AM, Thomas Witkowski <thomas.witkowski(a)tu-dresden.de <mailto:[email protected]>> wrote: >>>>> >>>>> Jed Brown wrote: >>>>> >>>>> On Wed, Mar 16, 2011 at 07:37, Thomas Witkowski >>>>> <thomas.witkowski(a)tu-dresden.de >>>>> <mailto:[email protected]> >>>>> <mailto:[email protected] >>>>> <mailto:[email protected]>>> wrote: >>>>> >>>>> Thanks for explanations! It works fine in my code. But I >>>>> have two >>>>> questions about it, maybe you can help me with them: >>>>> - To the first, is the LU factorization on block A_00 done >>>>> only once? >>>>> >>>>> >>>>> Yes, one way to confirm this is to run with -log_summary and >>>>> check MatLUFactor{Sym,Num}. >>>>> - I have run the code with -fieldsplit_1_ksp_monitor to get >>>>> some >>>>> more information about the internal solves. I expected to get >>>>> information about one iterative solver (for solving the Schur >>>>> complement system), but I got three, all of them need around 20 >>>>> iterations for my example. Could you explain to me what is >>>>> actually solved there? >>>>> >>>>> >>>>> I'm going to guess that you still have an outer KSP that (in >>>>> the global norm, rather than the partitioned norm used inside >>>>> of splits) has a tighter tolerance, therefore it takes a few >>>>> outer iterations. If you use loose inner tolerances then the >>>>> preconditioner becomes nonlinear and you'll need to use FGMRES >>>>> for the outer. When in doubt, run with -ksp_view and show us >>>>> the results if you don't understand. Additionally, monitoring >>>>> inner solves separately can be useful, e.g. >>>>> -fieldsplit_0_ksp_converged_reason -fieldsplit_1_ksp_monitor >>>>> -ksp_monitor_true_residual. >>>>> >>>>> Okay, I run my code with the options "-pc_fieldsplit_type schur >>>>> -fieldsplit_interior_ksp_type preonly -fieldsplit_interior_pc_type >>>>> bjacobi -fieldsplit_interior_sub_pc_type lu >>>>> -fieldsplit_boundary_ksp_monitor -ksp_monitor_true_residual >>>>> -fieldsplit_interior_ksp_converged_reason". The splits are named >>>>> "interior" and "boundary". The ksp output is as follows: >>>>> >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> Residual norms for fieldsplit_boundary_ solve. >>>>> 0 KSP Residual norm 1.790059331071e-04 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 1 KSP Residual norm 1.237356212928e-04 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 2 KSP Residual norm 7.952220245101e-05 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 3 KSP Residual norm 3.502858665398e-05 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 4 KSP Residual norm 1.601085190129e-05 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 5 KSP Residual norm 8.491161243057e-06 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 6 KSP Residual norm 4.778227395989e-06 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 7 KSP Residual norm 2.571919352633e-06 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 8 KSP Residual norm 1.353979940120e-06 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 9 KSP Residual norm 7.408377337496e-07 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 10 KSP Residual norm 3.810694345834e-07 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 11 KSP Residual norm 1.955889542056e-07 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 12 KSP Residual norm 9.938906113920e-08 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 13 KSP Residual norm 4.893445675773e-08 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 14 KSP Residual norm 2.395128458062e-08 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 15 KSP Residual norm 1.2464425896 <tel:1.2464425896>57e-08 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 16 KSP Residual norm 6.316454504022e-09 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 17 KSP Residual norm 3.088668836241e-09 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 18 KSP Residual norm 1.593454221996e-09 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> [0] Petsc-Iteration 0: 0.574504 >>>>> 0 KSP preconditioned resid norm 5.745043818120e-01 true resid >>>>> norm 1.584249437360e-01 ||r(i)||/||b|| 1.000000000000e+00 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> Residual norms for fieldsplit_boundary_ solve. >>>>> 0 KSP Residual norm 1.790059331000e-04 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 1 KSP Residual norm 1.237356237744e-04 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 2 KSP Residual norm 7.952220078415e-05 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 3 KSP Residual norm 3.502859285561e-05 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 4 KSP Residual norm 1.601086485810e-05 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 5 KSP Residual norm 8.491169384185e-06 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 6 KSP Residual norm 4.778229157872e-06 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 7 KSP Residual norm 2.571917112191e-06 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 8 KSP Residual norm 1.353977280183e-06 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 9 KSP Residual norm 7.408352317360e-07 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 10 KSP Residual norm 3.810710583336e-07 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 11 KSP Residual norm 1.955898169394e-07 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 12 KSP Residual norm 9.938892788465e-08 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 13 KSP Residual norm 4.893428546840e-08 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 14 KSP Residual norm 2.395120857135e-08 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 15 KSP Residual norm 1.2464367927 <tel:1.2464367927>84e-08 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 16 KSP Residual norm 6.316409779118e-09 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 17 KSP Residual norm 3.088649355374e-09 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 18 KSP Residual norm 1.593449602302e-09 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> Residual norms for fieldsplit_boundary_ solve. >>>>> 0 KSP Residual norm 1.593449603155e-09 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 1 KSP Residual norm 1.011857676662e-09 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 2 KSP Residual norm 5.660892669788e-10 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 3 KSP Residual norm 3.046799343903e-10 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 4 KSP Residual norm 1.6004713993 <tel:1.6004713993>29e-10 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 5 KSP Residual norm 8.083216601016e-11 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 6 KSP Residual norm 4.308671648345e-11 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 7 KSP Residual norm 2.381959817139e-11 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 8 KSP Residual norm 1.264839790114e-11 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 9 KSP Residual norm 6.435098853282e-12 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 10 KSP Residual norm 3.184769579797e-12 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 11 KSP Residual norm 1.5022019430 <tel:1.5022019430>16e-12 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 12 KSP Residual norm 7.099486208425e-13 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 13 KSP Residual norm 3.443222176388e-13 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 14 KSP Residual norm 1.6478434989 <tel:1.6478434989>12e-13 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 15 KSP Residual norm 8.208508173926e-14 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 16 KSP Residual norm 4.376604355287e-14 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 17 KSP Residual norm 2.596069152755e-14 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 18 KSP Residual norm 1.335744434252e-14 >>>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>>> 1 KSP preconditioned resid norm 2.608069232839e-13 true resid >>>>> norm 1.449869994655e-13 ||r(i)||/||b|| 9.151778504469e-13 >>>>> >>>>> I have no idea how to interpret this output! Could you help me >>>>> with it? >>>>> >>>>> >>>>> Get rid of -fieldsplit_interior_ksp_converged_reason. It is confusing things. Then you will see >>>>> the outer iteration and the inner boundary iteration which is indented. >>>>> >>>>> Matt >>>>> >>>>> >>>>> Thomas >>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead. >>>>> -- Norbert Wiener >>>>> >> >> >> >> >

1 0

Re: [petsc-dev] Using PCFieldSplitSetIS
by Thomas Witkowski 18 Mar '11

18 Mar '11

Barry Smith wrote: > Did you get a chance to run as I requested with "Please run with -ksp_view and send the output." > > Yes, the problem with the second iteration occurs only when I make use of bcgs for the outer iteration (which is set in my code as the standard solver). When using richardson or gmres, I get the expected output. Here is the output for -ksp_type bcgs and -ksp_view Residual norms for fieldsplit_boundary_ solve. 0 KSP Residual norm 1.238748554482e+02 1 KSP Residual norm 1.712708691574e+01 2 KSP Residual norm 5.537715643639e+00 3 KSP Residual norm 2.767431394864e+00 4 KSP Residual norm 2.308410861046e+00 5 KSP Residual norm 1.225474327957e+00 6 KSP Residual norm 4.705888493777e-01 7 KSP Residual norm 4.476449896581e-01 8 KSP Residual norm 1.859190943730e-01 9 KSP Residual norm 9.038347953900e-02 10 KSP Residual norm 7.545891428899e-02 11 KSP Residual norm 4.046165237615e-02 12 KSP Residual norm 1.499755811468e-02 13 KSP Residual norm 1.100288579779e-02 14 KSP Residual norm 4.530437449505e-03 15 KSP Residual norm 2.511112676997e-03 16 KSP Residual norm 1.425956836799e-03 17 KSP Residual norm 1.008189124008e-03 18 KSP Residual norm 4.759971096889e-04 19 KSP Residual norm 2.418445744584e-04 20 KSP Residual norm 1.345530122184e-04 21 KSP Residual norm 6.618130426631e-05 22 KSP Residual norm 3.502075214549e-05 23 KSP Residual norm 2.093145547362e-05 24 KSP Residual norm 1.426936785120e-05 25 KSP Residual norm 6.716866486925e-06 26 KSP Residual norm 2.938650130672e-06 27 KSP Residual norm 1.194333200607e-06 28 KSP Residual norm 8.117544753927e-07 29 KSP Residual norm 4.436526804864e-07 30 KSP Residual norm 2.619889310859e-07 31 KSP Residual norm 2.608365614137e-07 32 KSP Residual norm 2.502840136682e-07 33 KSP Residual norm 2.108068726014e-07 34 KSP Residual norm 1.190606661068e-07 35 KSP Residual norm 8.587022449664e-08 36 KSP Residual norm 2.657505256794e-08 37 KSP Residual norm 1.091795047578e-08 38 KSP Residual norm 5.622627482150e-09 Linear solve converged due to CONVERGED_ATOL iterations 38 0 KSP preconditioned resid norm 1.039480141214e+02 true resid norm 2.318397033201e+03 ||r(i)||/||b|| 1.000000000000e+00 Residual norms for fieldsplit_boundary_ solve. 0 KSP Residual norm 1.238748554488e+02 1 KSP Residual norm 1.712708691920e+01 2 KSP Residual norm 5.537715644318e+00 3 KSP Residual norm 2.767431394929e+00 4 KSP Residual norm 2.308410861005e+00 5 KSP Residual norm 1.225474328165e+00 6 KSP Residual norm 4.705888492572e-01 7 KSP Residual norm 4.476449894826e-01 8 KSP Residual norm 1.859190943717e-01 9 KSP Residual norm 9.038347954447e-02 10 KSP Residual norm 7.545891428241e-02 11 KSP Residual norm 4.046165236351e-02 12 KSP Residual norm 1.499755811079e-02 13 KSP Residual norm 1.100288580023e-02 14 KSP Residual norm 4.530437448754e-03 15 KSP Residual norm 2.511112675547e-03 16 KSP Residual norm 1.425956832972e-03 17 KSP Residual norm 1.008189121211e-03 18 KSP Residual norm 4.759971083063e-04 19 KSP Residual norm 2.418445729000e-04 20 KSP Residual norm 1.345530095639e-04 21 KSP Residual norm 6.618130177611e-05 22 KSP Residual norm 3.502074795980e-05 23 KSP Residual norm 2.093145116748e-05 24 KSP Residual norm 1.426936277614e-05 25 KSP Residual norm 6.716863232176e-06 26 KSP Residual norm 2.938647588875e-06 27 KSP Residual norm 1.194330143586e-06 28 KSP Residual norm 8.117422448346e-07 29 KSP Residual norm 4.436425441849e-07 30 KSP Residual norm 2.619889078643e-07 31 KSP Residual norm 2.608368186135e-07 32 KSP Residual norm 2.502849238080e-07 33 KSP Residual norm 2.108123763958e-07 34 KSP Residual norm 1.190912989234e-07 35 KSP Residual norm 8.589705060827e-08 36 KSP Residual norm 2.657654667253e-08 37 KSP Residual norm 1.091743530704e-08 38 KSP Residual norm 5.623018769513e-09 Linear solve converged due to CONVERGED_ATOL iterations 38 Residual norms for fieldsplit_boundary_ solve. 0 KSP Residual norm 5.628142396422e-09 Linear solve converged due to CONVERGED_ATOL iterations 0 1 KSP preconditioned resid norm 2.834168769772e-08 true resid norm 5.737810813629e-09 ||r(i)||/||b|| 2.474904311669e-12 Residual norms for fieldsplit_boundary_ solve. 0 KSP Residual norm 5.626350752150e-09 Linear solve converged due to CONVERGED_ATOL iterations 0 Residual norms for fieldsplit_boundary_ solve. 0 KSP Residual norm 5.628142396422e-09 Linear solve converged due to CONVERGED_ATOL iterations 0 2 KSP preconditioned resid norm 2.834287716574e-08 true resid norm 1.921317696012e-06 ||r(i)||/||b|| 8.287267747921e-10 Residual norms for fieldsplit_boundary_ solve. 0 KSP Residual norm 6.360593934279e-07 1 KSP Residual norm 6.207657513778e-07 2 KSP Residual norm 4.595521952584e-07 3 KSP Residual norm 2.353791066544e-07 4 KSP Residual norm 1.659055771510e-07 5 KSP Residual norm 1.057381480368e-07 6 KSP Residual norm 2.733159212163e-08 7 KSP Residual norm 1.685966550943e-08 8 KSP Residual norm 5.250226264235e-09 Linear solve converged due to CONVERGED_ATOL iterations 8 Residual norms for fieldsplit_boundary_ solve. 0 KSP Residual norm 5.314638497757e-10 Linear solve converged due to CONVERGED_ATOL iterations 0 3 KSP preconditioned resid norm 2.418607617684e-09 true resid norm 1.943729846844e-06 ||r(i)||/||b|| 8.383938639538e-10 KSP Object: type: bcgs maximum iterations=10000, initial guess is zero tolerances: relative=0, absolute=1e-08, divergence=10000 left preconditioning using PRECONDITIONED norm type for convergence test PC Object: type: fieldsplit FieldSplit with Schur preconditioner, blocksize = -1, factorization FULL Split info: Split number 0 Defined by IS Split number 1 Defined by IS KSP solver for A00 block KSP Object: (fieldsplit_interior_) type: preonly maximum iterations=10000, initial guess is zero tolerances: relative=1e-05, absolute=1e-50, divergence=10000 left preconditioning using PRECONDITIONED norm type for convergence test PC Object: (fieldsplit_interior_) type: bjacobi block Jacobi: number of blocks = 2 Local solve is same for all blocks, in the following KSP and PC objects: KSP Object: (fieldsplit_interior_sub_) type: preonly maximum iterations=10000, initial guess is zero tolerances: relative=1e-05, absolute=1e-50, divergence=10000 left preconditioning using PRECONDITIONED norm type for convergence test PC Object: (fieldsplit_interior_sub_) type: lu LU: out-of-place factorization tolerance for zero pivot 1e-12 matrix ordering: nd factor fill ratio given 0, needed 0 Factored matrix follows: Matrix Object: type: seqaij rows=12336, cols=12336 package used to perform factorization: umfpack total: nonzeros=0, allocated nonzeros=0 total number of mallocs used during MatSetValues calls =0 not using I-node routines UMFPACK run parameters: Control[UMFPACK_PRL]: 1 Control[UMFPACK_STRATEGY]: 0 Control[UMFPACK_DENSE_COL]: 0.2 Control[UMFPACK_DENSE_ROW]: 0.2 Control[UMFPACK_AMD_DENSE]: 10 Control[UMFPACK_BLOCK_SIZE]: 32 Control[UMFPACK_2BY2_TOLERANCE]: 0.01 Control[UMFPACK_FIXQ]: 0 Control[UMFPACK_AGGRESSIVE]: 1 Control[UMFPACK_PIVOT_TOLERANCE]: 0.1 Control[UMFPACK_SYM_PIVOT_TOLERANCE]: 0.001 Control[UMFPACK_SCALE]: 1 Control[UMFPACK_ALLOC_INIT]: 0.7 Control[UMFPACK_DROPTOL]: 0 Control[UMFPACK_IRSTEP]: 0 UMFPACK default matrix ordering is used (not the PETSc matrix ordering) linear system matrix = precond matrix: Matrix Object: type: seqaij rows=12336, cols=12336 total: nonzeros=173608, allocated nonzeros=173608 total number of mallocs used during MatSetValues calls =0 not using I-node routines linear system matrix = precond matrix: Matrix Object: type: mpiaij rows=24672, cols=24672 total: nonzeros=347216, allocated nonzeros=347216 total number of mallocs used during MatSetValues calls =0 not using I-node (on process 0) routines KSP solver for S = A11 - A10 inv(A00) A01 KSP Object: (fieldsplit_boundary_) type: gmres GMRES: restart=30, using Classical (unmodified) Gram-Schmidt Orthogonalization with no iterative refinement GMRES: happy breakdown tolerance 1e-30 maximum iterations=10000, initial guess is zero tolerances: relative=1e-50, absolute=1e-08, divergence=10000 left preconditioning using PRECONDITIONED norm type for convergence test PC Object: (fieldsplit_boundary_) type: bjacobi block Jacobi: number of blocks = 2 Local solve is same for all blocks, in the following KSP and PC objects: KSP Object: (fieldsplit_boundary_sub_) type: preonly maximum iterations=10000, initial guess is zero tolerances: relative=1e-05, absolute=1e-50, divergence=10000 left preconditioning using PRECONDITIONED norm type for convergence test PC Object: (fieldsplit_boundary_sub_) type: ilu ILU: out-of-place factorization 0 levels of fill tolerance for zero pivot 1e-12 using diagonal shift to prevent zero pivot matrix ordering: natural factor fill ratio given 1, needed 1 Factored matrix follows: Matrix Object: type: seqaij rows=0, cols=0 package used to perform factorization: petsc total: nonzeros=0, allocated nonzeros=0 total number of mallocs used during MatSetValues calls =0 not using I-node routines linear system matrix = precond matrix: Matrix Object: type: seqaij rows=0, cols=0 total: nonzeros=0, allocated nonzeros=0 total number of mallocs used during MatSetValues calls =0 not using I-node routines linear system matrix followed by preconditioner matrix: Matrix Object: type: schurcomplement rows=291, cols=291 Schur complement A11 - A10 inv(A00) A01 A11 Matrix Object: type: mpiaij rows=291, cols=291 total: nonzeros=1831, allocated nonzeros=1831 total number of mallocs used during MatSetValues calls =0 not using I-node (on process 0) routines A10 Matrix Object: type: mpiaij rows=291, cols=24672 total: nonzeros=2568, allocated nonzeros=2568 total number of mallocs used during MatSetValues calls =0 not using I-node (on process 0) routines KSP of A00 KSP Object: (fieldsplit_interior_) type: preonly maximum iterations=10000, initial guess is zero tolerances: relative=1e-05, absolute=1e-50, divergence=10000 left preconditioning using PRECONDITIONED norm type for convergence test PC Object: (fieldsplit_interior_) type: bjacobi block Jacobi: number of blocks = 2 Local solve is same for all blocks, in the following KSP and PC objects: KSP Object: (fieldsplit_interior_sub_) type: preonly maximum iterations=10000, initial guess is zero tolerances: relative=1e-05, absolute=1e-50, divergence=10000 left preconditioning using PRECONDITIONED norm type for convergence test PC Object: (fieldsplit_interior_sub_) type: lu LU: out-of-place factorization tolerance for zero pivot 1e-12 matrix ordering: nd factor fill ratio given 0, needed 0 Factored matrix follows: Matrix Object: type: seqaij rows=12336, cols=12336 package used to perform factorization: umfpack total: nonzeros=0, allocated nonzeros=0 total number of mallocs used during MatSetValues calls =0 not using I-node routines UMFPACK run parameters: Control[UMFPACK_PRL]: 1 Control[UMFPACK_STRATEGY]: 0 Control[UMFPACK_DENSE_COL]: 0.2 Control[UMFPACK_DENSE_ROW]: 0.2 Control[UMFPACK_AMD_DENSE]: 10 Control[UMFPACK_BLOCK_SIZE]: 32 Control[UMFPACK_2BY2_TOLERANCE]: 0.01 Control[UMFPACK_FIXQ]: 0 Control[UMFPACK_AGGRESSIVE]: 1 Control[UMFPACK_PIVOT_TOLERANCE]: 0.1 Control[UMFPACK_SYM_PIVOT_TOLERANCE]: 0.001 Control[UMFPACK_SCALE]: 1 Control[UMFPACK_ALLOC_INIT]: 0.7 Control[UMFPACK_DROPTOL]: 0 Control[UMFPACK_IRSTEP]: 0 UMFPACK default matrix ordering is used (not the PETSc matrix ordering) linear system matrix = precond matrix: Matrix Object: type: seqaij rows=12336, cols=12336 total: nonzeros=173608, allocated nonzeros=173608 total number of mallocs used during MatSetValues calls =0 not using I-node routines linear system matrix = precond matrix: Matrix Object: type: mpiaij rows=24672, cols=24672 total: nonzeros=347216, allocated nonzeros=347216 total number of mallocs used during MatSetValues calls =0 not using I-node (on process 0) routines A01 Matrix Object: type: mpiaij rows=24672, cols=291 total: nonzeros=2568, allocated nonzeros=2568 total number of mallocs used during MatSetValues calls =0 using I-node (on process 0) routines: found 2468 nodes, limit used is 5 Matrix Object: type: mpiaij rows=291, cols=291 total: nonzeros=1831, allocated nonzeros=1831 total number of mallocs used during MatSetValues calls =0 not using I-node (on process 0) routines linear system matrix = precond matrix: Matrix Object: type: mpiaij rows=24963, cols=24963 total: nonzeros=354183, allocated nonzeros=356014 total number of mallocs used during MatSetValues calls =0 not using I-node (on process 0) routines Thomas > We are eager to determine the problem. > > Barry > > > On Mar 16, 2011, at 11:03 AM, Barry Smith wrote: > > >> On Mar 16, 2011, at 8:57 AM, Thomas Witkowski wrote: >> >> -pc_fieldsplit_type schur -fieldsplit_interior_ksp_type preonly -fieldsplit_interior_pc_type bjacobi -fieldsplit_interior_sub_pc_type lu -fieldsplit_boundary_ksp_monitor -ksp_monitor_true_residual >> >> >> >>> Residual norms for fieldsplit_boundary_ solve. >>> 0 KSP Residual norm 1.790059331071e-04 >>> ..... >>> 18 KSP Residual norm 1.593454221996e-09 >>> 0 KSP preconditioned resid norm 5.745043818120e-01 true resid norm 1.584249437360e-01 ||r(i)||/||b|| 1.000000000000e+00 >>> >> This is the norms on the outer iteration variables >> >>> Residual norms for fieldsplit_boundary_ solve. >>> 0 KSP Residual norm 1.790059331000e-04 >>> >> This is the norms on the Schur complement iteration >> >>> .... >>> 18 KSP Residual norm 1.593449602302e-09 >>> >> It is unclear to me why it starts up another solve here, starting basically where it left off. I think it should just kick out to print the norm of the residual of the outer iteration. >> >> >>> Residual norms for fieldsplit_boundary_ solve. >>> 0 KSP Residual norm 1.593449603155e-09 >>> ... >>> 18 KSP Residual norm 1.335744434252e-14 >>> 1 KSP preconditioned resid norm 2.608069232839e-13 true resid norm 1.449869994655e-13 ||r(i)||/||b|| 9.151778504469e-13 >>> >>> >> Are you running with petsc-dev? >> >> Please run with -ksp_view and send the output. >> >> When I run tutorials/multiphysics/mp.c with the options ./mp -couple -snes_monitor_short -pc_type fieldsplit -ksp_monitor -pc_fieldsplit_type schur -fieldsplit_ksp_monitor -fieldsplit_1_ksp_type fgmres -fieldsplit_0_ksp_type gmres -snes_view I do not see the "double" iteration business. >> >> Barry >> >> >> >> >>> So, are there now two or one outer iterations? >>> >>> Thomas >>> >>> >>> >>> >>> Matthew Knepley wrote: >>> >>>> On Wed, Mar 16, 2011 at 8:27 AM, Thomas Witkowski <thomas.witkowski(a)tu-dresden.de <mailto:[email protected]>> wrote: >>>> >>>> Jed Brown wrote: >>>> >>>> On Wed, Mar 16, 2011 at 07:37, Thomas Witkowski >>>> <thomas.witkowski(a)tu-dresden.de >>>> <mailto:[email protected]> >>>> <mailto:[email protected] >>>> <mailto:[email protected]>>> wrote: >>>> >>>> Thanks for explanations! It works fine in my code. But I >>>> have two >>>> questions about it, maybe you can help me with them: >>>> - To the first, is the LU factorization on block A_00 done >>>> only once? >>>> >>>> >>>> Yes, one way to confirm this is to run with -log_summary and >>>> check MatLUFactor{Sym,Num}. >>>> - I have run the code with -fieldsplit_1_ksp_monitor to get >>>> some >>>> more information about the internal solves. I expected to get >>>> information about one iterative solver (for solving the Schur >>>> complement system), but I got three, all of them need around 20 >>>> iterations for my example. Could you explain to me what is >>>> actually solved there? >>>> >>>> >>>> I'm going to guess that you still have an outer KSP that (in >>>> the global norm, rather than the partitioned norm used inside >>>> of splits) has a tighter tolerance, therefore it takes a few >>>> outer iterations. If you use loose inner tolerances then the >>>> preconditioner becomes nonlinear and you'll need to use FGMRES >>>> for the outer. When in doubt, run with -ksp_view and show us >>>> the results if you don't understand. Additionally, monitoring >>>> inner solves separately can be useful, e.g. >>>> -fieldsplit_0_ksp_converged_reason -fieldsplit_1_ksp_monitor >>>> -ksp_monitor_true_residual. >>>> >>>> Okay, I run my code with the options "-pc_fieldsplit_type schur >>>> -fieldsplit_interior_ksp_type preonly -fieldsplit_interior_pc_type >>>> bjacobi -fieldsplit_interior_sub_pc_type lu >>>> -fieldsplit_boundary_ksp_monitor -ksp_monitor_true_residual >>>> -fieldsplit_interior_ksp_converged_reason". The splits are named >>>> "interior" and "boundary". The ksp output is as follows: >>>> >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> Residual norms for fieldsplit_boundary_ solve. >>>> 0 KSP Residual norm 1.790059331071e-04 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 1 KSP Residual norm 1.237356212928e-04 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 2 KSP Residual norm 7.952220245101e-05 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 3 KSP Residual norm 3.502858665398e-05 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 4 KSP Residual norm 1.601085190129e-05 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 5 KSP Residual norm 8.491161243057e-06 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 6 KSP Residual norm 4.778227395989e-06 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 7 KSP Residual norm 2.571919352633e-06 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 8 KSP Residual norm 1.353979940120e-06 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 9 KSP Residual norm 7.408377337496e-07 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 10 KSP Residual norm 3.810694345834e-07 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 11 KSP Residual norm 1.955889542056e-07 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 12 KSP Residual norm 9.938906113920e-08 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 13 KSP Residual norm 4.893445675773e-08 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 14 KSP Residual norm 2.395128458062e-08 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 15 KSP Residual norm 1.2464425896 <tel:1.2464425896>57e-08 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 16 KSP Residual norm 6.316454504022e-09 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 17 KSP Residual norm 3.088668836241e-09 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 18 KSP Residual norm 1.593454221996e-09 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> [0] Petsc-Iteration 0: 0.574504 >>>> 0 KSP preconditioned resid norm 5.745043818120e-01 true resid >>>> norm 1.584249437360e-01 ||r(i)||/||b|| 1.000000000000e+00 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> Residual norms for fieldsplit_boundary_ solve. >>>> 0 KSP Residual norm 1.790059331000e-04 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 1 KSP Residual norm 1.237356237744e-04 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 2 KSP Residual norm 7.952220078415e-05 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 3 KSP Residual norm 3.502859285561e-05 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 4 KSP Residual norm 1.601086485810e-05 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 5 KSP Residual norm 8.491169384185e-06 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 6 KSP Residual norm 4.778229157872e-06 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 7 KSP Residual norm 2.571917112191e-06 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 8 KSP Residual norm 1.353977280183e-06 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 9 KSP Residual norm 7.408352317360e-07 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 10 KSP Residual norm 3.810710583336e-07 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 11 KSP Residual norm 1.955898169394e-07 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 12 KSP Residual norm 9.938892788465e-08 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 13 KSP Residual norm 4.893428546840e-08 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 14 KSP Residual norm 2.395120857135e-08 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 15 KSP Residual norm 1.2464367927 <tel:1.2464367927>84e-08 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 16 KSP Residual norm 6.316409779118e-09 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 17 KSP Residual norm 3.088649355374e-09 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 18 KSP Residual norm 1.593449602302e-09 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> Residual norms for fieldsplit_boundary_ solve. >>>> 0 KSP Residual norm 1.593449603155e-09 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 1 KSP Residual norm 1.011857676662e-09 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 2 KSP Residual norm 5.660892669788e-10 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 3 KSP Residual norm 3.046799343903e-10 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 4 KSP Residual norm 1.6004713993 <tel:1.6004713993>29e-10 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 5 KSP Residual norm 8.083216601016e-11 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 6 KSP Residual norm 4.308671648345e-11 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 7 KSP Residual norm 2.381959817139e-11 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 8 KSP Residual norm 1.264839790114e-11 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 9 KSP Residual norm 6.435098853282e-12 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 10 KSP Residual norm 3.184769579797e-12 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 11 KSP Residual norm 1.5022019430 <tel:1.5022019430>16e-12 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 12 KSP Residual norm 7.099486208425e-13 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 13 KSP Residual norm 3.443222176388e-13 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 14 KSP Residual norm 1.6478434989 <tel:1.6478434989>12e-13 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 15 KSP Residual norm 8.208508173926e-14 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 16 KSP Residual norm 4.376604355287e-14 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 17 KSP Residual norm 2.596069152755e-14 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 18 KSP Residual norm 1.335744434252e-14 >>>> Linear solve converged due to CONVERGED_ITS iterations 1 >>>> 1 KSP preconditioned resid norm 2.608069232839e-13 true resid >>>> norm 1.449869994655e-13 ||r(i)||/||b|| 9.151778504469e-13 >>>> >>>> I have no idea how to interpret this output! Could you help me >>>> with it? >>>> >>>> >>>> Get rid of -fieldsplit_interior_ksp_converged_reason. It is confusing things. Then you will see >>>> the outer iteration and the inner boundary iteration which is indented. >>>> >>>> Matt >>>> >>>> >>>> Thomas >>>> >>>> >>>> >>>> >>>> -- >>>> What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead. >>>> -- Norbert Wiener >>>> > > > >

1 0

Re: [petsc-dev] Using PCFieldSplitSetIS
by Thomas Witkowski 18 Mar '11

18 Mar '11

Jed, thanks for clarification. I think that I now understand whats going when using the fieldsplit preconditioner. Thomas Jed Brown wrote: > On Wed, Mar 16, 2011 at 14:27, Thomas Witkowski > <thomas.witkowski(a)tu-dresden.de > <mailto:[email protected]>> wrote: > > > I'm going to guess that you still have an outer KSP that (in > the global norm, rather than the partitioned norm used inside > of splits) has a tighter tolerance, therefore it takes a few > outer iterations. If you use loose inner tolerances then the > preconditioner becomes nonlinear and you'll need to use FGMRES > for the outer. When in doubt, run with -ksp_view and show us > the results if you don't understand. Additionally, monitoring > inner solves separately can be useful, e.g. > -fieldsplit_0_ksp_converged_reason -fieldsplit_1_ksp_monitor > -ksp_monitor_true_residual. > > Okay, I run my code with the options "-pc_fieldsplit_type schur > -fieldsplit_interior_ksp_type preonly -fieldsplit_interior_pc_type > bjacobi -fieldsplit_interior_sub_pc_type lu > -fieldsplit_boundary_ksp_monitor -ksp_monitor_true_residual > -fieldsplit_interior_ksp_converged_reason". The splits are named > "interior" and "boundary". The ksp output is as follows: > > Linear solve converged due to CONVERGED_ITS iterations 1 > > > This is the initial interior solve. > > > Residual norms for fieldsplit_boundary_ solve. > 0 KSP Residual norm 1.790059331071e-04 > Linear solve converged due to CONVERGED_ITS iterations 1 > 1 KSP Residual norm 1.237356212928e-04 > Linear solve converged due to CONVERGED_ITS iterations 1 > 2 KSP Residual norm 7.952220245101e-05 > Linear solve converged due to CONVERGED_ITS iterations 1 > > > [...] > > Each iteration on the boundary problem requires an interior solve. We > see alternating boundary residual and interior solves. > > > > [0] Petsc-Iteration 0: 0.574504 > > > You must be printing this somewhere. > > > 0 KSP preconditioned resid norm 5.745043818120e-01 true resid > norm 1.584249437360e-01 ||r(i)||/||b|| 1.000000000000e+00 > > > This is the norm of P^{-1} b, upon which all following norms are > computed. Note that this is not actually a "preconditioned residual" > because the initial guess was zero, however. In fact, since P is an > exact preconditioner for your problem, it is the solution of your > problem, but GMRES can't check that until it does one more iteration > (the output below). You can use -ksp_type richardson to cheaply > confirm that the norm is small, it should show a small residual after > one iteration. Once you are happy that the inner solve really is > solving your system, you can switch to -ksp_type preonly. > > > Linear solve converged due to CONVERGED_ITS iterations 1 > Residual norms for fieldsplit_boundary_ solve. > 0 KSP Residual norm 1.790059331000e-04 > Linear solve converged due to CONVERGED_ITS iterations 1 > 1 KSP Residual norm 1.237356237744e-04 > Linear solve converged due to CONVERGED_ITS iterations 1 > 2 KSP Residual norm 7.952220078415e-05 > Linear solve converged due to CONVERGED_ITS iterations 1 > 3 KSP Residual norm 3.502859285561e-05 > Linear solve converged due to CONVERGED_ITS iterations 1 > 4 KSP Residual norm 1.601086485810e-05 > Linear solve converged due to CONVERGED_ITS iterations 1 > 5 KSP Residual norm 8.491169384185e-06 > Linear solve converged due to CONVERGED_ITS iterations 1 > 6 KSP Residual norm 4.778229157872e-06 > Linear solve converged due to CONVERGED_ITS iterations 1 > 7 KSP Residual norm 2.571917112191e-06 > Linear solve converged due to CONVERGED_ITS iterations 1 > 8 KSP Residual norm 1.353977280183e-06 > Linear solve converged due to CONVERGED_ITS iterations 1 > 9 KSP Residual norm 7.408352317360e-07 > Linear solve converged due to CONVERGED_ITS iterations 1 > 10 KSP Residual norm 3.810710583336e-07 > Linear solve converged due to CONVERGED_ITS iterations 1 > 11 KSP Residual norm 1.955898169394e-07 > Linear solve converged due to CONVERGED_ITS iterations 1 > 12 KSP Residual norm 9.938892788465e-08 > Linear solve converged due to CONVERGED_ITS iterations 1 > 13 KSP Residual norm 4.893428546840e-08 > Linear solve converged due to CONVERGED_ITS iterations 1 > 14 KSP Residual norm 2.395120857135e-08 > Linear solve converged due to CONVERGED_ITS iterations 1 > 15 KSP Residual norm 1.2464367927 <tel:1.2464367927>84e-08 > Linear solve converged due to CONVERGED_ITS iterations 1 > 16 KSP Residual norm 6.316409779118e-09 > Linear solve converged due to CONVERGED_ITS iterations 1 > 17 KSP Residual norm 3.088649355374e-09 > Linear solve converged due to CONVERGED_ITS iterations 1 > 18 KSP Residual norm 1.593449602302e-09 > Linear solve converged due to CONVERGED_ITS iterations 1 > > > The way GMRES computes residuals explains why we needed this Schur > solve, but it shouldn't do the one below. Are you using GMRES or some > other Krylov solver (perhaps set in an options file or inside your > code, -ksp_view would help)? > > > Linear solve converged due to CONVERGED_ITS iterations 1 > Residual norms for fieldsplit_boundary_ solve. > 0 KSP Residual norm 1.593449603155e-09 > Linear solve converged due to CONVERGED_ITS iterations 1 > 1 KSP Residual norm 1.011857676662e-09 > Linear solve converged due to CONVERGED_ITS iterations 1 > 2 KSP Residual norm 5.660892669788e-10 > Linear solve converged due to CONVERGED_ITS iterations 1 > 3 KSP Residual norm 3.046799343903e-10 > Linear solve converged due to CONVERGED_ITS iterations 1 > 4 KSP Residual norm 1.6004713993 <tel:1.6004713993>29e-10 > Linear solve converged due to CONVERGED_ITS iterations 1 > 5 KSP Residual norm 8.083216601016e-11 > Linear solve converged due to CONVERGED_ITS iterations 1 > 6 KSP Residual norm 4.308671648345e-11 > Linear solve converged due to CONVERGED_ITS iterations 1 > 7 KSP Residual norm 2.381959817139e-11 > Linear solve converged due to CONVERGED_ITS iterations 1 > 8 KSP Residual norm 1.264839790114e-11 > Linear solve converged due to CONVERGED_ITS iterations 1 > 9 KSP Residual norm 6.435098853282e-12 > Linear solve converged due to CONVERGED_ITS iterations 1 > 10 KSP Residual norm 3.184769579797e-12 > Linear solve converged due to CONVERGED_ITS iterations 1 > 11 KSP Residual norm 1.5022019430 <tel:1.5022019430>16e-12 > Linear solve converged due to CONVERGED_ITS iterations 1 > 12 KSP Residual norm 7.099486208425e-13 > Linear solve converged due to CONVERGED_ITS iterations 1 > 13 KSP Residual norm 3.443222176388e-13 > Linear solve converged due to CONVERGED_ITS iterations 1 > 14 KSP Residual norm 1.6478434989 <tel:1.6478434989>12e-13 > Linear solve converged due to CONVERGED_ITS iterations 1 > 15 KSP Residual norm 8.208508173926e-14 > Linear solve converged due to CONVERGED_ITS iterations 1 > 16 KSP Residual norm 4.376604355287e-14 > Linear solve converged due to CONVERGED_ITS iterations 1 > 17 KSP Residual norm 2.596069152755e-14 > Linear solve converged due to CONVERGED_ITS iterations 1 > 18 KSP Residual norm 1.335744434252e-14 > Linear solve converged due to CONVERGED_ITS iterations 1 > 1 KSP preconditioned resid norm 2.608069232839e-13 true resid > norm 1.449869994655e-13 ||r(i)||/||b|| 9.151778504469e-13 > > I have no idea how to interpret this output! Could you help me > with it? > > Thomas > >

1 0

Re: [petsc-dev] quad precision
by Satish Balay 17 Mar '11

17 Mar '11

On Thu, 17 Mar 2011, Lisandro Dalcin wrote: > On 16 March 2011 21:00, Barry Smith <bsmith(a)mcs.anl.gov> wrote: > > > > > > On Feb 8, 2011, at 6:31 AM, Jed Brown wrote: > > > >> > GCC now ships with the LGPL-licensed libquadmath library, which provides for targets with a __float128 datatype quad-precision mathematical functions. __float128 is available for targets on 32-bit x86, x86-64 and Itanium architectures. The libquadmath library is automatically built on such targets when building the Fortran compiler. > >> > >> http://gcc.gnu.org/gcc-4.6/changes.html#libquadmath > >> http://gcc.gnu.org/onlinedocs/libquadmath/ > >> > >> Looks like this is something that actually works. GCC-4.6 is probably about two months away from a release, but this should be functional now. Perhaps it should be supported by petsc-3.2? > > > > Done (use ./configure --with-precision=__float128 --download-qblaslapack > > > > I got an error about "Unknown comression type in URL: > http://ftp.mcs.anl.gov/pub/petsc/externalpackages/qblaslapack.gz"... > (BTW, the error message has a typo, should be "compression"). The pushed > trivial fix below solved the issue.. PLEASE PUSH! pushed satish

1 0

Re: [petsc-dev] quad precision
by Lisandro Dalcin 17 Mar '11

17 Mar '11

On 16 March 2011 21:00, Barry Smith <bsmith(a)mcs.anl.gov> wrote: > > > On Feb 8, 2011, at 6:31 AM, Jed Brown wrote: > >> > GCC now ships with the LGPL-licensed libquadmath library, which provides for targets with a __float128 datatype quad-precision mathematical functions. __float128 is available for targets on 32-bit x86, x86-64 and Itanium architectures. The libquadmath library is automatically built on such targets when building the Fortran compiler. >> >> http://gcc.gnu.org/gcc-4.6/changes.html#libquadmath >> http://gcc.gnu.org/onlinedocs/libquadmath/ >> >> Looks like this is something that actually works. GCC-4.6 is probably about two months away from a release, but this should be functional now. Perhaps it should be supported by petsc-3.2? > > Done (use ./configure --with-precision=__float128 --download-qblaslapack > I got an error about "Unknown comression type in URL: http://ftp.mcs.anl.gov/pub/petsc/externalpackages/qblaslapack.gz"... (BTW, the error message has a typo, should be "compression"). The trivial fix below solved the issue.. PLEASE PUSH! diff -r aaf10947275d config/PETSc/packages/qblaslapack.py --- a/config/PETSc/packages/qblaslapack.py Thu Mar 17 19:16:19 2011 -0500 +++ b/config/PETSc/packages/qblaslapack.py Thu Mar 17 22:38:57 2011 -0300 @@ -3,7 +3,7 @@ class Configure(PETSc.package.NewPackage): def __init__(self, framework): PETSc.package.NewPackage.__init__(self, framework) - self.download = ['http://ftp.mcs.anl.gov/pub/petsc/externalpackages/qblaslapack.gz'] + self.download = ['http://ftp.mcs.anl.gov/pub/petsc/externalpackages/qblaslapack.tar.gz'] self.functions = ['ddot_'] self.includes = [] self.liblist = [['libqlapack.a','libqblas.a']] > barry-smiths-macbook-pro:tutorials barrysmith$ petscmpiexec -n 2 ./ex19 -snes_monitor -ksp_monitor -ksp_rtol 1.e-30 -snes_rtol 1.e-28 > lid velocity = Qe, prandtl # = Qe, grashof # = Qe > 0 SNES Function norm 1.461936698223e-01 > 0 KSP Residual norm 1.461936698223e-01 > 1 KSP Residual norm 1.831093524630e-02 > 2 KSP Residual norm 3.842156479462e-03 > 3 KSP Residual norm 1.288406516834e-04 > 4 KSP Residual norm 6.151749539864e-06 > 5 KSP Residual norm 5.304145544729e-07 > 6 KSP Residual norm 1.885113023052e-08 > 7 KSP Residual norm 7.029816194041e-10 > 8 KSP Residual norm 5.197815114974e-11 > 9 KSP Residual norm 1.551090319297e-12 > 10 KSP Residual norm 6.563825928589e-14 > 11 KSP Residual norm 4.237666605992e-15 > 12 KSP Residual norm 1.991927370291e-16 > 13 KSP Residual norm 2.039546156320e-17 > 14 KSP Residual norm 1.399229447695e-17 > 15 KSP Residual norm 1.137432635542e-17 > 16 KSP Residual norm 9.814665753619e-18 > 17 KSP Residual norm 8.761318174145e-18 > 18 KSP Residual norm 7.987316427844e-18 > 19 KSP Residual norm 7.387832309954e-18 > 20 KSP Residual norm 6.905793284234e-18 > 21 KSP Residual norm 6.507264709320e-18 > 22 KSP Residual norm 6.170620606220e-18 > 23 KSP Residual norm 5.881342212029e-18 > 24 KSP Residual norm 5.629271709982e-18 > 25 KSP Residual norm 5.407060816706e-18 > 26 KSP Residual norm 5.209244641147e-18 > 27 KSP Residual norm 5.031663281118e-18 > 28 KSP Residual norm 4.871086689542e-18 > 29 KSP Residual norm 4.724963445290e-18 > 30 KSP Residual norm 1.945800083119e-17 > 31 KSP Residual norm 3.878029318777e-18 > 32 KSP Residual norm 8.021501106718e-19 > 33 KSP Residual norm 3.209251006205e-20 > 34 KSP Residual norm 9.713771954068e-22 > 35 KSP Residual norm 7.628163240222e-23 > 36 KSP Residual norm 4.108476441305e-24 > 37 KSP Residual norm 1.743186899274e-25 > 38 KSP Residual norm 1.115126800943e-26 > 39 KSP Residual norm 6.198813188878e-28 > 40 KSP Residual norm 2.869837519115e-29 > 41 KSP Residual norm 1.515585472682e-30 > 42 KSP Residual norm 5.770691059470e-32 > 1 SNES Function norm 2.507018921541e-05 > 0 KSP Residual norm 2.507018921541e-05 > 1 KSP Residual norm 7.131114735363e-07 > 2 KSP Residual norm 6.965532093127e-08 > 3 KSP Residual norm 8.087355337901e-09 > 4 KSP Residual norm 2.749048294679e-10 > 5 KSP Residual norm 1.113870556134e-11 > 6 KSP Residual norm 4.684216963041e-13 > 7 KSP Residual norm 4.911624900830e-14 > 8 KSP Residual norm 2.475960732046e-15 > 9 KSP Residual norm 1.012965264508e-16 > 10 KSP Residual norm 5.199268899437e-18 > 11 KSP Residual norm 2.361382990671e-19 > 12 KSP Residual norm 1.624218498133e-20 > 13 KSP Residual norm 1.626389274652e-21 > 14 KSP Residual norm 1.086627523198e-21 > 15 KSP Residual norm 8.796270682258e-22 > 16 KSP Residual norm 7.562576022670e-22 > 17 KSP Residual norm 6.738068994025e-22 > 18 KSP Residual norm 6.134859714231e-22 > 19 KSP Residual norm 5.669225669612e-22 > 20 KSP Residual norm 5.295704884674e-22 > 21 KSP Residual norm 4.987454291392e-22 > 22 KSP Residual norm 4.727440148233e-22 > 23 KSP Residual norm 4.504266287687e-22 > 24 KSP Residual norm 4.309981502786e-22 > 25 KSP Residual norm 4.138846776251e-22 > 26 KSP Residual norm 3.986602059865e-22 > 27 KSP Residual norm 3.850009759823e-22 > 28 KSP Residual norm 3.726559420703e-22 > 29 KSP Residual norm 3.614270387400e-22 > 30 KSP Residual norm 1.485730798507e-21 > 31 KSP Residual norm 5.734533095762e-23 > 32 KSP Residual norm 2.917983740862e-24 > 33 KSP Residual norm 2.415955278478e-25 > 34 KSP Residual norm 2.754121553256e-26 > 35 KSP Residual norm 1.530546077890e-27 > 36 KSP Residual norm 1.236527954824e-28 > 37 KSP Residual norm 5.968984750158e-30 > 38 KSP Residual norm 2.679693674423e-31 > 39 KSP Residual norm 2.728339059485e-32 > 40 KSP Residual norm 8.956127952264e-34 > 41 KSP Residual norm 2.732653737468e-35 > 42 KSP Residual norm 1.278928596713e-36 > 2 SNES Function norm 5.123354965471e-13 > 0 KSP Residual norm 5.123354965471e-13 > 1 KSP Residual norm 1.922138659280e-14 > 2 KSP Residual norm 1.916027080380e-15 > 3 KSP Residual norm 1.173166951366e-16 > 4 KSP Residual norm 6.562671109080e-18 > 5 KSP Residual norm 1.982740889768e-19 > 6 KSP Residual norm 1.593609248118e-20 > 7 KSP Residual norm 5.849655936465e-22 > 8 KSP Residual norm 2.871644899437e-23 > 9 KSP Residual norm 8.762292108710e-25 > 10 KSP Residual norm 2.883597656362e-26 > 11 KSP Residual norm 1.508069830626e-27 > 12 KSP Residual norm 9.552654188779e-29 > 13 KSP Residual norm 5.964437523019e-29 > 14 KSP Residual norm 4.773742821457e-29 > 15 KSP Residual norm 4.073114192114e-29 > 16 KSP Residual norm 3.613955807224e-29 > 17 KSP Residual norm 3.281398363062e-29 > 18 KSP Residual norm 3.026482504508e-29 > 19 KSP Residual norm 2.823023108355e-29 > 20 KSP Residual norm 2.655755272176e-29 > 21 KSP Residual norm 2.515082243565e-29 > 22 KSP Residual norm 2.394629606506e-29 > 23 KSP Residual norm 2.289975422292e-29 > 24 KSP Residual norm 2.197943014798e-29 > 25 KSP Residual norm 2.116183578028e-29 > 26 KSP Residual norm 2.042917954989e-29 > 27 KSP Residual norm 1.976770491487e-29 > 28 KSP Residual norm 1.916658520825e-29 > 29 KSP Residual norm 1.861716726173e-29 > 30 KSP Residual norm 7.847792961992e-29 > 31 KSP Residual norm 3.265251638392e-30 > 32 KSP Residual norm 2.554035610120e-31 > 33 KSP Residual norm 1.708749092417e-32 > 34 KSP Residual norm 1.088457747082e-33 > 35 KSP Residual norm 4.004032418947e-35 > 36 KSP Residual norm 3.626864425969e-36 > 37 KSP Residual norm 1.998928979977e-37 > 38 KSP Residual norm 5.929794876014e-39 > 39 KSP Residual norm 3.867971851833e-40 > 40 KSP Residual norm 2.306219660368e-41 > 41 KSP Residual norm 1.109502994834e-42 > 42 KSP Residual norm 7.010253552905e-44 > 3 SNES Function norm 1.676590295787e-28 > > -- Lisandro Dalcin --------------- CIMEC (INTEC/CONICET-UNL) Predio CONICET-Santa Fe Colectora RN 168 Km 472, Paraje El Pozo 3000 Santa Fe, Argentina Tel: +54-342-4511594 (ext 1011) Tel/Fax: +54-342-4511169

1 0

consistencyCheck always called?
by Barry Smith 17 Mar '11

17 Mar '11

In package.py: def configure(self): if self.download and not self.download[0] == 'redefine' and self.framework.argDB['download-'+self.downloadname.lower()]: self.framework.argDB['with-'+self.package] = 1 if 'with-'+self.package+'-dir' in self.framework.argDB or 'with-'+self.package+'-include' in self.framework.argDB or 'with-'+self.package+'-lib' in self.framework.argDB: self.framework.argDB['with-'+self.package] = 1 if hasattr(self, 'usePkgConfig') and 'with-'+self.package+'-pkg-config' in self.framework.argDB: self.framework.argDB['with-'+self.package] = 1 self.usePkgConfig() self.consistencyChecks() if self.framework.argDB['with-'+self.package]: # If clanguage is c++, test external packages with the c++ compiler self.libraries.pushLanguage(self.defaultLanguage) self.executeTest(self.configureLibrary) self.executeTest(self.checkSharedLibrary) self.libraries.popLanguage() else: self.executeTest(self.alternateConfigureLibrary) return Why does it do the consistency check even if the package is not being used?? Seems strange. Barry

1 0

Re: [petsc-dev] missing include files
by Satish Balay 17 Mar '11

17 Mar '11

for now - I commented these lines out. Once these files are added - this change can be reverted. Satish On Thu, 17 Mar 2011, Lisandro Dalcin wrote: > On 17 March 2011 18:46, Blaise Bourdin <bourdin(a)lsu.edu> wrote: > > Hi, > > > > include/finclude/petsc.h references "finclude/petscdmadda.h", "finclude/petscdmcomposite.h", "finclude/petscdmsliced.h", none of which exists in my system. > > > > Is the header file wrong or are the header files really missing in the repository? > > > > I think it is the second. However, I'm not sure if the ADDA, COMPOSITE > and Sliced API's are fully supported in Fortran. > > [dalcinl@nikola dev]$ nm linux-gnu/lib/libpetsc.so | grep dmadda > 0000000000599900 T dmaddagetcorners_ > 00000000005998f0 T dmaddagetghostcorners_ > 0000000000599930 T dmaddagetmatrixns_ > 0000000000599910 T dmaddasetrefinement_ > [dalcinl@nikola dev]$ nm linux-gnu/lib/libpetsc.so | grep dmcomposite > 0000000000596ed0 T dmcompositeaddarray_ > 0000000000596f00 T dmcompositeadddm_ > 0000000000596f20 T dmcompositecreate_ > 0000000000596ef0 T dmcompositedestroy_ > 0000000000596eb0 T dmcompositegetaccess4_ > 0000000000626970 T dmcompositegetaccessvpvp_ > 0000000000596df0 T dmcompositegetcontext_ > 0000000000596fb0 T dmcompositegetentries1_ > 0000000000596f90 T dmcompositegetentries2_ > 0000000000596f70 T dmcompositegetentries3_ > 0000000000596f50 T dmcompositegetentries4_ > 0000000000596f30 T dmcompositegetentries5_ > 0000000000596e30 T dmcompositegetlocalvectors4_ > 0000000000596e50 T dmcompositerestoreaccess4_ > 0000000000626900 T dmcompositerestoreaccessvpvp_ > 0000000000596e10 T dmcompositerestorelocalvectors4_ > 0000000000596e80 T dmcompositescatter4_ > 0000000000596e00 T dmcompositesetcontext_ > [dalcinl@nikola dev]$ nm linux-gnu/lib/libpetsc.so | grep dmsliced > > > > > > The problem comes up when compiling a heavily patched version of TAO compatible with petsc-dev > > > > Is this patched version publicly available somewhere? Are you planning > to contribute it back to TAO? Do it still requires a C++ build of > PETSc? > >

1 0