January 2021 - petsc-dev - mailman3.cels.anl.gov

Re: [petsc-dev] model for parallel ASM
by Jacob Faibussowitsch 09 Jan '21

09 Jan '21

I’m currently working on an implementation of a general PetscStream object. Currently it only supports Vector ops and has a proof of concept KSPCG, but should be extensible to other objects when finished. Junchao is also indirectly working on pipeline support in his NVSHMEM MR. Take a look at either MR, it would be very useful to get your input, as tailoring either of these approaches for pipelined algorithms is key. Best regards, Jacob Faibussowitsch (Jacob Fai - booss - oh - vitch) Cell: (312) 694-3391 > On Jan 9, 2021, at 15:01, Mark Adams <mfadams(a)lbl.gov> wrote: > > I would like to put a non-overlapping ASM solve on the GPU. It's not clear that we have a model for this. > > PCApply_ASM currently pipelines the scater with the subdomain solves. I think we would want to change this and do a 1) scatter begin loop, 2) scatter end and non-blocking solve loop, 3) solve-wait and scatter begging loop and 4) scatter end loop. > > I'm not sure how to go about doing this. > * Should we make a new PCApply_ASM_PARALLEL or dump this pipelining algorithm and rewrite PCApply_ASM? > * Add a solver-wait method to KSP? > > Thoughts? > > Mark

1 0

model for parallel ASM
by Mark Adams 09 Jan '21

09 Jan '21

I would like to put a non-overlapping ASM solve on the GPU. It's not clear that we have a model for this. PCApply_ASM currently pipelines the scater with the subdomain solves. I think we would want to change this and do a 1) scatter begin loop, 2) scatter end and non-blocking solve loop, 3) solve-wait and scatter begging loop and 4) scatter end loop. I'm not sure how to go about doing this. * Should we make a new PCApply_ASM_PARALLEL or dump this pipelining algorithm and rewrite PCApply_ASM? * Add a solver-wait method to KSP? Thoughts? Mark

1 0

Re: [petsc-dev] [petsc-maint] Proposal to improve MatSetValuesBlocked
by Mark Adams 08 Jan '21

08 Jan '21

[keep on list] Yes, Satish will need to give you permission. Please send your Gitlab user name (or is it email?) Thanks, Mark On Fri, Jan 8, 2021 at 10:56 AM Frank Bramkamp <bramkamp(a)nsc.liu.se> wrote: > Dear Mark, > > I have incorporated some changes for the BAIJ format to handle different > block sizes. > > I created a new local branch on my system: > > bramkamp/baij-seq-mpi-addswitchforblocksizes > > I am not sure how to commit this to petsc now: > > I tried > git push -u origin bramkamp/baij-seq-mpi-addswitchforblocksizes > > which seems the way how it is described on > https://docs.petsc.org/en/latest/developers/integration/ > > > I think I am not allowed to commit anything to the repository. > Basically I have changed two routines and added a new include file. > > > Greetings, Frank > > >

1 0

Re: [petsc-dev] [petsc-users] convergence problem- 3D Cahn Hillard
by Barry Smith 05 Jan '21

05 Jan '21

In debug mode SNES should always compute the Jacobian via differencing and compare. It is insane that we have had to tell 1,234 people individually over 25 years to check the Jacobian. It's software, it should be doing it for us. We are prisoners of 70 years of bad habits, afraid to do extra computation that would save humans endless time because it will waste the big valuable computer's time. Barry > On Jan 5, 2021, at 3:53 PM, Matthew Knepley <knepley(a)gmail.com> wrote: > > On Tue, Jan 5, 2021 at 4:48 PM Sepideh Kavousi <skavou1(a)lsu.edu <mailto:[email protected]>> wrote: > I have tried different pcs (lu,jacobi,sor,mg,asm,ksp,pbjacobi). they still do not solve the problem. the an example for lu: > -pc_type lu: > > 0 TS dt 0.0001 time 0. > copy! > Write output at step= 0! > 0 SNES Function norm 5.870630851181e+01 > 0 KSP preconditioned resid norm 1.761968940423e-02 true resid norm 5.870630851181e+01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 5.026000796457e-17 true resid norm 1.790914574372e-13 ||r(i)||/||b|| 3.050633943390e-15 > 1 SNES Function norm 5.808754845048e+01 > > So with a perfect linear solver, Newton is making no progress. That means that your initial guess is very far from the solution, but it could also mean > that your Jacobian does not match your residual, since it is not generating descent directions. Have you checked that it matches the finite difference > approximation? You can do this using -snes_test_jacobian (https://www.mcs.anl.gov/petsc/petsc-current/docs/manualpages/SNES/SNESCompu… <https://www.mcs.anl.gov/petsc/petsc-current/docs/manualpages/SNES/SNESCompu…>) > > Thanks, > > Matt > > 0 KSP preconditioned resid norm 1.191540511981e+06 true resid norm 5.808754845048e+01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 6.114882955273e-10 true resid norm 1.203029448994e-06 ||r(i)||/||b|| 2.071062527315e-08 > 2 SNES Function norm 5.794558475659e+01 > 0 KSP preconditioned resid norm 1.191526760369e+06 true resid norm 5.794558475659e+01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 1.166698266769e-09 true resid norm 1.059436818305e-06 ||r(i)||/||b|| 1.828330532439e-08 > 3 SNES Function norm 5.772046032228e+01 > 0 KSP preconditioned resid norm 1.191498793276e+06 true resid norm 5.772046032228e+01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 1.135175980555e-09 true resid norm 1.230437568859e-06 ||r(i)||/||b|| 2.131718219136e-08 > 4 SNES Function norm 5.750822623807e+01 > 0 KSP preconditioned resid norm 1.191443279124e+06 true resid norm 5.750822623807e+01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 8.905670672745e-10 true resid norm 1.110684454395e-06 ||r(i)||/||b|| 1.931348829639e-08 > 5 SNES Function norm 5.750395740069e+01 > 0 KSP preconditioned resid norm 1.191433462635e+06 true resid norm 5.750395740069e+01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 6.777205269843e-10 true resid norm 1.430076525401e-06 ||r(i)||/||b|| 2.486918448822e-08 > 6 SNES Function norm 5.750395740069e+01 > 0 SNES Function norm 5.870630851181e+01 > 0 KSP preconditioned resid norm 4.405989777785e-03 true resid norm 5.870630851181e+01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 1.185260514636e-18 true resid norm 2.397998208837e-14 ||r(i)||/||b|| 4.084736836000e-16 > 1 SNES Function norm 3.428067045216e+01 > 0 KSP preconditioned resid norm 1.895265798836e+06 true resid norm 3.428067045216e+01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 1.403775884750e-09 true resid norm 8.602063630559e-06 ||r(i)||/||b|| 2.509304373893e-07 > 2 SNES Function norm 3.428067045216e+01 > 0 SNES Function norm 5.870630851181e+01 > 0 KSP preconditioned resid norm 1.101564184740e-03 true resid norm 5.870630851181e+01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 5.380439828314e-19 true resid norm 3.289971303359e-14 ||r(i)||/||b|| 5.604118853253e-16 > 1 SNES Function norm 3.330623063627e+01 > 0 KSP preconditioned resid norm 6.892935831006e-04 true resid norm 3.330623063627e+01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 4.234145873951e-19 true resid norm 1.823438085202e-14 ||r(i)||/||b|| 5.474765683081e-16 > 2 SNES Function norm 1.228168587373e+01 > 0 KSP preconditioned resid norm 2.442179927376e-04 true resid norm 1.228168587373e+01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 3.114351195683e-19 true resid norm 1.328341389902e-14 ||r(i)||/||b|| 1.081562745993e-15 > 3 SNES Function norm 8.377002138765e+00 > 0 KSP preconditioned resid norm 1.670901807768e-04 true resid norm 8.377002138765e+00 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 3.056553283627e-19 true resid norm 1.539291322344e-14 ||r(i)||/||b|| 1.837520507750e-15 > 4 SNES Function norm 6.871259668846e-01 > 0 KSP preconditioned resid norm 7.849703293659e-06 true resid norm 6.871259668846e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 4.813692242300e-21 true resid norm 3.443983247611e-16 ||r(i)||/||b|| 5.012157033194e-16 > 5 SNES Function norm 4.598894985660e-01 > 0 SNES Function norm 4.609452800861e-01 > 0 KSP preconditioned resid norm 4.482807772478e+00 true resid norm 4.609452800861e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 3.779043025722e-15 true resid norm 9.363790606967e-11 ||r(i)||/||b|| 2.031432148566e-10 > 1 SNES Function norm 3.909615632676e-01 > 1 TS dt 1.25e-05 time 6.25e-06 > copy! > 0 SNES Function norm 1.083064424363e+00 > 0 KSP preconditioned resid norm 2.899372173019e+02 true resid norm 1.083064424363e+00 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 1.843039617595e-13 true resid norm 2.031204561200e-09 ||r(i)||/||b|| 1.875423581006e-09 > 1 SNES Function norm 1.083064424363e+00 > 0 SNES Function norm 4.081254017393e-01 > 0 KSP preconditioned resid norm 1.134610736819e+01 true resid norm 4.081254017393e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 5.857284280292e-15 true resid norm 1.950178080787e-10 ||r(i)||/||b|| 4.778379567837e-10 > 1 SNES Function norm 3.852294258555e-01 > 2 TS dt 6.25e-06 time 9.375e-06 > copy! > 0 SNES Function norm 3.855090631551e-01 > 0 KSP preconditioned resid norm 5.807020984426e+01 true resid norm 3.855090631551e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 6.595611115758e-14 true resid norm 6.458636528724e-10 ||r(i)||/||b|| 1.675352707888e-09 > 1 SNES Function norm 3.855090631551e-01 > 0 SNES Function norm 3.894882915800e-01 > 0 KSP preconditioned resid norm 3.545691207399e+00 true resid norm 3.894882915800e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 2.936099793899e-15 true resid norm 1.237085076854e-10 ||r(i)||/||b|| 3.176180397711e-10 > 1 SNES Function norm 3.826734119825e-01 > 3 TS dt 3.125e-06 time 1.09375e-05 > copy! > 0 SNES Function norm 3.846635056055e-01 > 0 KSP preconditioned resid norm 1.270632337662e+01 true resid norm 3.846635056055e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 4.538849751267e-15 true resid norm 2.462963992263e-10 ||r(i)||/||b|| 6.402905283117e-10 > 1 SNES Function norm 3.846635056055e-01 > 0 SNES Function norm 3.838572028974e-01 > 0 KSP preconditioned resid norm 9.750671428246e-01 true resid norm 3.838572028974e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 1.289810958767e-15 true resid norm 5.932884665420e-11 ||r(i)||/||b|| 1.545596805436e-10 > 1 SNES Function norm 3.823876176903e-01 > 4 TS dt 1.5625e-06 time 1.17188e-05 > copy! > 0 SNES Function norm 3.842190105197e-01 > 0 KSP preconditioned resid norm 2.949895830433e+00 true resid norm 3.842190105197e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 4.544123722663e-15 true resid norm 1.184005133464e-10 ||r(i)||/||b|| 3.081589148499e-10 > 1 SNES Function norm 3.842190105197e-01 > 0 SNES Function norm 3.825899662960e-01 > 0 KSP preconditioned resid norm 2.548468293806e-01 true resid norm 3.825899662960e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 2.086200228021e-16 true resid norm 2.882610131465e-11 ||r(i)||/||b|| 7.534463486778e-11 > 1 SNES Function norm 3.825019685537e-01 > 5 TS dt 7.8125e-07 time 1.21094e-05 > copy! > 0 SNES Function norm 3.827182409606e-01 > 0 KSP preconditioned resid norm 7.091231452893e-01 true resid norm 3.827182409606e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 9.614097858359e-16 true resid norm 5.440482894192e-11 ||r(i)||/||b|| 1.421537390153e-10 > 1 SNES Function norm 3.827182409606e-01 > 0 SNES Function norm 3.825683488225e-01 > 0 KSP preconditioned resid norm 6.509635329694e-02 true resid norm 3.825683488225e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 6.255654660173e-17 true resid norm 1.410340803479e-11 ||r(i)||/||b|| 3.686506758386e-11 > 1 SNES Function norm 3.825462954733e-01 > 6 TS dt 3.90625e-07 time 1.23047e-05 > copy! > 0 SNES Function norm 3.826632731069e-01 > 0 KSP preconditioned resid norm 1.737397651071e-01 true resid norm 3.826632731069e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 2.095925875164e-16 true resid norm 2.780031944787e-11 ||r(i)||/||b|| 7.264956268774e-11 > 1 SNES Function norm 3.826632731069e-01 > 0 SNES Function norm 3.825751343810e-01 > 0 KSP preconditioned resid norm 1.644741829353e-02 true resid norm 3.825751343810e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 5.211213666062e-18 true resid norm 7.515828526583e-12 ||r(i)||/||b|| 1.964536597169e-11 > 1 SNES Function norm 3.825729851167e-01 > 7 TS dt 1.95313e-07 time 1.24023e-05 > copy! > 0 SNES Function norm 3.826356173729e-01 > 0 KSP preconditioned resid norm 4.299238585205e-02 true resid norm 3.826356173729e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 1.260847149806e-17 true resid norm 1.287166330766e-11 ||r(i)||/||b|| 3.363948028683e-11 > 1 SNES Function norm 3.826356173729e-01 > 0 SNES Function norm 3.825855754640e-01 > 0 KSP preconditioned resid norm 4.133474793122e-03 true resid norm 3.825855754640e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 3.077297138396e-18 true resid norm 3.792689943805e-12 ||r(i)||/||b|| 9.913311392374e-12 > 1 SNES Function norm 3.825855754640e-01 > 0 SNES Function norm 3.825755706234e-01 > 0 KSP preconditioned resid norm 3.705095771277e-04 true resid norm 3.825755706234e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 2.848267031641e-19 true resid norm 1.079462463835e-12 ||r(i)||/||b|| 2.821566630813e-12 > 1 SNES Function norm 3.825755706234e-01 > 0 SNES Function norm 3.825734391910e-01 > 0 KSP preconditioned resid norm 2.690993850525e-05 true resid norm 3.825734391910e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 7.585015168707e-21 true resid norm 3.091320932665e-13 ||r(i)||/||b|| 8.080333384362e-13 > 1 SNES Function norm 3.825734391910e-01 > 0 SNES Function norm 3.825729114845e-01 > 0 KSP preconditioned resid norm 1.757556306807e-06 true resid norm 3.825729114845e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 9.987700736384e-22 true resid norm 8.038113355816e-14 ||r(i)||/||b|| 2.101067042260e-13 > 1 SNES Function norm 3.825729114845e-01 > 0 SNES Function norm 3.825565841303e-01 > 0 KSP preconditioned resid norm 1.103248802240e-07 true resid norm 3.825565841303e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 9.504795613889e-22 true resid norm 1.879813159274e-14 ||r(i)||/||b|| 4.913817294630e-14 > 1 SNES Function norm 3.825565841303e-01 > 0 SNES Function norm 3.825547574266e-01 > 0 KSP preconditioned resid norm 6.887463339138e-09 true resid norm 3.825547574266e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 2.559974044704e-23 true resid norm 5.311723680631e-15 ||r(i)||/||b|| 1.388487158378e-14 > 1 SNES Function norm 3.825547574266e-01 > 0 SNES Function norm 3.825908198230e-01 > 0 KSP preconditioned resid norm 4.314157283909e-10 true resid norm 3.825908198230e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 1.248846716324e-24 true resid norm 1.634240020842e-15 ||r(i)||/||b|| 4.271508714187e-15 > 1 SNES Function norm 3.825908198230e-01 > 0 SNES Function norm 3.823046631992e-01 > 0 KSP preconditioned resid norm 1.477599397951e-11 true resid norm 3.823046631992e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 1.674742673343e-25 true resid norm 4.342823046268e-15 ||r(i)||/||b|| 1.135958690623e-14 > 1 SNES Function norm 3.823046631992e-01 > 0 SNES Function norm 4.050006682433e-01 > 0 KSP preconditioned resid norm 4.744618612191e-12 true resid norm 4.050006682433e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 3.185835350170e-26 true resid norm 2.742859197646e-15 ||r(i)||/||b|| 6.772480671558e-15 > 1 SNES Function norm 4.050006682433e-01 > 0 SNES Function norm 4.420555752951e-01 > 0 KSP preconditioned resid norm 2.570862477765e-13 true resid norm 4.420555752951e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 1.558628106533e-27 true resid norm 2.669513100096e-15 ||r(i)||/||b|| 6.038863096149e-15 > 1 SNES Function norm 3.053219162874e-01 > 8 TS dt 3.72529e-13 time 1.24023e-05 > copy! > 0 SNES Function norm 2.938107171164e-01 > 0 KSP preconditioned resid norm 1.152686085246e-13 true resid norm 2.938107171164e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 6.059363368490e-28 true resid norm 1.486663802399e-15 ||r(i)||/||b|| 5.059937285439e-15 > 1 SNES Function norm 1.879261738365e-01 > 9 TS dt 7.45058e-13 time 1.24023e-05 > copy! > 0 SNES Function norm 2.598740119900e-01 > 0 KSP preconditioned resid norm 4.386389243102e-12 true resid norm 2.598740119900e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 4.765692021861e-27 true resid norm 4.362311845294e-16 ||r(i)||/||b|| 1.678625658599e-15 > 1 SNES Function norm 2.598740119900e-01 > 0 SNES Function norm 2.359036347057e-01 > 0 KSP preconditioned resid norm 3.416321738725e-13 true resid norm 2.359036347057e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 2.983917914615e-27 true resid norm 2.031818641817e-15 ||r(i)||/||b|| 8.612917916048e-15 > 1 SNES Function norm 1.708032078859e-01 > 10 TS dt 3.72529e-13 time 1.24023e-05 > copy! > 0 SNES Function norm 5.285427862819e-01 > 0 KSP preconditioned resid norm 1.592064460142e-12 true resid norm 5.285427862819e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 1.163339775654e-26 true resid norm 3.880080925123e-15 ||r(i)||/||b|| 7.341091442033e-15 > 1 SNES Function norm 5.285427862819e-01 > 0 SNES Function norm 1.646935190988e-01 > 0 KSP preconditioned resid norm 5.824112147206e-14 true resid norm 1.646935190988e-01 ||r(i)||/||b|| 1.000000000000e+00 > 1 KSP preconditioned resid norm 2.820310421468e-29 true resid norm 7.168182199430e-17 ||r(i)||/||b|| 4.352437326407e-16 > 1 SNES Function norm 1.621698143957e-01 > > > > > From: Matthew Knepley <knepley(a)gmail.com <mailto:[email protected]>> > Sent: Tuesday, January 5, 2021 3:25 PM > To: Sepideh Kavousi <skavou1(a)lsu.edu <mailto:[email protected]>> > Cc: petsc-users(a)mcs.anl.gov <mailto:[email protected]> <petsc-users(a)mcs.anl.gov <mailto:[email protected]>> > Subject: Re: [petsc-users] convergence problem- 3D Cahn Hillard > > On Tue, Jan 5, 2021 at 4:17 PM Sepideh Kavousi <skavou1(a)lsu.edu <mailto:[email protected]>> wrote: > Dear Matt, > following is the output for the first 130 timesteps. It continues the run with the same small timestep > 0 TS dt 0.0001 time 0. > copy! > Write output at step= 0! > 0 SNES Function norm 5.870630851181e+01 > 0 KSP preconditioned resid norm 1.714717261432e-02 true resid norm 5.870630851181e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.199465935450e-03 true resid norm 4.319055307029e+00 ||r(i)||/||b|| 7.357054831952 > 2 KSP preconditioned resid norm 3.319453031999e-08 true resid norm 2.987572551099e-04 ||r(i)||/||b|| 5.089014497476 > 1 SNES Function norm 5.870480277455e+01 > 0 SNES Function norm 5.870480198099e+01 > 0 KSP preconditioned resid norm 1.242359546728e+03 true resid norm 5.870480198099e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.490848214055e+02 true resid norm 7.765825085110e+05 ||r(i)||/||b|| 1.322860281110 > > You can see here that the linear solver is very bad, which might contribute to Newton stagnating. While you are starting out, I would recommend > > -pc_type lu > > Once you have the nonlinear system converging, then you can try different linear solvers to speed things up. > > Thanks, > > Matt > > 1 SNES Function norm 5.870165343582e+01 > 1 TS dt 0.0002 time 0.0001 > copy! > 0 SNES Function norm 5.869324856421e+01 > 0 KSP preconditioned resid norm 1.610036885378e+04 true resid norm 5.869324856421e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.932166117910e+03 true resid norm 2.795187905611e+06 ||r(i)||/||b|| 4.762367008112 > 1 SNES Function norm 5.869298823911e+01 > 2 TS dt 0.0004 time 0.0003 > copy! > 0 SNES Function norm 5.867574766362e+01 > 0 KSP preconditioned resid norm 6.440121822416e+04 true resid norm 5.867574766362e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 7.729183419474e+03 true resid norm 5.589239290096e+06 ||r(i)||/||b|| 9.525637955461 > 1 SNES Function norm 5.867531973582e+01 > 3 TS dt 0.0008 time 0.0007 > copy! > 0 SNES Function norm 5.864011322220e+01 > 0 KSP preconditioned resid norm 2.575951235569e+05 true resid norm 5.864011322220e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.092020125512e+04 true resid norm 1.117372172629e+07 ||r(i)||/||b|| 1.905474105063 > 1 SNES Function norm 5.863990526788e+01 > 4 TS dt 0.0016 time 0.0015 > copy! > 0 SNES Function norm 5.856903590475e+01 > 0 KSP preconditioned resid norm 1.030166914887e+06 true resid norm 5.856903590475e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.236963623364e+05 true resid norm 2.232651118139e+07 ||r(i)||/||b|| 3.811999094145 > 1 SNES Function norm 5.856893794226e+01 > 5 TS dt 0.0032 time 0.0031 > copy! > 0 SNES Function norm 5.842679564768e+01 > 0 KSP preconditioned resid norm 4.116839933215e+06 true resid norm 5.842679564768e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 4.947221952957e+05 true resid norm 4.455474620275e+07 ||r(i)||/||b|| 7.625738449088 > 1 SNES Function norm 5.842675271515e+01 > 6 TS dt 0.0064 time 0.0063 > copy! > 0 SNES Function norm 5.814352339598e+01 > 0 KSP preconditioned resid norm 1.640271206849e+07 true resid norm 5.814352339598e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.975364210355e+06 true resid norm 8.860074436391e+07 ||r(i)||/||b|| 1.523828264767 > 1 SNES Function norm 5.814350805660e+01 > 7 TS dt 0.0128 time 0.0127 > copy! > 0 SNES Function norm 5.760173270961e+01 > 0 KSP preconditioned resid norm 6.454729140249e+07 true resid norm 5.760173270961e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 7.823848123455e+06 true resid norm 1.742411872562e+08 ||r(i)||/||b|| 3.024929616867 > 1 SNES Function norm 5.760173134258e+01 > 8 TS dt 0.0256 time 0.0255 > copy! > 0 SNES Function norm 5.683398372141e+01 > 0 KSP preconditioned resid norm 2.407430690480e+08 true resid norm 5.683398372141e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.988112927961e+07 true resid norm 3.294875226513e+08 ||r(i)||/||b|| 5.797368072355 > 1 SNES Function norm 5.683398372141e+01 > 0 SNES Function norm 5.747024606058e+01 > 0 KSP preconditioned resid norm 2.515545687156e+07 true resid norm 5.747024606058e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.051720581278e+06 true resid norm 1.095447785949e+08 ||r(i)||/||b|| 1.906112921101 > 1 SNES Function norm 5.747023898114e+01 > 9 TS dt 0.00758395 time 0.0319 > copy! > 0 SNES Function norm 5.725811890845e+01 > 0 KSP preconditioned resid norm 2.611072328843e+07 true resid norm 5.725811890845e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.176469515845e+06 true resid norm 1.113946431934e+08 ||r(i)||/||b|| 1.945482061182 > 1 SNES Function norm 5.725811208900e+01 > 10 TS dt 0.0151679 time 0.039484 > copy! > 0 SNES Function norm 5.684339053584e+01 > 0 KSP preconditioned resid norm 8.519149364113e+07 true resid norm 5.684339053584e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.044655731587e+07 true resid norm 1.965090970240e+08 ||r(i)||/||b|| 3.457026316896 > 1 SNES Function norm 5.684338688259e+01 > 11 TS dt 0.0303358 time 0.0546519 > copy! > 0 SNES Function norm 5.605303343054e+01 > 0 KSP preconditioned resid norm 3.077821813947e+08 true resid norm 5.605303343054e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.830523927105e+07 true resid norm 3.551741213376e+08 ||r(i)||/||b|| 6.336394296622 > 1 SNES Function norm 5.605303164316e+01 > 12 TS dt 0.0606716 time 0.0849877 > copy! > 0 SNES Function norm 5.463652619423e+01 > 0 KSP preconditioned resid norm 9.913250744377e+08 true resid norm 5.463652619423e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.270586572012e+08 true resid norm 5.803799416601e+08 ||r(i)||/||b|| 1.062256300111 > 1 SNES Function norm 5.463652534643e+01 > 13 TS dt 0.121343 time 0.145659 > copy! > 0 SNES Function norm 5.251966690761e+01 > 0 KSP preconditioned resid norm 2.257468849129e+09 true resid norm 5.251966690761e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.978974887824e+08 true resid norm 7.294445370018e+08 ||r(i)||/||b|| 1.388897873791 > 1 SNES Function norm 5.251966654744e+01 > 14 TS dt 0.242686 time 0.267003 > copy! > 0 SNES Function norm 5.150151326391e+01 > 0 KSP preconditioned resid norm 1.934621627312e+09 true resid norm 5.150151326391e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 7.373534863658e+08 true resid norm 5.533546685373e+08 ||r(i)||/||b|| 1.074443513343 > 1 SNES Function norm 5.150151326391e+01 > 0 SNES Function norm 5.184908859688e+01 > 0 KSP preconditioned resid norm 9.594647854417e+08 true resid norm 5.184908859688e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.327300773354e+08 true resid norm 5.290096803217e+08 ||r(i)||/||b|| 1.020287327391 > 1 SNES Function norm 5.184908859688e+01 > 0 SNES Function norm 5.232682115621e+01 > 0 KSP preconditioned resid norm 1.266845619319e+08 true resid norm 5.232682115621e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.745176236994e+07 true resid norm 2.288152713580e+08 ||r(i)||/||b|| 4.372810468936 > 1 SNES Function norm 5.232682115621e+01 > 0 SNES Function norm 5.246983753576e+01 > 0 KSP preconditioned resid norm 1.016188047721e+07 true resid norm 5.246983753576e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.386074172374e+06 true resid norm 6.834728918642e+07 ||r(i)||/||b|| 1.302601502050 > 1 SNES Function norm 5.246983737815e+01 > 15 TS dt 0.00758395 time 0.270794 > copy! > 0 SNES Function norm 5.237345394852e+01 > 0 KSP preconditioned resid norm 1.520623505703e+07 true resid norm 5.237345394852e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.085613628230e+06 true resid norm 8.323112079508e+07 ||r(i)||/||b|| 1.589185255509 > 1 SNES Function norm 5.237345394852e+01 > 0 SNES Function norm 5.244535357001e+01 > 0 KSP preconditioned resid norm 1.536584002766e+06 true resid norm 5.244535357001e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.096310197197e+05 true resid norm 2.689484472091e+07 ||r(i)||/||b|| 5.128165393146 > 1 SNES Function norm 5.244535357001e+01 > 0 SNES Function norm 5.246369218939e+01 > 0 KSP preconditioned resid norm 1.396784143620e+05 true resid norm 5.246369218939e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.902693207785e+04 true resid norm 8.150907015311e+06 ||r(i)||/||b|| 1.553628171248 > 1 SNES Function norm 5.246369181668e+01 > 16 TS dt 0.000947994 time 0.271268 > copy! > 0 SNES Function norm 5.245144714661e+01 > 0 KSP preconditioned resid norm 2.476071225856e+05 true resid norm 5.245144714661e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.375328023503e+04 true resid norm 1.084434754065e+07 ||r(i)||/||b|| 2.067502067262 > 1 SNES Function norm 5.245144714661e+01 > 0 SNES Function norm 5.246062448755e+01 > 0 KSP preconditioned resid norm 2.428224536380e+04 true resid norm 5.246062448755e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.307763409533e+03 true resid norm 3.402894455924e+06 ||r(i)||/||b|| 6.486568715421 > 1 SNES Function norm 5.246062426384e+01 > 17 TS dt 0.000473997 time 0.271505 > copy! > 0 SNES Function norm 5.245449911597e+01 > 0 KSP preconditioned resid norm 6.205856465529e+04 true resid norm 5.245449911597e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 8.456948933661e+03 true resid norm 5.437111337200e+06 ||r(i)||/||b|| 1.036538605617 > 1 SNES Function norm 5.245449911597e+01 > 0 SNES Function norm 5.245909110130e+01 > 0 KSP preconditioned resid norm 6.073102282836e+03 true resid norm 5.245909110130e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 8.273091803130e+02 true resid norm 1.702595489649e+06 ||r(i)||/||b|| 3.245568030070 > 1 SNES Function norm 5.245909110130e+01 > 0 SNES Function norm 5.246024056684e+01 > 0 KSP preconditioned resid norm 5.469219328745e+02 true resid norm 5.246024056684e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 7.449715612636e+01 true resid norm 5.111045278569e+05 ||r(i)||/||b|| 9.742702708458 > 1 SNES Function norm 5.246024055663e+01 > 18 TS dt 5.92496e-05 time 0.271535 > copy! > 0 SNES Function norm 5.245947411014e+01 > 0 KSP preconditioned resid norm 9.721423022050e+02 true resid norm 5.245947411014e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.324232130801e+02 true resid norm 6.813881966795e+05 ||r(i)||/||b|| 1.298884916858 > 1 SNES Function norm 5.245947411014e+01 > 0 SNES Function norm 5.246004891756e+01 > 0 KSP preconditioned resid norm 9.496157296515e+01 true resid norm 5.246004891756e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.293484266592e+01 true resid norm 2.129900140686e+05 ||r(i)||/||b|| 4.060042231438 > 1 SNES Function norm 5.246004890902e+01 > 19 TS dt 2.96248e-05 time 0.27155 > copy! > 0 SNES Function norm 5.245966566276e+01 > 0 KSP preconditioned resid norm 2.431000935393e+02 true resid norm 5.245966566276e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.311385157364e+01 true resid norm 3.407887271653e+05 ||r(i)||/||b|| 6.496204710034 > 1 SNES Function norm 5.245966566276e+01 > 0 SNES Function norm 5.245995306375e+01 > 0 KSP preconditioned resid norm 2.374244377432e+01 true resid norm 5.245995306375e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.233977517286e+00 true resid norm 1.065053760904e+05 ||r(i)||/||b|| 2.030222481536 > 2 KSP preconditioned resid norm 7.230270716674e-06 true resid norm 6.926453755200e-01 ||r(i)||/||b|| 1.320331672196 > 1 SNES Function norm 5.245977670896e+01 > 20 TS dt 1.48124e-05 time 0.271557 > copy! > 0 SNES Function norm 5.245977453999e+01 > 0 KSP preconditioned resid norm 6.168684412120e+01 true resid norm 5.245977453999e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 8.402553599990e+00 true resid norm 1.729515771051e+05 ||r(i)||/||b|| 3.296841792053 > 2 KSP preconditioned resid norm 3.005621555900e-05 true resid norm 1.799678959759e+00 ||r(i)||/||b|| 3.430588437598 > 1 SNES Function norm 5.245977453999e+01 > 0 SNES Function norm 5.245973715661e+01 > 0 KSP preconditioned resid norm 5.969268501139e+00 true resid norm 5.245973715661e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 8.130709135360e-01 true resid norm 5.355456766116e+04 ||r(i)||/||b|| 1.020869919750 > 2 KSP preconditioned resid norm 9.089448541659e-07 true resid norm 1.741374551917e-01 ||r(i)||/||b|| 3.319449631855 > 1 SNES Function norm 5.245972630220e+01 > 21 TS dt 7.4062e-06 time 0.271561 > copy! > 0 SNES Function norm 5.245962991861e+01 > 0 KSP preconditioned resid norm 1.536192095911e+01 true resid norm 5.245962991861e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.092469114093e+00 true resid norm 8.614027499757e+04 ||r(i)||/||b|| 1.642029788072 > 2 KSP preconditioned resid norm 3.742653666692e-06 true resid norm 4.481544594898e-01 ||r(i)||/||b|| 8.542844472694 > 1 SNES Function norm 5.245962991861e+01 > 0 SNES Function norm 5.245970348930e+01 > 0 KSP preconditioned resid norm 1.495436965385e+00 true resid norm 5.245970348930e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.036883393815e-01 true resid norm 2.683283953695e+04 ||r(i)||/||b|| 5.114943042410 > 2 KSP preconditioned resid norm 1.138549307287e-07 true resid norm 4.362396228098e-02 ||r(i)||/||b|| 8.315708892613 > 1 SNES Function norm 5.245969886119e+01 > 22 TS dt 3.7031e-06 time 0.271563 > copy! > 0 SNES Function norm 5.245964973088e+01 > 0 KSP preconditioned resid norm 3.852412585267e+00 true resid norm 5.245964973088e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 5.247342254154e-01 true resid norm 4.320350322949e+04 ||r(i)||/||b|| 8.235568375147 > 2 KSP preconditioned resid norm 4.692850698407e-07 true resid norm 1.123826615441e-01 ||r(i)||/||b|| 2.142268622086 > 1 SNES Function norm 5.245964973088e+01 > 0 SNES Function norm 5.245968740629e+01 > 0 KSP preconditioned resid norm 3.748147030747e-01 true resid norm 5.245968740629e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 5.104998787585e-02 true resid norm 1.345019035411e+04 ||r(i)||/||b|| 2.563909740815 > 2 KSP preconditioned resid norm 1.426784946039e-08 true resid norm 1.093337980248e-02 ||r(i)||/||b|| 2.084148866120 > 1 SNES Function norm 5.245968066039e+01 > 23 TS dt 1.85155e-06 time 0.271564 > copy! > 0 SNES Function norm 5.245966664362e+01 > 0 KSP preconditioned resid norm 9.837329252613e-01 true resid norm 5.245966664362e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.339899075028e-01 true resid norm 2.206396454765e+04 ||r(i)||/||b|| 4.205891108218 > 2 KSP preconditioned resid norm 5.991678882897e-08 true resid norm 2.869654952283e-02 ||r(i)||/||b|| 5.470211947357 > 1 SNES Function norm 5.245966664362e+01 > 0 SNES Function norm 5.245967459813e+01 > 0 KSP preconditioned resid norm 9.462653470563e-02 true resid norm 5.245967459813e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.288704436220e-02 true resid norm 6.790773385904e+03 ||r(i)||/||b|| 1.294474934876 > 2 KSP preconditioned resid norm 1.800909995964e-09 true resid norm 2.760039732652e-03 ||r(i)||/||b|| 5.261259727199 > 1 SNES Function norm 5.245967167916e+01 > 24 TS dt 9.25775e-07 time 0.271564 > copy! > 0 SNES Function norm 5.245972527444e+01 > 0 KSP preconditioned resid norm 2.662779884000e-01 true resid norm 5.245972527444e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.626690181904e-02 true resid norm 1.194411437916e+04 ||r(i)||/||b|| 2.276816036813 > 2 KSP preconditioned resid norm 8.108932355980e-09 true resid norm 7.767274936648e-03 ||r(i)||/||b|| 1.480616777159 > 1 SNES Function norm 5.245972527444e+01 > 0 SNES Function norm 5.245966286541e+01 > 0 KSP preconditioned resid norm 2.455492468134e-02 true resid norm 5.245966286541e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.343507759856e-03 true resid norm 3.523728385966e+03 ||r(i)||/||b|| 6.717024459356 > 2 KSP preconditioned resid norm 2.336250050344e-10 true resid norm 7.160969335303e-04 ||r(i)||/||b|| 1.365042957610 > 1 SNES Function norm 5.245964735626e+01 > 25 TS dt 4.62888e-07 time 0.271565 > copy! > 0 SNES Function norm 5.245965045260e+01 > 0 KSP preconditioned resid norm 6.979335700381e-02 true resid norm 5.245965045260e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 9.504921828211e-03 true resid norm 6.260729925833e+03 ||r(i)||/||b|| 1.193437217331 > 2 KSP preconditioned resid norm 1.062619850597e-09 true resid norm 2.035685556196e-03 ||r(i)||/||b|| 3.880478689113 > 1 SNES Function norm 5.245965045260e+01 > 0 SNES Function norm 5.245964737315e+01 > 0 KSP preconditioned resid norm 6.401992290600e-03 true resid norm 5.245964737315e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 8.713916783411e-04 true resid norm 1.836735746083e+03 ||r(i)||/||b|| 3.501235402934 > 2 KSP preconditioned resid norm 3.044475123624e-11 true resid norm 1.866360513754e-04 ||r(i)||/||b|| 3.557706937065 > 1 SNES Function norm 5.245953907407e+01 > 26 TS dt 2.31444e-07 time 0.271565 > copy! > 0 SNES Function norm 5.245952669603e+01 > 0 KSP preconditioned resid norm 2.305046937264e-02 true resid norm 5.245952669603e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.138819663630e-03 true resid norm 4.134990532267e+03 ||r(i)||/||b|| 7.882249026428 > 2 KSP preconditioned resid norm 1.754568090046e-10 true resid norm 6.722522467136e-04 ||r(i)||/||b|| 1.281468379631 > 1 SNES Function norm 5.245952669603e+01 > 0 SNES Function norm 5.245955619349e+01 > 0 KSP preconditioned resid norm 1.849410943612e-03 true resid norm 5.245955619349e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.515382952823e-04 true resid norm 1.060363623027e+03 ||r(i)||/||b|| 2.021297357370 > 2 KSP preconditioned resid norm 4.394235662988e-12 true resid norm 5.387607049056e-05 ||r(i)||/||b|| 1.027002025939 > 1 SNES Function norm 5.245916156502e+01 > 27 TS dt 1.15722e-07 time 0.271565 > copy! > 0 SNES Function norm 5.245916087517e+01 > 0 KSP preconditioned resid norm 1.050473288664e-02 true resid norm 5.245916087517e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.430366094863e-03 true resid norm 3.768622481624e+03 ||r(i)||/||b|| 7.183916819775 > 2 KSP preconditioned resid norm 3.997794865638e-11 true resid norm 3.063457445171e-04 ||r(i)||/||b|| 5.839699671256 > 1 SNES Function norm 5.245916087517e+01 > 0 SNES Function norm 5.245922267220e+01 > 0 KSP preconditioned resid norm 6.766788166208e-04 true resid norm 5.245922267220e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 9.191834279480e-05 true resid norm 7.748447133999e+02 ||r(i)||/||b|| 1.477041926911 > 2 KSP preconditioned resid norm 8.028477267590e-13 true resid norm 1.968655949470e-05 ||r(i)||/||b|| 3.752735647212 > 1 SNES Function norm 5.245868047885e+01 > 28 TS dt 5.7861e-08 time 0.271565 > copy! > 0 SNES Function norm 5.245971666219e+01 > 0 KSP preconditioned resid norm 5.675077511356e-03 true resid norm 5.245971666219e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 7.727222643129e-04 true resid norm 4.071757048781e+03 ||r(i)||/||b|| 7.761683264515 > 2 KSP preconditioned resid norm 1.079847189588e-11 true resid norm 1.654940997196e-04 ||r(i)||/||b|| 3.154689164360 > 1 SNES Function norm 5.245971666219e+01 > 0 SNES Function norm 5.245866772896e+01 > 0 KSP preconditioned resid norm 3.156888082592e-04 true resid norm 5.245866772896e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 4.278792745648e-05 true resid norm 7.210828864373e+02 ||r(i)||/||b|| 1.374573388259 > 2 KSP preconditioned resid norm 1.868277550800e-13 true resid norm 9.162051759969e-06 ||r(i)||/||b|| 1.746527724895 > 1 SNES Function norm 5.245862997528e+01 > 29 TS dt 2.89305e-08 time 0.271565 > copy! > 0 SNES Function norm 5.245864268828e+01 > 0 KSP preconditioned resid norm 9.946730650307e-04 true resid norm 5.245864268828e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.352720009406e-04 true resid norm 1.425435652676e+03 ||r(i)||/||b|| 2.717256069978 > 2 KSP preconditioned resid norm 9.451723279064e-13 true resid norm 2.897067420077e-05 ||r(i)||/||b|| 5.522574110985 > 1 SNES Function norm 5.245864268828e+01 > 0 SNES Function norm 5.245863432005e+01 > 0 KSP preconditioned resid norm 8.830611952540e-05 true resid norm 5.245863432005e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.171521190212e-05 true resid norm 3.936108229308e+02 ||r(i)||/||b|| 7.503260960424 > 2 KSP preconditioned resid norm 2.554304840579e-14 true resid norm 2.504584831831e-06 ||r(i)||/||b|| 4.774399608938 > 1 SNES Function norm 5.245668231675e+01 > 30 TS dt 1.44652e-08 time 0.271565 > copy! > 0 SNES Function norm 5.245690451230e+01 > 0 KSP preconditioned resid norm 7.890756591999e-04 true resid norm 5.245690451230e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.073178641459e-04 true resid norm 2.261548879199e+03 ||r(i)||/||b|| 4.311251112174 > 2 KSP preconditioned resid norm 3.749009906718e-13 true resid norm 2.298213554527e-05 ||r(i)||/||b|| 4.381145963328 > 1 SNES Function norm 5.245690451230e+01 > 0 SNES Function norm 5.245696584491e+01 > 0 KSP preconditioned resid norm 4.617797594369e-05 true resid norm 5.245696584491e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 5.815858852608e-06 true resid norm 3.880872061891e+02 ||r(i)||/||b|| 7.398201553184 > 2 KSP preconditioned resid norm 6.320906527522e-15 true resid norm 1.238878017978e-06 ||r(i)||/||b|| 2.361703537411 > 1 SNES Function norm 5.245647736964e+01 > 31 TS dt 7.23262e-09 time 0.271565 > copy! > 0 SNES Function norm 5.245669639739e+01 > 0 KSP preconditioned resid norm 1.920423917689e-04 true resid norm 5.245669639739e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.595404589478e-05 true resid norm 1.092735026689e+03 ||r(i)||/||b|| 2.083118270375 > 2 KSP preconditioned resid norm 4.531344162809e-14 true resid norm 5.555122754515e-06 ||r(i)||/||b|| 1.058992108926 > 1 SNES Function norm 5.245669639739e+01 > 0 SNES Function norm 5.245652990872e+01 > 0 KSP preconditioned resid norm 2.148561771896e-05 true resid norm 5.245652990872e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.901735215594e-06 true resid norm 2.469549886027e+02 ||r(i)||/||b|| 4.707802613562 > 2 KSP preconditioned resid norm 1.021721996628e-15 true resid norm 3.996560492854e-07 ||r(i)||/||b|| 7.618804560287 > 1 SNES Function norm 5.245350296758e+01 > 32 TS dt 3.61631e-09 time 0.271565 > copy! > 0 SNES Function norm 5.246640623267e+01 > 0 KSP preconditioned resid norm 1.868946199874e-04 true resid norm 5.246640623267e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.526564335433e-05 true resid norm 2.127311290841e+03 ||r(i)||/||b|| 4.054615979236 > 2 KSP preconditioned resid norm 2.205384342972e-14 true resid norm 5.407251237239e-06 ||r(i)||/||b|| 1.030612086000 > 1 SNES Function norm 5.246640623267e+01 > 0 SNES Function norm 5.245276947886e+01 > 0 KSP preconditioned resid norm 1.857577202281e-05 true resid norm 5.245276947886e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.251209740085e-06 true resid norm 3.217505532117e+02 ||r(i)||/||b|| 6.134100380368 > 2 KSP preconditioned resid norm 3.347148796890e-16 true resid norm 2.616700562397e-07 ||r(i)||/||b|| 4.988679508051 > 1 SNES Function norm 5.245276947886e+01 > 0 SNES Function norm 5.245277054267e+01 > 0 KSP preconditioned resid norm 1.585651339750e-05 true resid norm 5.245277054267e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.158396081841e-07 true resid norm 9.815158167794e+01 ||r(i)||/||b|| 1.871237318114 > 2 KSP preconditioned resid norm 9.262934482642e-18 true resid norm 2.410856399560e-08 ||r(i)||/||b|| 4.596242247296 > 1 SNES Function norm 5.240788106409e+01 > 33 TS dt 4.52039e-10 time 0.271565 > copy! > 0 SNES Function norm 5.240539051979e+01 > 0 KSP preconditioned resid norm 1.847576989221e-05 true resid norm 5.240539051979e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.258349698670e-06 true resid norm 8.091283770820e+02 ||r(i)||/||b|| 1.543979291169 > 2 KSP preconditioned resid norm 1.346406659091e-16 true resid norm 2.631533872893e-07 ||r(i)||/||b|| 5.021494634029 > 1 SNES Function norm 5.240539051979e+01 > 0 SNES Function norm 5.240989970820e+01 > 0 KSP preconditioned resid norm 1.577993726636e-05 true resid norm 5.240989970820e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 8.768519589340e-08 true resid norm 1.783077376605e+02 ||r(i)||/||b|| 3.402176662295 > 2 KSP preconditioned resid norm 2.919605399798e-18 true resid norm 1.824330465594e-08 ||r(i)||/||b|| 3.480889060562 > 1 SNES Function norm 5.240989970820e+01 > 0 SNES Function norm 5.241000025070e+01 > 0 KSP preconditioned resid norm 1.575274319792e-05 true resid norm 5.241000025070e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 8.221250233678e-09 true resid norm 5.572925549085e+01 ||r(i)||/||b|| 1.063332478998 > 2 KSP preconditioned resid norm 8.231796009516e-20 true resid norm 1.712111363787e-09 ||r(i)||/||b|| 3.266764654833 > 1 SNES Function norm 5.228672678486e+01 > 34 TS dt 5.65048e-11 time 0.271565 > copy! > 0 SNES Function norm 5.229325617508e+01 > 0 KSP preconditioned resid norm 1.531451762057e-05 true resid norm 5.229325617508e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 6.923728185961e-08 true resid norm 3.519843808690e+02 ||r(i)||/||b|| 6.730970809898 > 2 KSP preconditioned resid norm 9.219320031850e-19 true resid norm 1.440250259886e-08 ||r(i)||/||b|| 2.754179726472 > 1 SNES Function norm 5.229325617508e+01 > 0 SNES Function norm 5.228920001144e+01 > 0 KSP preconditioned resid norm 1.556134876385e-05 true resid norm 5.228920001144e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 5.003575759749e-09 true resid norm 8.140280605473e+01 ||r(i)||/||b|| 1.556780483100 > 2 KSP preconditioned resid norm 2.086030462329e-20 true resid norm 1.041501558695e-09 ||r(i)||/||b|| 1.991810084046 > 1 SNES Function norm 5.228920001144e+01 > 0 SNES Function norm 5.228865204069e+01 > 0 KSP preconditioned resid norm 1.560838827547e-05 true resid norm 5.228865204069e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 4.922970395207e-10 true resid norm 2.669725885478e+01 ||r(i)||/||b|| 5.105746239932 > 2 KSP preconditioned resid norm 6.839542768926e-21 true resid norm 1.026968182189e-10 ||r(i)||/||b|| 1.964036444065 > 1 SNES Function norm 5.175201563991e+01 > 35 TS dt 7.06311e-12 time 0.271565 > copy! > 0 SNES Function norm 5.168638826028e+01 > 0 KSP preconditioned resid norm 1.404721029851e-05 true resid norm 5.168638826028e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.587829868981e-09 true resid norm 1.459250372800e+02 ||r(i)||/||b|| 2.823277891757 > 2 KSP preconditioned resid norm 7.859657062564e-21 true resid norm 7.465711379232e-10 ||r(i)||/||b|| 1.444425047004 > 1 SNES Function norm 5.168638826028e+01 > 0 SNES Function norm 5.178402875676e+01 > 0 KSP preconditioned resid norm 1.497434443016e-05 true resid norm 5.178402875676e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.736806352294e-10 true resid norm 3.562053719761e+01 ||r(i)||/||b|| 6.878672450328 > 2 KSP preconditioned resid norm 2.152524613455e-21 true resid norm 5.703543390249e-11 ||r(i)||/||b|| 1.101409744892 > 1 SNES Function norm 5.178402875676e+01 > 0 SNES Function norm 5.178806568852e+01 > 0 KSP preconditioned resid norm 1.513680827217e-05 true resid norm 5.178806568852e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.964269630137e-11 true resid norm 1.286074159038e+01 ||r(i)||/||b|| 2.483340788925 > 1 SNES Function norm 4.925818844220e+01 > 36 TS dt 8.82888e-13 time 0.271565 > copy! > 0 SNES Function norm 5.270383537204e+01 > 0 KSP preconditioned resid norm 1.970630708625e-06 true resid norm 5.270383537204e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.088592363798e-10 true resid norm 1.004963420137e+02 ||r(i)||/||b|| 1.906812688380 > 2 KSP preconditioned resid norm 7.410648384868e-22 true resid norm 6.428135574044e-11 ||r(i)||/||b|| 1.219671306399 > 1 SNES Function norm 5.270383537204e+01 > 0 SNES Function norm 4.874520711594e+01 > 0 KSP preconditioned resid norm 8.155830254099e-06 true resid norm 4.874520711594e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.736808340126e-11 true resid norm 2.849743547961e+01 ||r(i)||/||b|| 5.846202563430 > 1 SNES Function norm 4.874520711594e+01 > 0 SNES Function norm 4.879679718326e+01 > 0 KSP preconditioned resid norm 9.914611839830e-06 true resid norm 4.879679718326e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.917454881119e-12 true resid norm 1.012614869841e+01 ||r(i)||/||b|| 2.075166667267 > 1 SNES Function norm 4.872964148564e+01 > 37 TS dt 1.10361e-13 time 0.271565 > copy! > 0 SNES Function norm 4.866691749862e+01 > 0 KSP preconditioned resid norm 7.212230332263e-06 true resid norm 4.866691749862e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 5.134577224509e-12 true resid norm 1.336615037832e+01 ||r(i)||/||b|| 2.746455100366 > 1 SNES Function norm 4.866382095049e+01 > 38 TS dt 2.20722e-13 time 0.271565 > copy! > 0 SNES Function norm 4.893392986820e+01 > 0 KSP preconditioned resid norm 1.505657886052e-06 true resid norm 4.893392986820e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.933826297142e-11 true resid norm 2.517043359347e+01 ||r(i)||/||b|| 5.143758872681 > 2 KSP preconditioned resid norm 1.275522938352e-21 true resid norm 4.032007898216e-12 ||r(i)||/||b|| 8.239697708883 > 1 SNES Function norm 4.893392986820e+01 > 0 SNES Function norm 4.865470718806e+01 > 0 KSP preconditioned resid norm 6.064585739884e-06 true resid norm 4.865470718806e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.189348282039e-12 true resid norm 9.118770839991e+00 ||r(i)||/||b|| 1.874180601837 > 1 SNES Function norm 4.843333577010e+01 > 39 TS dt 1.10361e-13 time 0.271565 > copy! > 0 SNES Function norm 4.842612728466e+01 > 0 KSP preconditioned resid norm 1.689891330588e-06 true resid norm 4.842612728466e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 5.404712448465e-12 true resid norm 1.406935960874e+01 ||r(i)||/||b|| 2.905324129274 > 1 SNES Function norm 4.842612728466e+01 > 0 SNES Function norm 4.840969985006e+01 > 0 KSP preconditioned resid norm 4.866603210605e-06 true resid norm 4.840969985006e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 6.824415550862e-13 true resid norm 5.685261525942e+00 ||r(i)||/||b|| 1.174405448402 > 1 SNES Function norm 3.917148384566e+01 > 0 KSP preconditioned resid norm 4.873840219744e-12 true resid norm 3.917148384566e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 9.760673202702e-16 true resid norm 1.090795416316e-02 ||r(i)||/||b|| 2.784667082345 > 2 KSP preconditioned resid norm 2.716930489198e-27 true resid norm 1.727082218528e-14 ||r(i)||/||b|| 4.409029347299 > 2 SNES Function norm 3.373009701057e-01 > 40 TS dt 5.51805e-14 time 0.271565 > copy! > 0 SNES Function norm 4.835053852293e+01 > 0 KSP preconditioned resid norm 2.102791183017e-05 true resid norm 4.835053852293e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 5.264257339614e-12 true resid norm 2.740749949067e+01 ||r(i)||/||b|| 5.668499323471 > 1 SNES Function norm 4.835053852293e+01 > 0 SNES Function norm 1.287943764600e+01 > 0 KSP preconditioned resid norm 2.829357402918e-06 true resid norm 1.287943764600e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 9.855151020448e-14 true resid norm 1.640255580411e+00 ||r(i)||/||b|| 1.273545961784 > 1 SNES Function norm 1.128956057544e+01 > 41 TS dt 2.75903e-14 time 0.271565 > copy! > 0 SNES Function norm 1.669600342271e+01 > 0 KSP preconditioned resid norm 5.647351770054e-06 true resid norm 1.669600342271e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.899074559115e-13 true resid norm 3.019191100477e+00 ||r(i)||/||b|| 1.808331625262 > 1 SNES Function norm 1.472401994522e+01 > 42 TS dt 5.51805e-14 time 0.271565 > copy! > 0 SNES Function norm 5.552587859898e+01 > 0 KSP preconditioned resid norm 7.077263385509e-06 true resid norm 5.552587859898e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 8.106473736400e-13 true resid norm 4.220553854228e+00 ||r(i)||/||b|| 7.601057310069 > 1 SNES Function norm 2.907234222906e+01 > 0 KSP preconditioned resid norm 5.805178419738e-12 true resid norm 2.907234222906e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.606372758906e-15 true resid norm 9.077259836980e-03 ||r(i)||/||b|| 3.122300833369 > 2 KSP preconditioned resid norm 5.428926972364e-26 true resid norm 2.711140186441e-13 ||r(i)||/||b|| 9.325496257164 > 2 SNES Function norm 1.772805631039e-01 > 43 TS dt 1.10361e-13 time 0.271565 > copy! > 0 SNES Function norm 7.725490953363e+00 > 0 KSP preconditioned resid norm 1.415994950687e-05 true resid norm 7.725490953363e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.015357130343e-13 true resid norm 7.859026423913e-01 ||r(i)||/||b|| 1.017285046524 > 1 SNES Function norm 5.415206018520e+00 > 0 KSP preconditioned resid norm 2.165462061838e-12 true resid norm 5.415206018520e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.235973695994e-15 true resid norm 3.206254598880e-03 ||r(i)||/||b|| 5.920835860934 > 2 KSP preconditioned resid norm 1.611047004247e-26 true resid norm 3.962511257349e-14 ||r(i)||/||b|| 7.317378588732 > 2 SNES Function norm 2.952018920094e-02 > 44 TS dt 2.20722e-13 time 0.271565 > copy! > 0 SNES Function norm 3.042546652708e+00 > 0 KSP preconditioned resid norm 8.091399616290e-06 true resid norm 3.042546652708e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 8.205771643684e-14 true resid norm 1.106405513744e-01 ||r(i)||/||b|| 3.636445517636 > 1 SNES Function norm 7.553554533053e-01 > 0 KSP preconditioned resid norm 6.277932115893e-13 true resid norm 7.553554533053e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 4.929640368541e-15 true resid norm 6.440202696056e-03 ||r(i)||/||b|| 8.526055736905 > 2 KSP preconditioned resid norm 5.620814878971e-28 true resid norm 1.291358921256e-15 ||r(i)||/||b|| 1.709604287102 > 2 SNES Function norm 6.213938456039e-02 > 45 TS dt 4.41444e-13 time 0.271565 > copy! > 0 SNES Function norm 1.726791649984e+00 > 0 KSP preconditioned resid norm 4.535477432157e-12 true resid norm 1.726791649984e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.852992097181e-13 true resid norm 2.620032765602e-01 ||r(i)||/||b|| 1.517283666287 > 2 KSP preconditioned resid norm 5.405843783997e-26 true resid norm 9.329259279290e-14 ||r(i)||/||b|| 5.402654848009 > 1 SNES Function norm 1.726791649984e+00 > 0 SNES Function norm 4.569198217932e-01 > 0 KSP preconditioned resid norm 1.754712299938e-13 true resid norm 4.569198217932e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.123917412662e-15 true resid norm 9.715310204164e-03 ||r(i)||/||b|| 2.126261488512 > 2 KSP preconditioned resid norm 6.198312815878e-28 true resid norm 2.844892856386e-15 ||r(i)||/||b|| 6.226240842915 > 1 SNES Function norm 5.060166636556e-02 > 46 TS dt 2.20722e-13 time 0.271565 > copy! > 0 SNES Function norm 4.648499891442e-01 > 0 KSP preconditioned resid norm 1.215583828915e-13 true resid norm 4.648499891442e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 4.136647831085e-14 true resid norm 5.780523594107e-02 ||r(i)||/||b|| 1.243524519544 > 2 KSP preconditioned resid norm 2.652404498648e-27 true resid norm 9.750234455621e-15 ||r(i)||/||b|| 2.097501276395 > 1 SNES Function norm 4.303888962028e-01 > 47 TS dt 4.41444e-13 time 0.271565 > copy! > 0 SNES Function norm 1.205705397633e+00 > 0 KSP preconditioned resid norm 4.272460039856e-12 true resid norm 1.205705397633e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.187144280708e-13 true resid norm 2.132926270869e-01 ||r(i)||/||b|| 1.769027720251 > 2 KSP preconditioned resid norm 4.626725670443e-26 true resid norm 6.980033435000e-14 ||r(i)||/||b|| 5.789169932142 > 1 SNES Function norm 1.205705397633e+00 > 0 SNES Function norm 3.168320704593e-01 > 0 KSP preconditioned resid norm 1.467076946194e-13 true resid norm 3.168320704593e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 5.064560855977e-15 true resid norm 1.313310429467e-02 ||r(i)||/||b|| 4.145130976050 > 2 KSP preconditioned resid norm 4.892746399265e-28 true resid norm 2.638623094303e-15 ||r(i)||/||b|| 8.328143961179 > 1 SNES Function norm 1.059925414019e-01 > 48 TS dt 2.20722e-13 time 0.271565 > copy! > 0 SNES Function norm 1.008300299382e+00 > 0 KSP preconditioned resid norm 7.125489114170e-13 true resid norm 1.008300299382e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 5.171770889218e-14 true resid norm 7.934022500962e-02 ||r(i)||/||b|| 7.868709853430 > 2 KSP preconditioned resid norm 5.099650177302e-27 true resid norm 2.081198449279e-14 ||r(i)||/||b|| 2.064066082847 > 1 SNES Function norm 5.842489315290e-01 > 49 TS dt 4.41444e-13 time 0.271565 > copy! > 0 SNES Function norm 1.508490594861e+00 > 0 KSP preconditioned resid norm 1.603738895795e-12 true resid norm 1.508490594861e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 8.662801546410e-14 true resid norm 6.022795565867e-02 ||r(i)||/||b|| 3.992597359495 > 2 KSP preconditioned resid norm 1.733582507049e-26 true resid norm 2.177135518256e-14 ||r(i)||/||b|| 1.443254287214 > 1 SNES Function norm 4.745080825960e-01 > 50 TS dt 8.82888e-13 time 0.271565 > copy! > 0 SNES Function norm 1.014687630993e+00 > 0 KSP preconditioned resid norm 1.060889675722e-12 true resid norm 1.014687630993e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.800896805065e-13 true resid norm 1.186937932631e-01 ||r(i)||/||b|| 1.169756973848 > 2 KSP preconditioned resid norm 5.568109464029e-26 true resid norm 5.204626017419e-14 ||r(i)||/||b|| 5.129288914587 > 1 SNES Function norm 5.592988640286e-01 > 51 TS dt 1.76578e-12 time 0.271565 > copy! > 0 SNES Function norm 9.841734166744e-01 > 0 KSP preconditioned resid norm 3.788698480562e-11 true resid norm 9.841734166744e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 4.427253759379e-12 true resid norm 7.591907014254e-01 ||r(i)||/||b|| 7.713993169931 > 2 KSP preconditioned resid norm 2.270789969554e-24 true resid norm 9.656618497679e-13 ||r(i)||/||b|| 9.811907468817 > 1 SNES Function norm 9.841734166744e-01 > 0 SNES Function norm 5.290699913962e-01 > 0 KSP preconditioned resid norm 2.961203074770e-13 true resid norm 5.290699913962e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 6.579385754203e-14 true resid norm 1.070765043149e-01 ||r(i)||/||b|| 2.023862741342 > 2 KSP preconditioned resid norm 1.605527076496e-26 true resid norm 2.353592595573e-14 ||r(i)||/||b|| 4.448546759119 > 1 SNES Function norm 4.072990107379e-01 > 52 TS dt 8.82888e-13 time 0.271565 > copy! > 0 SNES Function norm 3.293320470683e-01 > 0 KSP preconditioned resid norm 3.661504324948e-12 true resid norm 3.293320470683e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.548679963821e-13 true resid norm 1.203392185968e-01 ||r(i)||/||b|| 3.654039127625 > 2 KSP preconditioned resid norm 7.635768593448e-26 true resid norm 7.754573523890e-14 ||r(i)||/||b|| 2.354636784644 > 1 SNES Function norm 3.293320470683e-01 > 0 SNES Function norm 6.190385444978e-01 > 0 KSP preconditioned resid norm 7.667894793585e-13 true resid norm 6.190385444978e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 4.308949396243e-14 true resid norm 4.695429803832e-02 ||r(i)||/||b|| 7.585036255926 > 2 KSP preconditioned resid norm 5.691126876098e-27 true resid norm 1.280807005416e-14 ||r(i)||/||b|| 2.069026261450 > 1 SNES Function norm 3.612736786105e-01 > 53 TS dt 4.41444e-13 time 0.271565 > copy! > 0 SNES Function norm 1.245269204940e+00 > 0 KSP preconditioned resid norm 2.568176854554e-12 true resid norm 1.245269204940e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 9.776800765706e-14 true resid norm 6.420730342930e-02 ||r(i)||/||b|| 5.156098229569 > 2 KSP preconditioned resid norm 1.529785626210e-26 true resid norm 2.418985312534e-14 ||r(i)||/||b|| 1.942540057152 > 1 SNES Function norm 5.113533173009e-01 > 54 TS dt 8.82888e-13 time 0.271565 > copy! > 0 SNES Function norm 1.607180712938e+00 > 0 KSP preconditioned resid norm 4.636162321951e-12 true resid norm 1.607180712938e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.328071063591e-12 true resid norm 4.130113477995e-01 ||r(i)||/||b|| 2.569787855683 > 2 KSP preconditioned resid norm 2.986094131796e-25 true resid norm 2.815708124309e-13 ||r(i)||/||b|| 1.751954899435 > 1 SNES Function norm 1.607180712938e+00 > 0 SNES Function norm 3.045128849808e-01 > 0 KSP preconditioned resid norm 5.097361796388e-13 true resid norm 3.045128849808e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.515506059329e-14 true resid norm 3.781546284180e-02 ||r(i)||/||b|| 1.241834572753 > 2 KSP preconditioned resid norm 3.850751097418e-27 true resid norm 7.793249956367e-15 ||r(i)||/||b|| 2.559251296331 > 1 SNES Function norm 2.935346973548e-01 > 55 TS dt 4.41444e-13 time 0.271565 > copy! > 0 SNES Function norm 8.467066865826e-01 > 0 KSP preconditioned resid norm 2.105464755264e-12 true resid norm 8.467066865826e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.055931985432e-13 true resid norm 6.965043278992e-02 ||r(i)||/||b|| 8.226040244353 > 2 KSP preconditioned resid norm 1.468324550496e-26 true resid norm 2.541042013299e-14 ||r(i)||/||b|| 3.001088870048 > 1 SNES Function norm 5.502623367952e-01 > 56 TS dt 8.82888e-13 time 0.271565 > copy! > 0 SNES Function norm 1.717470692129e+00 > 0 KSP preconditioned resid norm 6.408790513630e-12 true resid norm 1.717470692129e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.479693689356e-13 true resid norm 5.024422519606e-02 ||r(i)||/||b|| 2.925477880136 > 2 KSP preconditioned resid norm 9.272060121777e-26 true resid norm 6.739995179418e-14 ||r(i)||/||b|| 3.924372747848 > 1 SNES Function norm 4.045528183667e-01 > 57 TS dt 1.76578e-12 time 0.271565 > copy! > 0 SNES Function norm 1.544462481147e+00 > 0 KSP preconditioned resid norm 2.692153893932e-12 true resid norm 1.544462481147e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 7.398074985269e-13 true resid norm 3.283436461006e-01 ||r(i)||/||b|| 2.125941226211 > 2 KSP preconditioned resid norm 5.181047437358e-25 true resid norm 2.315578147201e-13 ||r(i)||/||b|| 1.499277693998 > 1 SNES Function norm 1.293824512618e+00 > 58 TS dt 3.53155e-12 time 0.271565 > copy! > 0 SNES Function norm 3.191314292345e+00 > 0 KSP preconditioned resid norm 1.039062273406e-11 true resid norm 3.191314292345e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.212715067065e-12 true resid norm 7.787068321621e-01 ||r(i)||/||b|| 2.440081924961 > 2 KSP preconditioned resid norm 4.498885154283e-24 true resid norm 9.194573610481e-13 ||r(i)||/||b|| 2.881124442220 > 1 SNES Function norm 2.617175498914e+00 > 59 TS dt 7.06311e-12 time 0.271565 > copy! > 0 SNES Function norm 5.489780310948e+00 > 0 KSP preconditioned resid norm 6.978639256294e-11 true resid norm 5.489780310948e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 7.433511036300e-12 true resid norm 4.377640181520e-01 ||r(i)||/||b|| 7.974162778044 > 2 KSP preconditioned resid norm 1.898195012657e-23 true resid norm 2.066485446633e-12 ||r(i)||/||b|| 3.764240697413 > 1 SNES Function norm 2.949802369100e+00 > 60 TS dt 1.41262e-11 time 0.271565 > copy! > 0 SNES Function norm 4.631512871139e+00 > 0 KSP preconditioned resid norm 1.314555356832e-10 true resid norm 4.631512871139e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.149855773442e-11 true resid norm 2.985608081754e-01 ||r(i)||/||b|| 6.446291233171 > 2 KSP preconditioned resid norm 6.387204091106e-23 true resid norm 3.106571956406e-12 ||r(i)||/||b|| 6.707466961313 > 1 SNES Function norm 2.195569697365e+00 > 61 TS dt 2.82524e-11 time 0.271565 > copy! > 0 SNES Function norm 1.662194684551e+00 > 0 KSP preconditioned resid norm 3.979057807951e-11 true resid norm 1.662194684551e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.086175282186e-11 true resid norm 5.322911899228e-01 ||r(i)||/||b|| 3.202339622849 > 2 KSP preconditioned resid norm 2.731031856638e-22 true resid norm 6.309496904983e-12 ||r(i)||/||b|| 3.795883216103 > 1 SNES Function norm 1.662194684551e+00 > 0 SNES Function norm 2.329147999080e+00 > 0 KSP preconditioned resid norm 6.940116009840e-11 true resid norm 2.329147999080e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 5.686978686498e-13 true resid norm 1.844903435300e-02 ||r(i)||/||b|| 7.920936909243 > 2 KSP preconditioned resid norm 1.554849191003e-24 true resid norm 1.343083437814e-13 ||r(i)||/||b|| 5.766415179903 > 1 SNES Function norm 1.548533538885e-01 > 62 TS dt 1.41262e-11 time 0.271565 > copy! > 0 SNES Function norm 2.019371357242e+00 > 0 KSP preconditioned resid norm 8.927861046269e-11 true resid norm 2.019371357242e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.633454572537e-12 true resid norm 3.342963950456e-02 ||r(i)||/||b|| 1.655447839481 > 2 KSP preconditioned resid norm 5.428564048405e-24 true resid norm 3.971355417344e-13 ||r(i)||/||b|| 1.966629566722 > 1 SNES Function norm 2.813130743975e-01 > 63 TS dt 2.82524e-11 time 0.271565 > copy! > 0 SNES Function norm 1.849189158431e+00 > 0 KSP preconditioned resid norm 4.231820684255e-10 true resid norm 1.849189158431e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.103282896492e-11 true resid norm 3.234539155275e-01 ||r(i)||/||b|| 1.749166190234 > 2 KSP preconditioned resid norm 2.526336324696e-22 true resid norm 6.913891205901e-12 ||r(i)||/||b|| 3.738877212415 > 1 SNES Function norm 1.849189158431e+00 > 0 SNES Function norm 1.106437703298e-01 > 0 KSP preconditioned resid norm 5.126209904027e-13 true resid norm 1.106437703298e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 4.846798499741e-14 true resid norm 4.840531155629e-02 ||r(i)||/||b|| 4.374879074709 > 2 KSP preconditioned resid norm 1.059052122888e-24 true resid norm 1.127634799619e-13 ||r(i)||/||b|| 1.019157966379 > 1 SNES Function norm 1.071406781366e-01 > 64 TS dt 1.41262e-11 time 0.271565 > copy! > 0 SNES Function norm 1.036597476193e-01 > 0 KSP preconditioned resid norm 2.324014615591e-11 true resid norm 1.036597476193e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.412487586102e-12 true resid norm 5.133394649546e-02 ||r(i)||/||b|| 4.952158159209 > 2 KSP preconditioned resid norm 9.523883793204e-24 true resid norm 5.272794267194e-13 ||r(i)||/||b|| 5.086636219256 > 1 SNES Function norm 1.036597476193e-01 > 0 SNES Function norm 1.081080288554e-01 > 0 KSP preconditioned resid norm 1.084935227116e-12 true resid norm 1.081080288554e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 7.229645091619e-14 true resid norm 5.392749154177e-03 ||r(i)||/||b|| 4.988296624470 > 2 KSP preconditioned resid norm 8.081519853713e-26 true resid norm 1.900661741517e-14 ||r(i)||/||b|| 1.758113399753 > 1 SNES Function norm 4.280304180299e-02 > 65 TS dt 7.06311e-12 time 0.271565 > copy! > 0 SNES Function norm 2.901310268658e-02 > 0 KSP preconditioned resid norm 9.917300891113e-12 true resid norm 2.901310268658e-02 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.434546877621e-12 true resid norm 6.205707705779e-02 ||r(i)||/||b|| 2.138932803161 > 2 KSP preconditioned resid norm 2.529678011006e-24 true resid norm 3.065329426678e-13 ||r(i)||/||b|| 1.056532787890 > 1 SNES Function norm 2.901310268658e-02 > 0 SNES Function norm 6.115306732380e-02 > 0 KSP preconditioned resid norm 2.547917833733e-12 true resid norm 6.115306732380e-02 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.801385928681e-13 true resid norm 3.828533392152e-02 ||r(i)||/||b|| 6.260574587176 > 2 KSP preconditioned resid norm 1.669209280590e-25 true resid norm 6.101206994457e-14 ||r(i)||/||b|| 9.976943531143 > 1 SNES Function norm 6.115306732380e-02 > 0 SNES Function norm 8.316482031597e-02 > 0 KSP preconditioned resid norm 1.012769836049e-13 true resid norm 8.316482031597e-02 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.197763826639e-14 true resid norm 1.249377989981e-02 ||r(i)||/||b|| 1.502291455972 > 2 KSP preconditioned resid norm 4.446090640241e-27 true resid norm 6.863398747477e-15 ||r(i)||/||b|| 8.252766880757 > 1 SNES Function norm 8.316482031597e-02 > 0 SNES Function norm 3.114039374287e-01 > 0 KSP preconditioned resid norm 8.748442759635e-14 true resid norm 3.114039374287e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.226759854372e-14 true resid norm 2.120469361912e-02 ||r(i)||/||b|| 6.809385197312 > 2 KSP preconditioned resid norm 9.397777017132e-28 true resid norm 4.097331860538e-15 ||r(i)||/||b|| 1.315761096141 > 1 SNES Function norm 1.476629082037e-01 > 66 TS dt 2.20722e-13 time 0.271565 > copy! > 0 SNES Function norm 2.741199964540e-01 > 0 KSP preconditioned resid norm 3.188829732248e-13 true resid norm 2.741199964540e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.647675195755e-14 true resid norm 3.703443776834e-02 ||r(i)||/||b|| 1.351030141814 > 2 KSP preconditioned resid norm 2.098519894127e-27 true resid norm 6.898284400613e-15 ||r(i)||/||b|| 2.516519951061 > 1 SNES Function norm 2.741199964540e-01 > 0 SNES Function norm 1.363976538331e+00 > 0 KSP preconditioned resid norm 1.251170838500e-13 true resid norm 1.363976538331e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 9.636645431797e-15 true resid norm 5.264845256515e-02 ||r(i)||/||b|| 3.859923619329 > 2 KSP preconditioned resid norm 7.635303466452e-28 true resid norm 9.257181979862e-15 ||r(i)||/||b|| 6.786907046941 > 1 SNES Function norm 3.620782473843e-01 > 67 TS dt 1.10361e-13 time 0.271565 > copy! > 0 SNES Function norm 2.101847656775e+00 > 0 KSP preconditioned resid norm 4.257244883447e-13 true resid norm 2.101847656775e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.680981244445e-14 true resid norm 5.619073143068e-02 ||r(i)||/||b|| 2.673396963361 > 2 KSP preconditioned resid norm 1.997340575290e-27 true resid norm 1.283993693662e-14 ||r(i)||/||b|| 6.108880867380 > 1 SNES Function norm 5.837297362402e-01 > 68 TS dt 2.20722e-13 time 0.271565 > copy! > 0 SNES Function norm 1.691478479373e+00 > 0 KSP preconditioned resid norm 8.133079044346e-13 true resid norm 1.691478479373e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.698893362948e-13 true resid norm 2.106548414754e-01 ||r(i)||/||b|| 1.245388836123 > 2 KSP preconditioned resid norm 1.128206894627e-26 true resid norm 4.076997707073e-14 ||r(i)||/||b|| 2.410316038182 > 1 SNES Function norm 1.646871085300e+00 > 69 TS dt 4.41444e-13 time 0.271565 > copy! > 0 SNES Function norm 4.140741966573e+00 > 0 KSP preconditioned resid norm 8.449944920915e-12 true resid norm 4.140741966573e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.434715389913e-13 true resid norm 1.581407737712e-01 ||r(i)||/||b|| 3.819140990862 > 2 KSP preconditioned resid norm 4.610158546072e-26 true resid norm 5.765801763725e-14 ||r(i)||/||b|| 1.392456185454 > 1 SNES Function norm 1.278992537889e+00 > 70 TS dt 8.82888e-13 time 0.271565 > copy! > 0 SNES Function norm 4.925810717003e+00 > 0 KSP preconditioned resid norm 1.428864783873e-11 true resid norm 4.925810717003e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.733848835145e-13 true resid norm 5.645045312253e-02 ||r(i)||/||b|| 1.146013445618 > 2 KSP preconditioned resid norm 1.251375367698e-25 true resid norm 5.322015357344e-14 ||r(i)||/||b|| 1.080434402194 > 1 SNES Function norm 4.757993340113e-01 > 71 TS dt 1.76578e-12 time 0.271565 > copy! > 0 SNES Function norm 1.014381910385e+00 > 0 KSP preconditioned resid norm 3.946219055429e-11 true resid norm 1.014381910385e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 5.966786301027e-12 true resid norm 1.033679382452e+00 ||r(i)||/||b|| 1.019023872438 > 2 KSP preconditioned resid norm 2.903362877451e-24 true resid norm 1.280286864393e-12 ||r(i)||/||b|| 1.262134952611 > 1 SNES Function norm 1.014381910385e+00 > 0 SNES Function norm 5.247873040702e-01 > 0 KSP preconditioned resid norm 1.818706815696e-12 true resid norm 5.247873040702e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.258546236990e-13 true resid norm 6.756656786828e-02 ||r(i)||/||b|| 1.287503858120 > 2 KSP preconditioned resid norm 2.177562327102e-26 true resid norm 2.997964765485e-14 ||r(i)||/||b|| 5.712723501946 > 1 SNES Function norm 5.128575534549e-01 > 72 TS dt 8.82888e-13 time 0.271565 > copy! > 0 SNES Function norm 1.463622536847e+00 > 0 KSP preconditioned resid norm 9.747931941457e-12 true resid norm 1.463622536847e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 6.765688549276e-13 true resid norm 2.251123750537e-01 ||r(i)||/||b|| 1.538049390375 > 2 KSP preconditioned resid norm 1.869288517804e-25 true resid norm 1.493803600598e-13 ||r(i)||/||b|| 1.020620797365 > 1 SNES Function norm 1.463622536847e+00 > 0 SNES Function norm 5.760430307939e-01 > 0 KSP preconditioned resid norm 6.381755075677e-13 true resid norm 5.760430307939e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 4.512645640892e-14 true resid norm 5.054200634193e-02 ||r(i)||/||b|| 8.773998406383 > 2 KSP preconditioned resid norm 5.897788241013e-27 true resid norm 1.444726065102e-14 ||r(i)||/||b|| 2.508017609572 > 1 SNES Function norm 4.031598199606e-01 > 73 TS dt 4.41444e-13 time 0.271565 > copy! > 0 SNES Function norm 1.304273554580e+00 > 0 KSP preconditioned resid norm 2.483318267074e-12 true resid norm 1.304273554580e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.092864274592e-13 true resid norm 7.365253445649e-02 ||r(i)||/||b|| 5.647015857820 > 2 KSP preconditioned resid norm 1.918045490471e-26 true resid norm 3.067490789471e-14 ||r(i)||/||b|| 2.351876857964 > 1 SNES Function norm 5.901656814576e-01 > 74 TS dt 8.82888e-13 time 0.271565 > copy! > 0 SNES Function norm 1.806967885919e+00 > 0 KSP preconditioned resid norm 1.254495981226e-12 true resid norm 1.806967885919e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 5.165988305016e-13 true resid norm 5.816785021255e-01 ||r(i)||/||b|| 3.219085998475 > 2 KSP preconditioned resid norm 1.946561591545e-25 true resid norm 1.737891724525e-13 ||r(i)||/||b|| 9.617723358940 > 1 SNES Function norm 1.806967885919e+00 > 0 SNES Function norm 3.525254737467e-01 > 0 KSP preconditioned resid norm 5.330467525907e-13 true resid norm 3.525254737467e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.630807147216e-14 true resid norm 3.919219364897e-02 ||r(i)||/||b|| 1.111754938797 > 2 KSP preconditioned resid norm 5.994572328389e-27 true resid norm 9.229714104420e-15 ||r(i)||/||b|| 2.618169406688 > 1 SNES Function norm 2.971700641320e-01 > 75 TS dt 4.41444e-13 time 0.271565 > copy! > 0 SNES Function norm 9.276360188622e-01 > 0 KSP preconditioned resid norm 1.891036138299e-12 true resid norm 9.276360188622e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 6.946049427296e-14 true resid norm 4.561178088188e-02 ||r(i)||/||b|| 4.916991142477 > 2 KSP preconditioned resid norm 1.256902512171e-26 true resid norm 1.744854906145e-14 ||r(i)||/||b|| 1.880969335672 > 1 SNES Function norm 3.629560323025e-01 > 76 TS dt 8.82888e-13 time 0.271565 > copy! > 0 SNES Function norm 1.281038880923e+00 > 0 KSP preconditioned resid norm 4.415052525028e-12 true resid norm 1.281038880923e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.136240774791e-12 true resid norm 3.697121999437e-01 ||r(i)||/||b|| 2.886034182486 > 2 KSP preconditioned resid norm 2.562962622803e-25 true resid norm 2.399035397213e-13 ||r(i)||/||b|| 1.872726451116 > 1 SNES Function norm 1.281038880923e+00 > 0 SNES Function norm 2.062116742478e-01 > 0 KSP preconditioned resid norm 1.923072172220e-13 true resid norm 2.062116742478e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 4.958504624205e-15 true resid norm 6.829230759572e-03 ||r(i)||/||b|| 3.311757583310 > 2 KSP preconditioned resid norm 1.391184745224e-27 true resid norm 3.773822554237e-15 ||r(i)||/||b|| 1.830072214874 > 1 SNES Function norm 4.076142877095e-02 > 77 TS dt 4.41444e-13 time 0.271565 > copy! > 0 SNES Function norm 2.970990313724e-01 > 0 KSP preconditioned resid norm 9.040615152309e-13 true resid norm 2.970990313724e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 7.232085752735e-14 true resid norm 4.914824284390e-02 ||r(i)||/||b|| 1.654271392837 > 2 KSP preconditioned resid norm 7.636608912666e-27 true resid norm 1.683518570269e-14 ||r(i)||/||b|| 5.666523254863 > 1 SNES Function norm 2.970990313724e-01 > 0 SNES Function norm 3.372906354998e-01 > 0 KSP preconditioned resid norm 1.370644308318e-13 true resid norm 3.372906354998e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.614825882833e-14 true resid norm 3.675107445605e-02 ||r(i)||/||b|| 1.089596644200 > 2 KSP preconditioned resid norm 8.601703784137e-28 true resid norm 4.442878941035e-15 ||r(i)||/||b|| 1.317225701938 > 1 SNES Function norm 2.538611106909e-01 > 78 TS dt 2.20722e-13 time 0.271565 > copy! > 0 SNES Function norm 6.929161829162e-01 > 0 KSP preconditioned resid norm 7.330013379242e-13 true resid norm 6.929161829162e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 4.054917531295e-14 true resid norm 5.498057443165e-02 ||r(i)||/||b|| 7.934664507367 > 2 KSP preconditioned resid norm 7.310884687286e-27 true resid norm 1.292973689106e-14 ||r(i)||/||b|| 1.865988587052 > 1 SNES Function norm 4.533321906044e-01 > 79 TS dt 4.41444e-13 time 0.271565 > copy! > 0 SNES Function norm 1.430558276957e+00 > 0 KSP preconditioned resid norm 1.636116329936e-12 true resid norm 1.430558276957e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 6.817922999930e-14 true resid norm 4.712735639247e-02 ||r(i)||/||b|| 3.294333209041 > 2 KSP preconditioned resid norm 1.146093777731e-26 true resid norm 1.932373607025e-14 ||r(i)||/||b|| 1.350782864390 > 1 SNES Function norm 3.940601459612e-01 > 80 TS dt 8.82888e-13 time 0.271565 > copy! > 0 SNES Function norm 7.524069011779e-01 > 0 KSP preconditioned resid norm 2.481886990312e-12 true resid norm 7.524069011779e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.339301105663e-14 true resid norm 7.656029456180e-03 ||r(i)||/||b|| 1.017538441526 > 2 KSP preconditioned resid norm 2.346841971396e-26 true resid norm 8.847412314801e-15 ||r(i)||/||b|| 1.175881335079 > 1 SNES Function norm 6.651399131369e-02 > 81 TS dt 1.76578e-12 time 0.271565 > copy! > 0 SNES Function norm 9.121363306761e-01 > 0 KSP preconditioned resid norm 1.415277696966e-11 true resid norm 9.121363306761e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.506895452970e-12 true resid norm 4.337437183567e-01 ||r(i)||/||b|| 4.755250983537 > 2 KSP preconditioned resid norm 1.384562439012e-24 true resid norm 5.421357345910e-13 ||r(i)||/||b|| 5.943582295304 > 1 SNES Function norm 9.121363306761e-01 > 0 SNES Function norm 1.548591006657e-01 > 0 KSP preconditioned resid norm 5.616471772316e-13 true resid norm 1.548591006657e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 9.954607379149e-14 true resid norm 5.523767371683e-02 ||r(i)||/||b|| 3.566963354390 > 2 KSP preconditioned resid norm 1.470440737347e-26 true resid norm 2.184049715244e-14 ||r(i)||/||b|| 1.410346376710 > 1 SNES Function norm 1.548591006657e-01 > 0 SNES Function norm 3.363022877948e-01 > 0 KSP preconditioned resid norm 8.467251086447e-14 true resid norm 3.363022877948e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.434324574579e-14 true resid norm 2.672034782109e-02 ||r(i)||/||b|| 7.945336321172 > 2 KSP preconditioned resid norm 1.110644590522e-27 true resid norm 5.785593809905e-15 ||r(i)||/||b|| 1.720355174460 > 1 SNES Function norm 2.439869058762e-01 > 82 TS dt 2.20722e-13 time 0.271565 > copy! > 0 SNES Function norm 1.602729745290e+00 > 0 KSP preconditioned resid norm 9.709062010424e-13 true resid norm 1.602729745290e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 9.355854428092e-14 true resid norm 1.378584285322e-01 ||r(i)||/||b|| 8.601476882629 > 2 KSP preconditioned resid norm 8.483606474061e-27 true resid norm 3.154414053953e-14 ||r(i)||/||b|| 1.968150939497 > 1 SNES Function norm 1.007188504688e+00 > 83 TS dt 4.41444e-13 time 0.271565 > copy! > 0 SNES Function norm 3.461320490774e+00 > 0 KSP preconditioned resid norm 7.492674005874e-12 true resid norm 3.461320490774e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 4.176957625211e-13 true resid norm 2.789428168044e-01 ||r(i)||/||b|| 8.058855501763 > 2 KSP preconditioned resid norm 7.444156283855e-26 true resid norm 1.021992286550e-13 ||r(i)||/||b|| 2.952608084902 > 1 SNES Function norm 2.147586456566e+00 > 84 TS dt 8.82888e-13 time 0.271565 > copy! > 0 SNES Function norm 6.341628072414e+00 > 0 KSP preconditioned resid norm 1.890014038061e-11 true resid norm 6.341628072414e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.459710305760e-13 true resid norm 4.739692900452e-02 ||r(i)||/||b|| 7.473937049493 > 2 KSP preconditioned resid norm 8.252858530640e-26 true resid norm 4.602796303332e-14 ||r(i)||/||b|| 7.258067251459 > 1 SNES Function norm 3.965504408873e-01 > 85 TS dt 1.76578e-12 time 0.271565 > copy! > 0 SNES Function norm 9.612683816763e-01 > 0 KSP preconditioned resid norm 2.356191998211e-11 true resid norm 9.612683816763e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.862087577004e-12 true resid norm 6.694050681105e-01 ||r(i)||/||b|| 6.963768712991 > 2 KSP preconditioned resid norm 1.951534640097e-24 true resid norm 8.287711294991e-13 ||r(i)||/||b|| 8.621641419785 > 1 SNES Function norm 9.612683816763e-01 > 0 SNES Function norm 7.029352448723e-01 > 0 KSP preconditioned resid norm 8.948344944644e-13 true resid norm 7.029352448723e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 5.386128932384e-14 true resid norm 3.219048667133e-02 ||r(i)||/||b|| 4.579438419990 > 2 KSP preconditioned resid norm 1.108923120335e-26 true resid norm 1.627610218719e-14 ||r(i)||/||b|| 2.315448301379 > 1 SNES Function norm 2.593382931820e-01 > 86 TS dt 8.82888e-13 time 0.271565 > copy! > 0 SNES Function norm 3.105068885806e-01 > 0 KSP preconditioned resid norm 1.618419501580e-12 true resid norm 3.105068885806e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.981247261898e-13 true resid norm 1.027739572583e-01 ||r(i)||/||b|| 3.309876883187 > 2 KSP preconditioned resid norm 6.583406103694e-26 true resid norm 6.399058569206e-14 ||r(i)||/||b|| 2.060842707374 > 1 SNES Function norm 3.105068885806e-01 > 0 SNES Function norm 4.981482205604e-01 > 0 KSP preconditioned resid norm 8.626925542249e-13 true resid norm 4.981482205604e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 6.669162705870e-14 true resid norm 7.232605345260e-02 ||r(i)||/||b|| 1.451898259744 > 2 KSP preconditioned resid norm 9.172627809051e-27 true resid norm 1.659330498905e-14 ||r(i)||/||b|| 3.330997543339 > 1 SNES Function norm 4.981482205604e-01 > 0 SNES Function norm 7.138905144630e-01 > 0 KSP preconditioned resid norm 5.742811613241e-14 true resid norm 7.138905144630e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.084547511423e-14 true resid norm 6.979230429959e-02 ||r(i)||/||b|| 9.776331648290 > 2 KSP preconditioned resid norm 6.986277174013e-28 true resid norm 8.250974203380e-15 ||r(i)||/||b|| 1.155775855852 > 1 SNES Function norm 3.696022475452e-01 > 87 TS dt 1.10361e-13 time 0.271565 > copy! > 0 SNES Function norm 8.789063973037e-01 > 0 KSP preconditioned resid norm 2.073370392578e-13 true resid norm 8.789063973037e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 8.600619418517e-15 true resid norm 2.560720526085e-02 ||r(i)||/||b|| 2.913530421375 > 2 KSP preconditioned resid norm 3.498888144974e-28 true resid norm 1.974995118370e-15 ||r(i)||/||b|| 2.247105180288 > 1 SNES Function norm 2.343211520992e-01 > 88 TS dt 2.20722e-13 time 0.271565 > copy! > 0 SNES Function norm 3.552109100087e+00 > 0 KSP preconditioned resid norm 3.072072938848e-12 true resid norm 3.552109100087e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.936295929537e-13 true resid norm 4.080829783621e-01 ||r(i)||/||b|| 1.148846971936 > 2 KSP preconditioned resid norm 2.809147978825e-26 true resid norm 7.254932274516e-14 ||r(i)||/||b|| 2.042429460947 > 1 SNES Function norm 2.944262139143e+00 > 89 TS dt 4.41444e-13 time 0.271565 > copy! > 0 SNES Function norm 7.582944894373e+00 > 0 KSP preconditioned resid norm 8.393978853130e-12 true resid norm 7.582944894373e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 4.262222672686e-13 true resid norm 2.986218296929e-01 ||r(i)||/||b|| 3.938072000424 > 2 KSP preconditioned resid norm 6.640484585438e-26 true resid norm 1.074847335850e-13 ||r(i)||/||b|| 1.417453708054 > 1 SNES Function norm 2.445215958037e+00 > 90 TS dt 8.82888e-13 time 0.271565 > copy! > 0 SNES Function norm 3.577254475804e+00 > 0 KSP preconditioned resid norm 1.115580563317e-11 true resid norm 3.577254475804e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.650683554983e-14 true resid norm 1.178080901429e-02 ||r(i)||/||b|| 3.293254392153 > 2 KSP preconditioned resid norm 7.673544276365e-26 true resid norm 2.812768618506e-14 ||r(i)||/||b|| 7.862925708896 > 1 SNES Function norm 9.478103979365e-02 > 91 TS dt 1.76578e-12 time 0.271565 > copy! > 0 SNES Function norm 3.398926029549e+00 > 0 KSP preconditioned resid norm 5.123364982057e-12 true resid norm 3.398926029549e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.115609694640e-12 true resid norm 9.139384215290e-01 ||r(i)||/||b|| 2.688903534774 > 2 KSP preconditioned resid norm 1.387793573464e-24 true resid norm 5.108329430216e-13 ||r(i)||/||b|| 1.502924566703 > 1 SNES Function norm 2.854550344474e+00 > 92 TS dt 3.53155e-12 time 0.271565 > copy! > 0 SNES Function norm 8.846027110554e+00 > 0 KSP preconditioned resid norm 5.947065097708e-11 true resid norm 8.846027110554e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 5.761881698641e-12 true resid norm 6.337664376005e-01 ||r(i)||/||b|| 7.164418893136 > 2 KSP preconditioned resid norm 7.117755314975e-24 true resid norm 1.565174980493e-12 ||r(i)||/||b|| 1.769353587698 > 1 SNES Function norm 4.478173098971e+00 > 93 TS dt 7.06311e-12 time 0.271565 > copy! > 0 SNES Function norm 9.479827241861e+00 > 0 KSP preconditioned resid norm 1.701559584628e-10 true resid norm 9.479827241861e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 8.315086094503e-12 true resid norm 3.627411941645e-01 ||r(i)||/||b|| 3.826453635808 > 2 KSP preconditioned resid norm 1.798626239608e-23 true resid norm 2.081618631614e-12 ||r(i)||/||b|| 2.195840260065 > 1 SNES Function norm 2.980698125901e+00 > 94 TS dt 1.41262e-11 time 0.271565 > copy! > 0 SNES Function norm 2.583823756970e+00 > 0 KSP preconditioned resid norm 4.104881353739e-11 true resid norm 2.583823756970e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 7.478889497974e-12 true resid norm 4.729547726201e-01 ||r(i)||/||b|| 1.830445173918 > 2 KSP preconditioned resid norm 5.263394780419e-23 true resid norm 2.707360752891e-12 ||r(i)||/||b|| 1.047811695975 > 1 SNES Function norm 1.929142014309e+00 > 95 TS dt 2.82524e-11 time 0.271565 > copy! > 0 SNES Function norm 1.257265283168e-01 > 0 KSP preconditioned resid norm 1.888094035320e-10 true resid norm 1.257265283168e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.700866752609e-11 true resid norm 2.919506838417e-01 ||r(i)||/||b|| 2.322108848072 > 2 KSP preconditioned resid norm 2.762793483719e-22 true resid norm 5.974718530884e-12 ||r(i)||/||b|| 4.752154227810 > 1 SNES Function norm 1.257265283168e-01 > 0 SNES Function norm 2.389423098829e+00 > 0 KSP preconditioned resid norm 7.163702375816e-11 true resid norm 2.389423098829e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 5.293759314015e-13 true resid norm 1.716421726476e-02 ||r(i)||/||b|| 7.183414805513 > 2 KSP preconditioned resid norm 1.175729523003e-24 true resid norm 1.264669953401e-13 ||r(i)||/||b|| 5.292783659876 > 1 SNES Function norm 1.440136831177e-01 > 96 TS dt 1.41262e-11 time 0.271565 > copy! > 0 SNES Function norm 2.101422245445e+00 > 0 KSP preconditioned resid norm 7.152285194626e-11 true resid norm 2.101422245445e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 4.097479577508e-12 true resid norm 9.195764624290e-02 ||r(i)||/||b|| 4.375971865827 > 2 KSP preconditioned resid norm 1.748601892473e-23 true resid norm 1.041205209420e-12 ||r(i)||/||b|| 4.954764382443 > 1 SNES Function norm 7.435685625660e-01 > 97 TS dt 2.82524e-11 time 0.271565 > copy! > 0 SNES Function norm 3.062056964383e+00 > 0 KSP preconditioned resid norm 6.084026768000e-10 true resid norm 3.062056964383e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.895899408610e-11 true resid norm 4.033100253552e-01 ||r(i)||/||b|| 1.317121235975 > 2 KSP preconditioned resid norm 3.441051874886e-22 true resid norm 8.780304816060e-12 ||r(i)||/||b|| 2.867453126507 > 1 SNES Function norm 3.062056964383e+00 > 0 SNES Function norm 1.640638339300e-01 > 0 KSP preconditioned resid norm 5.417809531981e-12 true resid norm 1.640638339300e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.578652530864e-14 true resid norm 8.330361033090e-04 ||r(i)||/||b|| 5.077512108271 > 2 KSP preconditioned resid norm 5.700346043787e-25 true resid norm 1.892267222941e-14 ||r(i)||/||b|| 1.153372548729 > 1 SNES Function norm 7.185385907970e-03 > 98 TS dt 1.41262e-11 time 0.271565 > copy! > 0 SNES Function norm 1.778588005116e-01 > 0 KSP preconditioned resid norm 1.467933269180e-11 true resid norm 1.778588005116e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 7.320665418771e-13 true resid norm 1.500689112501e-02 ||r(i)||/||b|| 8.437530828862 > 2 KSP preconditioned resid norm 7.093249924252e-24 true resid norm 2.009990248879e-13 ||r(i)||/||b|| 1.130104466631 > 1 SNES Function norm 1.179095579605e-01 > 99 TS dt 2.82524e-11 time 0.271565 > copy! > 0 SNES Function norm 2.512082795192e-01 > 0 KSP preconditioned resid norm 2.545260780417e-10 true resid norm 2.512082795192e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.103551821095e-11 true resid norm 3.332276483102e-01 ||r(i)||/||b|| 1.326499464699 > 2 KSP preconditioned resid norm 2.716418948880e-22 true resid norm 6.784375663172e-12 ||r(i)||/||b|| 2.700697475480 > 1 SNES Function norm 2.512082795192e-01 > 0 SNES Function norm 8.541223283936e-02 > 0 KSP preconditioned resid norm 4.670001273164e-12 true resid norm 8.541223283936e-02 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.562541098196e-13 true resid norm 8.434243733496e-03 ||r(i)||/||b|| 9.874749146717 > 2 KSP preconditioned resid norm 6.370478068503e-25 true resid norm 5.778616836687e-14 ||r(i)||/||b|| 6.765561143396 > 1 SNES Function norm 6.589891795632e-02 > 100 TS dt 1.41262e-11 time 0.271565 > copy! > 0 SNES Function norm 2.174757993770e-01 > 0 KSP preconditioned resid norm 2.859280269411e-12 true resid norm 2.174757993770e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.471810140751e-12 true resid norm 6.201078658085e-02 ||r(i)||/||b|| 2.851387913436 > 2 KSP preconditioned resid norm 5.722426147432e-24 true resid norm 3.941686459620e-13 ||r(i)||/||b|| 1.812471305272 > 1 SNES Function norm 2.174757993770e-01 > 0 SNES Function norm 3.006903173936e-02 > 0 KSP preconditioned resid norm 6.535808425657e-13 true resid norm 3.006903173936e-02 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.524559373094e-13 true resid norm 1.019789011252e-02 ||r(i)||/||b|| 3.391492682875 > 2 KSP preconditioned resid norm 1.371358314749e-25 true resid norm 3.214755423120e-14 ||r(i)||/||b|| 1.069125022377 > 1 SNES Function norm 3.006903173936e-02 > 0 SNES Function norm 5.071683999025e-02 > 0 KSP preconditioned resid norm 3.218558385971e-13 true resid norm 5.071683999025e-02 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.425007105445e-14 true resid norm 5.633853826000e-03 ||r(i)||/||b|| 1.110844805607 > 2 KSP preconditioned resid norm 1.798053049205e-26 true resid norm 6.703474165418e-15 ||r(i)||/||b|| 1.321745236238 > 1 SNES Function norm 4.513917663662e-02 > 101 TS dt 1.76578e-12 time 0.271565 > copy! > 0 SNES Function norm 1.261469809763e-01 > 0 KSP preconditioned resid norm 1.032315057640e-12 true resid norm 1.261469809763e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 7.604301669904e-14 true resid norm 1.296411054050e-02 ||r(i)||/||b|| 1.027698835134 > 2 KSP preconditioned resid norm 1.310670285844e-25 true resid norm 2.515529585425e-14 ||r(i)||/||b|| 1.994125872817 > 1 SNES Function norm 9.629885791766e-02 > 102 TS dt 3.53155e-12 time 0.271565 > copy! > 0 SNES Function norm 3.223153986924e-01 > 0 KSP preconditioned resid norm 2.305970581681e-12 true resid norm 3.223153986924e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.976815022230e-13 true resid norm 1.959093829944e-02 ||r(i)||/||b|| 6.078188748945 > 2 KSP preconditioned resid norm 6.568144168886e-25 true resid norm 8.678245455582e-14 ||r(i)||/||b|| 2.692470012537 > 1 SNES Function norm 1.444530545281e-01 > 103 TS dt 7.06311e-12 time 0.271565 > copy! > 0 SNES Function norm 3.103810286198e-01 > 0 KSP preconditioned resid norm 6.997537490850e-11 true resid norm 3.103810286198e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 8.436018618177e-12 true resid norm 3.621194384608e-01 ||r(i)||/||b|| 1.166693209540 > 2 KSP preconditioned resid norm 1.688134668219e-23 true resid norm 1.831353422483e-12 ||r(i)||/||b|| 5.900339433201 > 1 SNES Function norm 3.103810286198e-01 > 0 SNES Function norm 1.063191577145e-01 > 0 KSP preconditioned resid norm 8.698969335864e-13 true resid norm 1.063191577145e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 6.309099373219e-15 true resid norm 8.571707973797e-04 ||r(i)||/||b|| 8.062242175410 > 2 KSP preconditioned resid norm 7.499864860003e-27 true resid norm 2.462681494673e-15 ||r(i)||/||b|| 2.316310199980 > 1 SNES Function norm 1.280948192266e-02 > 104 TS dt 3.53155e-12 time 0.271565 > copy! > 0 SNES Function norm 1.183517461737e-01 > 0 KSP preconditioned resid norm 1.090570879027e-12 true resid norm 1.183517461737e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 4.694477819390e-14 true resid norm 4.063412999276e-03 ||r(i)||/||b|| 3.433335908127 > 2 KSP preconditioned resid norm 4.916221176514e-26 true resid norm 1.355899448286e-14 ||r(i)||/||b|| 1.145652254506 > 1 SNES Function norm 3.338348178983e-02 > 105 TS dt 7.06311e-12 time 0.271565 > copy! > 0 SNES Function norm 1.506755043591e-01 > 0 KSP preconditioned resid norm 3.066688763024e-11 true resid norm 1.506755043591e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.742427906882e-12 true resid norm 1.608109396920e-01 ||r(i)||/||b|| 1.067266642816 > 2 KSP preconditioned resid norm 5.677157047324e-24 true resid norm 8.112232502417e-13 ||r(i)||/||b|| 5.383909306905 > 1 SNES Function norm 1.506755043591e-01 > 0 SNES Function norm 1.678694983365e-02 > 0 KSP preconditioned resid norm 4.701859124640e-13 true resid norm 1.678694983365e-02 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 5.091062630452e-14 true resid norm 6.973109079933e-03 ||r(i)||/||b|| 4.153886887751 > 2 KSP preconditioned resid norm 4.322767172602e-26 true resid norm 1.155415302284e-14 ||r(i)||/||b|| 6.882818580704 > 1 SNES Function norm 1.678694983365e-02 > 0 SNES Function norm 2.211256020366e-02 > 0 KSP preconditioned resid norm 2.163088052431e-13 true resid norm 2.211256020366e-02 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.334586688160e-14 true resid norm 1.543819424718e-02 ||r(i)||/||b|| 6.981640346024 > 2 KSP preconditioned resid norm 4.802892641462e-27 true resid norm 7.248676397051e-15 ||r(i)||/||b|| 3.278081022862 > 1 SNES Function norm 2.211256020366e-02 > 0 SNES Function norm 6.319453516491e-02 > 0 KSP preconditioned resid norm 6.072060969357e-14 true resid norm 6.319453516491e-02 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 8.964391819297e-15 true resid norm 1.554133427814e-02 ||r(i)||/||b|| 2.459284531104 > 2 KSP preconditioned resid norm 5.645620505335e-28 true resid norm 2.227910476902e-15 ||r(i)||/||b|| 3.525479649606 > 1 SNES Function norm 6.319453516491e-02 > 0 SNES Function norm 1.993150558437e+00 > 0 KSP preconditioned resid norm 1.408921226669e-13 true resid norm 1.993150558437e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.137246523173e-14 true resid norm 9.300777627086e-02 ||r(i)||/||b|| 4.666369827264 > 2 KSP preconditioned resid norm 3.373579898708e-28 true resid norm 6.738838901468e-15 ||r(i)||/||b|| 3.380998426306 > 1 SNES Function norm 7.832112166701e-01 > 106 TS dt 5.51805e-14 time 0.271565 > copy! > 0 SNES Function norm 3.629560288909e+00 > 0 KSP preconditioned resid norm 2.855866937659e-13 true resid norm 3.629560288909e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.469091767778e-14 true resid norm 2.028655945992e-01 ||r(i)||/||b|| 5.589260914581 > 2 KSP preconditioned resid norm 1.191764462912e-27 true resid norm 1.834164299648e-14 ||r(i)||/||b|| 5.053406345813 > 1 SNES Function norm 1.672457508921e+00 > 107 TS dt 1.10361e-13 time 0.271565 > copy! > 0 SNES Function norm 4.062643571582e+00 > 0 KSP preconditioned resid norm 1.085854715813e-12 true resid norm 4.062643571582e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.178769832441e-14 true resid norm 1.118410859325e-01 ||r(i)||/||b|| 2.752914056129 > 2 KSP preconditioned resid norm 4.297181573967e-27 true resid norm 2.628615092202e-14 ||r(i)||/||b|| 6.470208488357 > 1 SNES Function norm 9.036991011875e-01 > 108 TS dt 2.20722e-13 time 0.271565 > copy! > 0 SNES Function norm 4.105674791223e+00 > 0 KSP preconditioned resid norm 1.963614457879e-12 true resid norm 4.105674791223e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 6.051107635909e-14 true resid norm 8.277420683114e-02 ||r(i)||/||b|| 2.016092628868 > 2 KSP preconditioned resid norm 5.700654872204e-27 true resid norm 2.220252793344e-14 ||r(i)||/||b|| 5.407765851524 > 1 SNES Function norm 6.003561441737e-01 > 109 TS dt 4.41444e-13 time 0.271565 > copy! > 0 SNES Function norm 3.053877992744e+00 > 0 KSP preconditioned resid norm 1.003248415294e-11 true resid norm 3.053877992744e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 8.233646686238e-13 true resid norm 5.577994771593e-01 ||r(i)||/||b|| 1.826528363230 > 2 KSP preconditioned resid norm 1.029901304608e-25 true resid norm 1.936015096597e-13 ||r(i)||/||b|| 6.339529939299 > 1 SNES Function norm 3.053877992744e+00 > 0 SNES Function norm 5.829087412676e-01 > 0 KSP preconditioned resid norm 1.889341282348e-13 true resid norm 5.829087412676e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.662933221169e-14 true resid norm 5.989286100184e-02 ||r(i)||/||b|| 1.027482635989 > 2 KSP preconditioned resid norm 1.456379026302e-27 true resid norm 7.668848909744e-15 ||r(i)||/||b|| 1.315617414326 > 1 SNES Function norm 4.254244459909e-01 > 110 TS dt 2.20722e-13 time 0.271565 > copy! > 0 SNES Function norm 1.180846267144e+00 > 0 KSP preconditioned resid norm 9.105704411362e-13 true resid norm 1.180846267144e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.670199723048e-14 true resid norm 5.057066847784e-02 ||r(i)||/||b|| 4.282578510423 > 2 KSP preconditioned resid norm 4.325921784021e-27 true resid norm 1.275361754352e-14 ||r(i)||/||b|| 1.080040467449 > 1 SNES Function norm 3.911236882643e-01 > 111 TS dt 4.41444e-13 time 0.271565 > copy! > 0 SNES Function norm 1.532064854858e+00 > 0 KSP preconditioned resid norm 4.779679137769e-12 true resid norm 1.532064854858e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.157872991170e-13 true resid norm 2.098875091408e-01 ||r(i)||/||b|| 1.369964910266 > 2 KSP preconditioned resid norm 4.366911735365e-26 true resid norm 7.239962529738e-14 ||r(i)||/||b|| 4.725624053563 > 1 SNES Function norm 1.532064854858e+00 > 0 SNES Function norm 1.764940070080e-01 > 0 KSP preconditioned resid norm 2.464402583943e-14 true resid norm 1.764940070080e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 6.215297019902e-15 true resid norm 2.047617209569e-02 ||r(i)||/||b|| 1.160162457797 > 2 KSP preconditioned resid norm 3.631831094940e-28 true resid norm 2.355763139437e-15 ||r(i)||/||b|| 1.334755315136 > 1 SNES Function norm 1.706450714666e-01 > 112 TS dt 2.20722e-13 time 0.271565 > copy! > 0 SNES Function norm 4.407680008950e-01 > 0 KSP preconditioned resid norm 4.930548470884e-13 true resid norm 4.407680008950e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 5.356345294181e-14 true resid norm 7.551962516450e-02 ||r(i)||/||b|| 1.713364514011 > 2 KSP preconditioned resid norm 4.584264258499e-27 true resid norm 1.292315985984e-14 ||r(i)||/||b|| 2.931964170176 > 1 SNES Function norm 4.407680008950e-01 > 0 SNES Function norm 1.064954076440e+00 > 0 KSP preconditioned resid norm 8.497424886833e-14 true resid norm 1.064954076440e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 5.766159625691e-15 true resid norm 2.490017627469e-02 ||r(i)||/||b|| 2.338145543133 > 2 KSP preconditioned resid norm 6.635425384718e-28 true resid norm 8.234479883376e-15 ||r(i)||/||b|| 7.732239413465 > 1 SNES Function norm 2.964963371165e-01 > 113 TS dt 1.10361e-13 time 0.271565 > copy! > 0 SNES Function norm 8.622925709624e-01 > 0 KSP preconditioned resid norm 4.463457031339e-13 true resid norm 8.622925709624e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 4.715977525563e-14 true resid norm 1.329341326415e-01 ||r(i)||/||b|| 1.541636065508 > 2 KSP preconditioned resid norm 2.945289610486e-27 true resid norm 1.273616756823e-14 ||r(i)||/||b|| 1.477012327036 > 1 SNES Function norm 8.622925709624e-01 > 0 SNES Function norm 2.612065167743e+00 > 0 KSP preconditioned resid norm 1.216980364706e-13 true resid norm 2.612065167743e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 9.591070115731e-15 true resid norm 1.117348786244e-01 ||r(i)||/||b|| 4.277645137044 > 2 KSP preconditioned resid norm 6.045627145118e-28 true resid norm 1.388069047834e-14 ||r(i)||/||b|| 5.314067447381 > 1 SNES Function norm 1.331790654620e+00 > 114 TS dt 5.51805e-14 time 0.271565 > copy! > 0 SNES Function norm 3.606851714788e+00 > 0 KSP preconditioned resid norm 4.067733329812e-13 true resid norm 3.606851714788e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.823877861556e-14 true resid norm 1.077790820977e-01 ||r(i)||/||b|| 2.988176133103 > 2 KSP preconditioned resid norm 4.727810534551e-28 true resid norm 7.519886149541e-15 ||r(i)||/||b|| 2.084889189846 > 1 SNES Function norm 9.013753678258e-01 > 115 TS dt 1.10361e-13 time 0.271565 > copy! > 0 SNES Function norm 3.227741616537e+00 > 0 KSP preconditioned resid norm 7.976107877122e-13 true resid norm 3.227741616537e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 3.326079645062e-14 true resid norm 1.010611637550e-01 ||r(i)||/||b|| 3.131017775316 > 2 KSP preconditioned resid norm 3.388023427292e-27 true resid norm 1.918813178565e-14 ||r(i)||/||b|| 5.944754588577 > 1 SNES Function norm 7.734015655943e-01 > 116 TS dt 2.20722e-13 time 0.271565 > copy! > 0 SNES Function norm 2.393623504956e+00 > 0 KSP preconditioned resid norm 1.608960463713e-12 true resid norm 2.393623504956e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 4.457509300959e-14 true resid norm 6.395509588463e-02 ||r(i)||/||b|| 2.671894546164 > 2 KSP preconditioned resid norm 1.031673495966e-26 true resid norm 2.303431837034e-14 ||r(i)||/||b|| 9.623200274667 > 1 SNES Function norm 4.969182786938e-01 > 117 TS dt 4.41444e-13 time 0.271565 > copy! > 0 SNES Function norm 2.596405006351e+00 > 0 KSP preconditioned resid norm 4.993386282508e-12 true resid norm 2.596405006351e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.113373830574e-12 true resid norm 7.480031452187e-01 ||r(i)||/||b|| 2.880918590856 > 2 KSP preconditioned resid norm 1.249282305831e-25 true resid norm 2.418510317361e-13 ||r(i)||/||b|| 9.314842297119 > 1 SNES Function norm 2.596405006351e+00 > 0 SNES Function norm 4.974558747187e-01 > 0 KSP preconditioned resid norm 1.517572543094e-13 true resid norm 4.974558747187e-01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.284261373562e-14 true resid norm 3.075576674000e-02 ||r(i)||/||b|| 6.182612027126 > 2 KSP preconditioned resid norm 8.899015955837e-28 true resid norm 5.037510039676e-15 ||r(i)||/||b|| 1.012654648520 > 1 SNES Function norm 2.909443551880e-01 > 118 TS dt 2.20722e-13 time 0.271565 > copy! > 0 SNES Function norm 1.088860095507e+00 > 0 KSP preconditioned resid norm 8.259380793768e-13 true resid norm 1.088860095507e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 6.146289565587e-14 true resid norm 8.801960855155e-02 ||r(i)||/||b|| 8.083647193494 > 2 KSP preconditioned resid norm 6.542880856158e-27 true resid norm 1.745113143419e-14 ||r(i)||/||b|| 1.602697307597 > 1 SNES Function norm 6.203518870415e-01 > 119 TS dt 4.41444e-13 time 0.271565 > copy! > 0 SNES Function norm 1.828717001803e+00 > 0 KSP preconditioned resid norm 4.269088444122e-12 true resid norm 1.828717001803e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.812126037081e-13 true resid norm 1.188943176912e-01 ||r(i)||/||b|| 6.501515410749 > 2 KSP preconditioned resid norm 2.087655349967e-26 true resid norm 4.228142299992e-14 ||r(i)||/||b|| 2.312081254685 > 1 SNES Function norm 9.407254842319e-01 > 120 TS dt 8.82888e-13 time 0.271565 > copy! > 0 SNES Function norm 2.970950728036e+00 > 0 KSP preconditioned resid norm 1.617443380237e-11 true resid norm 2.970950728036e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 8.861956154914e-13 true resid norm 2.920843259110e-01 ||r(i)||/||b|| 9.831341972610 > 2 KSP preconditioned resid norm 2.385942331865e-25 true resid norm 2.019781312789e-13 ||r(i)||/||b|| 6.798434230930 > 1 SNES Function norm 2.277472194573e+00 > 121 TS dt 1.76578e-12 time 0.271565 > copy! > 0 SNES Function norm 6.655252327413e+00 > 0 KSP preconditioned resid norm 1.940972430816e-11 true resid norm 6.655252327413e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.363154535742e-12 true resid norm 6.207663299839e-01 ||r(i)||/||b|| 9.327464977202 > 2 KSP preconditioned resid norm 1.739471177685e-24 true resid norm 6.857043712083e-13 ||r(i)||/||b|| 1.030320621179 > 1 SNES Function norm 3.860967926913e+00 > 122 TS dt 3.53155e-12 time 0.271565 > copy! > 0 SNES Function norm 8.141502067665e+00 > 0 KSP preconditioned resid norm 2.861146567034e-11 true resid norm 8.141502067665e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 5.627735131533e-12 true resid norm 1.790291714119e+00 ||r(i)||/||b|| 2.198969796040 > 2 KSP preconditioned resid norm 9.558838466264e-24 true resid norm 2.239279225704e-12 ||r(i)||/||b|| 2.750449741453 > 1 SNES Function norm 6.426598300871e+00 > 123 TS dt 7.06311e-12 time 0.271565 > copy! > 0 SNES Function norm 1.224562198048e+01 > 0 KSP preconditioned resid norm 1.860092428595e-10 true resid norm 1.224562198048e+01 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 1.412376301911e-11 true resid norm 6.881778695473e-01 ||r(i)||/||b|| 5.619786978926 > 2 KSP preconditioned resid norm 3.119097349134e-23 true resid norm 3.694807748646e-12 ||r(i)||/||b|| 3.017247923002 > 1 SNES Function norm 5.283049961509e+00 > 124 TS dt 1.41262e-11 time 0.271565 > copy! > 0 SNES Function norm 5.780124419709e+00 > 0 KSP preconditioned resid norm 2.355254806679e-10 true resid norm 5.780124419709e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 7.026309613126e-12 true resid norm 1.462739352259e-01 ||r(i)||/||b|| 2.530636446633 > 2 KSP preconditioned resid norm 4.007977791166e-23 true resid norm 1.760862449704e-12 ||r(i)||/||b|| 3.046409249773 > 1 SNES Function norm 1.227257133866e+00 > 125 TS dt 2.82524e-11 time 0.271565 > copy! > 0 SNES Function norm 5.063237678461e+00 > 0 KSP preconditioned resid norm 1.132388220275e-09 true resid norm 5.063237678461e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 8.141022667213e-11 true resid norm 8.476518026367e-01 ||r(i)||/||b|| 1.674129986515 > 2 KSP preconditioned resid norm 6.201902296105e-22 true resid norm 1.808797506267e-11 ||r(i)||/||b|| 3.572412794212 > 1 SNES Function norm 4.907594073483e+00 > 126 TS dt 5.65048e-11 time 0.271565 > copy! > 0 SNES Function norm 8.280289521084e+00 > 0 KSP preconditioned resid norm 1.016908346818e-09 true resid norm 8.280289521084e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 7.542353161709e-11 true resid norm 4.553108039388e-01 ||r(i)||/||b|| 5.498730482544 > 2 KSP preconditioned resid norm 1.286724699239e-21 true resid norm 1.963867830074e-11 ||r(i)||/||b|| 2.371738119873 > 1 SNES Function norm 3.515932015486e+00 > 127 TS dt 1.1301e-10 time 0.271565 > copy! > 0 SNES Function norm 2.638351398877e+00 > 0 KSP preconditioned resid norm 8.318417737715e-10 true resid norm 2.638351398877e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 2.886536821595e-11 true resid norm 7.583100218372e-02 ||r(i)||/||b|| 2.874181286693 > 2 KSP preconditioned resid norm 1.101294596184e-21 true resid norm 7.150867353793e-12 ||r(i)||/||b|| 2.710354411788 > 1 SNES Function norm 6.341356656368e-01 > 128 TS dt 2.26019e-10 time 0.271565 > copy! > 0 SNES Function norm 4.327811744723e+00 > 0 KSP preconditioned resid norm 9.707711632195e-09 true resid norm 4.327811744723e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 8.220441545084e-10 true resid norm 1.079734109206e+00 ||r(i)||/||b|| 2.494873097293 > 2 KSP preconditioned resid norm 5.565090370575e-20 true resid norm 1.824401176064e-10 ||r(i)||/||b|| 4.215528039751 > 1 SNES Function norm 1.736633786129e-01 > 129 TS dt 4.52039e-10 time 0.271565 > copy! > 0 SNES Function norm 3.450425343262e+00 > 0 KSP preconditioned resid norm 5.403348982018e-08 true resid norm 3.450425343262e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 6.555040648017e-09 true resid norm 4.397639385930e+00 ||r(i)||/||b|| 1.274520949864 > 2 KSP preconditioned resid norm 8.635871880972e-19 true resid norm 1.425658172221e-09 ||r(i)||/||b|| 4.131833123140 > 1 SNES Function norm 1.373376592274e+00 > 130 TS dt 9.04078e-10 time 0.271565 > copy! > 0 SNES Function norm 4.603810494450e+00 > 0 KSP preconditioned resid norm 4.317990603404e-07 true resid norm 4.603810494450e+00 ||r(i)||/||b|| 1.000000000000 > 1 KSP preconditioned resid norm 5.666497114486e-08 true resid norm 1.908034902688e+01 ||r(i)||/||b|| 4.144468815536 > 2 KSP preconditioned resid norm 1.483356956179e-17 true resid norm 1.226697895774e-08 ||r(i)||/||b|| 2.664527345886 > 1 SNES Function norm 1.142888930566e+00 > > > From: Matthew Knepley <knepley(a)gmail.com <mailto:[email protected]>> > Sent: Tuesday, January 5, 2021 2:53 PM > To: Sepideh Kavousi <skavou1(a)lsu.edu <mailto:[email protected]>> > Cc: petsc-users(a)mcs.anl.gov <mailto:[email protected]> <petsc-users(a)mcs.anl.gov <mailto:[email protected]>> > Subject: Re: [petsc-users] convergence problem- 3D Cahn Hillard > > On Tue, Jan 5, 2021 at 3:14 PM Sepideh Kavousi <skavou1(a)lsu.edu <mailto:[email protected]>> wrote: > Dear Petsc Users > I wrote a code in 2D solving PF equations for solidification of alloys. I have two variables in the equations 1-non-dimensional concentration (U) 2- order parameter (p). Everything is fine with this code. > When I change the code to 3D, the code has convergence problems which I cannot solve it. > I know the term which is causing problem is a term in the equation for U: > (dp/dt)*(Pxx+Pyy+Pzz) > where Pxx,Pyy,Pzz are the second derivative of order parameter in x,y,z, respectively. > > When I eliminate this term, the results of 2D and 3D are close to each other. But adding that term the time step should be reduced a lot to obtain convergence, otherwise the timestep does not converge. I have no idea how I should solve this problem. > I solve the equations considering (I chose based on suggestions of Moose for solving Cahn-hillard) > -ts_type bdf -ts_bdf_adapt -pc_type bjacobi -snes_linesearch_type l2 -snes_type newtontr -ksp_type gmres -ksp_gmres_restart 1001 -sub_pc_type ilu -sub_ksp_type preonly > > Would you please help me solve this issue? > > In order to see the solver you have we need the output of > > -ts_view > > and then to see what is happening during the run we need > > -ts_monitor -snes_monitor -snes_linesearch_monitor -ksp_monitor_true_residual > > Thanks, > > Matt > > Best, > sepideh > > > > -- > What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead. > -- Norbert Wiener > > https://www.cse.buffalo.edu/~knepley/ <https://nam04.safelinks.protection.outlook.com/?url=http:%2F%2Fwww.cse.buff…> > > > -- > What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead. > -- Norbert Wiener > > https://www.cse.buffalo.edu/~knepley/ <https://nam04.safelinks.protection.outlook.com/?url=http:%2F%2Fwww.cse.buff…> > > > -- > What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead. > -- Norbert Wiener > > https://www.cse.buffalo.edu/~knepley/ <http://www.cse.buffalo.edu/~knepley/>

1 0

Re: [petsc-dev] builds of PETSc based packages should not get their own secret files
by Barry Smith 05 Jan '21

05 Jan '21

> On Jan 5, 2021, at 5:30 PM, Satish Balay via petsc-dev <petsc-dev(a)mcs.anl.gov> wrote: > > BTW: for CI - the following might grab most of the config logs as artifacts [assuming they are either config.log or configure.log] - but yeah - all logs won't be in the same location [or single file, and good to have a fix that works for both users and CI] > > Satish > > ---- > > diff --git a/.gitlab-ci.yml b/.gitlab-ci.yml > index 8f3d139235..53de0fd875 100644 > --- a/.gitlab-ci.yml > +++ b/.gitlab-ci.yml > @@ -76,6 +76,7 @@ check-ci-settings: > name: "$CI_JOB_NAME" > when: always > paths: > + - arch-*/externalpackages/*/*.log You are assuming one level of nesting of external packages. This is not correct. SLEPc nests SLEPc4py down yet another level so its logs would not be saved with this rule. > - arch-*/lib/petsc/conf/*.log > - arch-*/lib/pkgconfig/PETSc.pc > - arch-*/tests/testresults.xml > > > > On Tue, 5 Jan 2021, Satish Balay via petsc-dev wrote: > >> On Tue, 5 Jan 2021, Satish Balay via petsc-dev wrote: >> >>> On Tue, 5 Jan 2021, Barry Smith wrote: >>> >>>> >>>> >>>>> On Jan 5, 2021, at 8:28 AM, Satish Balay <balay(a)mcs.anl.gov> wrote: >>>>> >>>>> Well we have to look at artifacts for configure.log. Why is this more of a burden for slepc or externalpackage logs? >>>> >>>> Some of the "artifacts" don't even exist to look at as artifacts; for example slepc4py log files. And if we continue with the current model more and more "artifacts" won't exist unless we add them (and we will forget to add them). >> >> BTW: If the logs are in a single location - and we have a wildscard (*.log or loc/*) that can capture them all - there won't be an issue with 'forget to add'. But a single log is also fine [if the contents are well separated for each package - like 'more *.log' does..] >> >> >>> I am fine with the output being in configure.log (as is the case for configures on external packages) or in make.log, it doesn't have to be in the CI console window, but it can't be scattered in dozens of files. >>> >>> We've never saved config.log [or equivalent] for all externalpackages [build either during configure or after petsc] >>> >>> Currently we just save the build logs [to either configure.log - for packages that are built during configure, or to PETSC_ARCH/lib/petsc/conf - for packages that are built after petsc. >>> >>> If we can add config.log [or equivalent] for all externalpackages to some log file - or to PETSC_ARCH/lib/petsc/conf - that would be fine [and can be added to artifacts]. >>> >>> [currently make.log equivalent that we dump into configure.log is a bad format - stdout and stderr separated - so hard to co-relate errors to the commands invoked] >>> >>> >>> BTW: One of the reasons we had separate petsc4py.log and slepc.py log was we wanted make.log clean for our users - so that the commands we recommend [for subsequent steps] are not easily ignored. >>> >>> [anything on stdout for CI will also be on stdout for users] >> >> However we can have it saved in a log - and than do a 'cat' [as shown below] - to have the logs on stdout - for CI (and avoid for users) >> >> But then - we do want an easy mechanism for users to send us logs [here a single logfile or a tarball that users can send u is most convenient] >> >> Satish >> >>> >>> Satish >>> >>> >>>> >>>> >>>>> >>>>> Whatever you say for slepc log applies for configure.log. If its only CI issue - and you want all logs on STDOUT - then you can modify .gitlab-ci.yml. Perhaps: >>>>> >>>>> >>>>> diff --git a/.gitlab-ci.yml b/.gitlab-ci.yml >>>>> index 8f3d139235..f9cdd38abd 100644 >>>>> --- a/.gitlab-ci.yml >>>>> +++ b/.gitlab-ci.yml >>>>> @@ -70,6 +70,7 @@ check-ci-settings: >>>>> after_script: >>>>> - date >>>>> - ccache --show-stats >>>>> + - more arch-*/lib/petsc/conf/*.log |cat >>>>> artifacts: >>>>> reports: >>>>> junit: arch-*/tests/testresults.xml >>>>> >>>>> Satish >>>>> >>>>> >>>>> On Mon, 4 Jan 2021, Barry Smith wrote: >>>>> >>>>>> >>>>>> For packages that are built after PETSc configure (and or install is done) slepc, hpddm etc we've traditional saved the output in its own file stashed away somewhere. >>>>>> >>>>>> For the CI this is driving me nuts because when they fail the output is essentially "lost" and thus it is impossible to determine what has gone wrong. >>>>>> >>>>>> I have started to directly output in the same stream as the PETSc compiles to make debugging much easier. Generally the packages are relatively small and don't have a huge amount of output when compiling correctly. I did it for PETSc4py and SLEPc (slepc4py is a mystery yet how it get's hidden in slepc). >>>>>> >>>>>> Are there any large downsides to this plan? >>>>>> >>>>>> Barry >>>>>> >>>>>> >>>>> >>>> >>> >> >

1 0

Re: [petsc-dev] builds of PETSc based packages should not get their own secret files
by Satish Balay 05 Jan '21

05 Jan '21

BTW: for CI - the following might grab most of the config logs as artifacts [assuming they are either config.log or configure.log] - but yeah - all logs won't be in the same location [or single file, and good to have a fix that works for both users and CI] Satish ---- diff --git a/.gitlab-ci.yml b/.gitlab-ci.yml index 8f3d139235..53de0fd875 100644 --- a/.gitlab-ci.yml +++ b/.gitlab-ci.yml @@ -76,6 +76,7 @@ check-ci-settings: name: "$CI_JOB_NAME" when: always paths: + - arch-*/externalpackages/*/*.log - arch-*/lib/petsc/conf/*.log - arch-*/lib/pkgconfig/PETSc.pc - arch-*/tests/testresults.xml On Tue, 5 Jan 2021, Satish Balay via petsc-dev wrote: > On Tue, 5 Jan 2021, Satish Balay via petsc-dev wrote: > > > On Tue, 5 Jan 2021, Barry Smith wrote: > > > > > > > > > > > > On Jan 5, 2021, at 8:28 AM, Satish Balay <balay(a)mcs.anl.gov> wrote: > > > > > > > > Well we have to look at artifacts for configure.log. Why is this more of a burden for slepc or externalpackage logs? > > > > > > Some of the "artifacts" don't even exist to look at as artifacts; for example slepc4py log files. And if we continue with the current model more and more "artifacts" won't exist unless we add them (and we will forget to add them). > > BTW: If the logs are in a single location - and we have a wildscard (*.log or loc/*) that can capture them all - there won't be an issue with 'forget to add'. But a single log is also fine [if the contents are well separated for each package - like 'more *.log' does..] > > > > I am fine with the output being in configure.log (as is the case for configures on external packages) or in make.log, it doesn't have to be in the CI console window, but it can't be scattered in dozens of files. > > > > We've never saved config.log [or equivalent] for all externalpackages [build either during configure or after petsc] > > > > Currently we just save the build logs [to either configure.log - for packages that are built during configure, or to PETSC_ARCH/lib/petsc/conf - for packages that are built after petsc. > > > > If we can add config.log [or equivalent] for all externalpackages to some log file - or to PETSC_ARCH/lib/petsc/conf - that would be fine [and can be added to artifacts]. > > > > [currently make.log equivalent that we dump into configure.log is a bad format - stdout and stderr separated - so hard to co-relate errors to the commands invoked] > > > > > > BTW: One of the reasons we had separate petsc4py.log and slepc.py log was we wanted make.log clean for our users - so that the commands we recommend [for subsequent steps] are not easily ignored. > > > > [anything on stdout for CI will also be on stdout for users] > > However we can have it saved in a log - and than do a 'cat' [as shown below] - to have the logs on stdout - for CI (and avoid for users) > > But then - we do want an easy mechanism for users to send us logs [here a single logfile or a tarball that users can send u is most convenient] > > Satish > > > > > Satish > > > > > > > > > > > > > > > > > > Whatever you say for slepc log applies for configure.log. If its only CI issue - and you want all logs on STDOUT - then you can modify .gitlab-ci.yml. Perhaps: > > > > > > > > > > > > diff --git a/.gitlab-ci.yml b/.gitlab-ci.yml > > > > index 8f3d139235..f9cdd38abd 100644 > > > > --- a/.gitlab-ci.yml > > > > +++ b/.gitlab-ci.yml > > > > @@ -70,6 +70,7 @@ check-ci-settings: > > > > after_script: > > > > - date > > > > - ccache --show-stats > > > > + - more arch-*/lib/petsc/conf/*.log |cat > > > > artifacts: > > > > reports: > > > > junit: arch-*/tests/testresults.xml > > > > > > > > Satish > > > > > > > > > > > > On Mon, 4 Jan 2021, Barry Smith wrote: > > > > > > > >> > > > >> For packages that are built after PETSc configure (and or install is done) slepc, hpddm etc we've traditional saved the output in its own file stashed away somewhere. > > > >> > > > >> For the CI this is driving me nuts because when they fail the output is essentially "lost" and thus it is impossible to determine what has gone wrong. > > > >> > > > >> I have started to directly output in the same stream as the PETSc compiles to make debugging much easier. Generally the packages are relatively small and don't have a huge amount of output when compiling correctly. I did it for PETSc4py and SLEPc (slepc4py is a mystery yet how it get's hidden in slepc). > > > >> > > > >> Are there any large downsides to this plan? > > > >> > > > >> Barry > > > >> > > > >> > > > > > > > > > >

1 0

Re: [petsc-dev] builds of PETSc based packages should not get their own secret files
by Satish Balay 05 Jan '21

05 Jan '21

On Tue, 5 Jan 2021, Satish Balay via petsc-dev wrote: > On Tue, 5 Jan 2021, Barry Smith wrote: > > > > > > > > On Jan 5, 2021, at 8:28 AM, Satish Balay <balay(a)mcs.anl.gov> wrote: > > > > > > Well we have to look at artifacts for configure.log. Why is this more of a burden for slepc or externalpackage logs? > > > > Some of the "artifacts" don't even exist to look at as artifacts; for example slepc4py log files. And if we continue with the current model more and more "artifacts" won't exist unless we add them (and we will forget to add them). BTW: If the logs are in a single location - and we have a wildscard (*.log or loc/*) that can capture them all - there won't be an issue with 'forget to add'. But a single log is also fine [if the contents are well separated for each package - like 'more *.log' does..] > I am fine with the output being in configure.log (as is the case for configures on external packages) or in make.log, it doesn't have to be in the CI console window, but it can't be scattered in dozens of files. > > We've never saved config.log [or equivalent] for all externalpackages [build either during configure or after petsc] > > Currently we just save the build logs [to either configure.log - for packages that are built during configure, or to PETSC_ARCH/lib/petsc/conf - for packages that are built after petsc. > > If we can add config.log [or equivalent] for all externalpackages to some log file - or to PETSC_ARCH/lib/petsc/conf - that would be fine [and can be added to artifacts]. > > [currently make.log equivalent that we dump into configure.log is a bad format - stdout and stderr separated - so hard to co-relate errors to the commands invoked] > > > BTW: One of the reasons we had separate petsc4py.log and slepc.py log was we wanted make.log clean for our users - so that the commands we recommend [for subsequent steps] are not easily ignored. > > [anything on stdout for CI will also be on stdout for users] However we can have it saved in a log - and than do a 'cat' [as shown below] - to have the logs on stdout - for CI (and avoid for users) But then - we do want an easy mechanism for users to send us logs [here a single logfile or a tarball that users can send u is most convenient] Satish > > Satish > > > > > > > > > > > > Whatever you say for slepc log applies for configure.log. If its only CI issue - and you want all logs on STDOUT - then you can modify .gitlab-ci.yml. Perhaps: > > > > > > > > > diff --git a/.gitlab-ci.yml b/.gitlab-ci.yml > > > index 8f3d139235..f9cdd38abd 100644 > > > --- a/.gitlab-ci.yml > > > +++ b/.gitlab-ci.yml > > > @@ -70,6 +70,7 @@ check-ci-settings: > > > after_script: > > > - date > > > - ccache --show-stats > > > + - more arch-*/lib/petsc/conf/*.log |cat > > > artifacts: > > > reports: > > > junit: arch-*/tests/testresults.xml > > > > > > Satish > > > > > > > > > On Mon, 4 Jan 2021, Barry Smith wrote: > > > > > >> > > >> For packages that are built after PETSc configure (and or install is done) slepc, hpddm etc we've traditional saved the output in its own file stashed away somewhere. > > >> > > >> For the CI this is driving me nuts because when they fail the output is essentially "lost" and thus it is impossible to determine what has gone wrong. > > >> > > >> I have started to directly output in the same stream as the PETSc compiles to make debugging much easier. Generally the packages are relatively small and don't have a huge amount of output when compiling correctly. I did it for PETSc4py and SLEPc (slepc4py is a mystery yet how it get's hidden in slepc). > > >> > > >> Are there any large downsides to this plan? > > >> > > >> Barry > > >> > > >> > > > > > >

1 0

Re: [petsc-dev] builds of PETSc based packages should not get their own secret files
by Satish Balay 05 Jan '21

05 Jan '21

On Tue, 5 Jan 2021, Barry Smith wrote: > > > > On Jan 5, 2021, at 8:28 AM, Satish Balay <balay(a)mcs.anl.gov> wrote: > > > > Well we have to look at artifacts for configure.log. Why is this more of a burden for slepc or externalpackage logs? > > Some of the "artifacts" don't even exist to look at as artifacts; for example slepc4py log files. And if we continue with the current model more and more "artifacts" won't exist unless we add them (and we will forget to add them). I am fine with the output being in configure.log (as is the case for configures on external packages) or in make.log, it doesn't have to be in the CI console window, but it can't be scattered in dozens of files. We've never saved config.log [or equivalent] for all externalpackages [build either during configure or after petsc] Currently we just save the build logs [to either configure.log - for packages that are built during configure, or to PETSC_ARCH/lib/petsc/conf - for packages that are built after petsc. If we can add config.log [or equivalent] for all externalpackages to some log file - or to PETSC_ARCH/lib/petsc/conf - that would be fine [and can be added to artifacts]. [currently make.log equivalent that we dump into configure.log is a bad format - stdout and stderr separated - so hard to co-relate errors to the commands invoked] BTW: One of the reasons we had separate petsc4py.log and slepc.py log was we wanted make.log clean for our users - so that the commands we recommend [for subsequent steps] are not easily ignored. [anything on stdout for CI will also be on stdout for users] Satish > > > > > > Whatever you say for slepc log applies for configure.log. If its only CI issue - and you want all logs on STDOUT - then you can modify .gitlab-ci.yml. Perhaps: > > > > > > diff --git a/.gitlab-ci.yml b/.gitlab-ci.yml > > index 8f3d139235..f9cdd38abd 100644 > > --- a/.gitlab-ci.yml > > +++ b/.gitlab-ci.yml > > @@ -70,6 +70,7 @@ check-ci-settings: > > after_script: > > - date > > - ccache --show-stats > > + - more arch-*/lib/petsc/conf/*.log |cat > > artifacts: > > reports: > > junit: arch-*/tests/testresults.xml > > > > Satish > > > > > > On Mon, 4 Jan 2021, Barry Smith wrote: > > > >> > >> For packages that are built after PETSc configure (and or install is done) slepc, hpddm etc we've traditional saved the output in its own file stashed away somewhere. > >> > >> For the CI this is driving me nuts because when they fail the output is essentially "lost" and thus it is impossible to determine what has gone wrong. > >> > >> I have started to directly output in the same stream as the PETSc compiles to make debugging much easier. Generally the packages are relatively small and don't have a huge amount of output when compiling correctly. I did it for PETSc4py and SLEPc (slepc4py is a mystery yet how it get's hidden in slepc). > >> > >> Are there any large downsides to this plan? > >> > >> Barry > >> > >> > > >

1 0

Re: [petsc-dev] builds of PETSc based packages should not get their own secret files
by Barry Smith 05 Jan '21

05 Jan '21

> On Jan 5, 2021, at 8:28 AM, Satish Balay <balay(a)mcs.anl.gov> wrote: > > Well we have to look at artifacts for configure.log. Why is this more of a burden for slepc or externalpackage logs? Some of the "artifacts" don't even exist to look at as artifacts; for example slepc4py log files. And if we continue with the current model more and more "artifacts" won't exist unless we add them (and we will forget to add them). I am fine with the output being in configure.log (as is the case for configures on external packages) or in make.log, it doesn't have to be in the CI console window, but it can't be scattered in dozens of files. > > Whatever you say for slepc log applies for configure.log. If its only CI issue - and you want all logs on STDOUT - then you can modify .gitlab-ci.yml. Perhaps: > > > diff --git a/.gitlab-ci.yml b/.gitlab-ci.yml > index 8f3d139235..f9cdd38abd 100644 > --- a/.gitlab-ci.yml > +++ b/.gitlab-ci.yml > @@ -70,6 +70,7 @@ check-ci-settings: > after_script: > - date > - ccache --show-stats > + - more arch-*/lib/petsc/conf/*.log |cat > artifacts: > reports: > junit: arch-*/tests/testresults.xml > > Satish > > > On Mon, 4 Jan 2021, Barry Smith wrote: > >> >> For packages that are built after PETSc configure (and or install is done) slepc, hpddm etc we've traditional saved the output in its own file stashed away somewhere. >> >> For the CI this is driving me nuts because when they fail the output is essentially "lost" and thus it is impossible to determine what has gone wrong. >> >> I have started to directly output in the same stream as the PETSc compiles to make debugging much easier. Generally the packages are relatively small and don't have a huge amount of output when compiling correctly. I did it for PETSc4py and SLEPc (slepc4py is a mystery yet how it get's hidden in slepc). >> >> Are there any large downsides to this plan? >> >> Barry >> >> >

1 0

Re: [petsc-dev] builds of PETSc based packages should not get their own secret files
by Satish Balay 05 Jan '21

05 Jan '21

Well we have to look at artifacts for configure.log. Why is this more of a burden for slepc or externalpackage logs? Whatever you say for slepc log applies for configure.log. If its only CI issue - and you want all logs on STDOUT - then you can modify .gitlab-ci.yml. Perhaps: diff --git a/.gitlab-ci.yml b/.gitlab-ci.yml index 8f3d139235..f9cdd38abd 100644 --- a/.gitlab-ci.yml +++ b/.gitlab-ci.yml @@ -70,6 +70,7 @@ check-ci-settings: after_script: - date - ccache --show-stats + - more arch-*/lib/petsc/conf/*.log |cat artifacts: reports: junit: arch-*/tests/testresults.xml Satish On Mon, 4 Jan 2021, Barry Smith wrote: > > For packages that are built after PETSc configure (and or install is done) slepc, hpddm etc we've traditional saved the output in its own file stashed away somewhere. > > For the CI this is driving me nuts because when they fail the output is essentially "lost" and thus it is impossible to determine what has gone wrong. > > I have started to directly output in the same stream as the PETSc compiles to make debugging much easier. Generally the packages are relatively small and don't have a huge amount of output when compiling correctly. I did it for PETSc4py and SLEPc (slepc4py is a mystery yet how it get's hidden in slepc). > > Are there any large downsides to this plan? > > Barry > >

1 0