I am not looking at Geoff's pull request right now. Let me try to be clearer, in the master branch, the TaoGradientNorm() function is only used for termination tests inside the optimization methods. It does not change anything else that goes on inside of the methods. A user-defined convergence test (presuming we can get the callbacks right) would suffice. As all norms are equivalent in finite dimensions, a user could also scale the standard termination tolerance by the correct constant. If you need to live in function spaces, which seems to be the argument, then it seems that PETSc needs to be changed by more than just a single termination test. Thanks, Todd.
On Apr 12, 2018, at 3:27 PM, Stefano Zampini <[email protected]> wrote:
The gradient norm is the one induced by the mass matrix of the DM associated with the control. In principle, TaoGradientNorm() can be replaced by DMCreateMassMatrix() + solve with the mass matrix.
For PDE constrained optimization, the “gradient norm” is crucial, since we consider optimization problems in Banach spaces. We should keep supporting it, maybe differently than as it is now, but keep it.
On Apr 12, 2018, at 11:21 PM, Jed Brown <[email protected]> wrote:
Are you thinking about this PR again?
https://bitbucket.org/petsc/petsc/pull-requests/506
There's an issue here that Krylov methods operate in the discrete inner product while some higher level operations are of interest in (approximations of) continuous inner products (or norms). The object in PETSc that endows continuous attributes (like a hierarchy, subdomains, fields) on discrete quantities is DM, so my first inclination is that any continuous interpretation of vectors, including inner products and norms, belongs in DM.
"Munson, Todd" <[email protected]> writes:
There is a bit of code in TAO that allows the user to change the norm to a matrix norm. This was introduced to get some mesh independent behavior in one example (tao/examples/tutorials/ex3.c). That norm, however, does not propagate down into the KSP methods and is only used for testing convergence of the nonlinear problem.
A few questions then: Is similar functionality needed in SNES? Are TAO and SNES even the right place for this functionality? Should it belong to the Vector class so that you can change the inner products and have all the KSP methods (hopefully) work correctly?
Note: that this discussion brings us to the brink of supporting an optimize-then-discretize approach. I am not convinced we should go down that rabbit hole.
Thanks, Todd.