Hi Matthew, Ok, I did that but it segfault now. Here are the order of the calls: DMPlexCreate DMSetDimension DMPlexBuildFromCellListParallel(...) DMPlexInterpolate PetscPartitioner lPart; DMPlexGetPartitioner(lDMSansOverlap, &lPart); PetscPartitionerSetFromOptions(lPart); DMSetUseNatural(lDMSansOverlap, PETSC_TRUE) DMPlexDistribute DMPlexGlobalToNaturalBegin DMPlexGlobalToNaturalEnd But it gives me the following error: 0]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [0]PETSC ERROR: Petsc has generated inconsistent data [0]PETSC ERROR: DM global to natural SF not present. If DMPlexDistribute() was called and a section was defined, report to [email protected]. [0]PETSC ERROR: See https://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [0]PETSC ERROR: Petsc Release Version 3.15.0, Mar 30, 2021 [0]PETSC ERROR: MEF++.dev on a named rohan by ericc Wed Jul 14 16:57:48 2021 [0]PETSC ERROR: Configure options --prefix=/opt/petsc-3.15.0_debug_openmpi-4.1.0_gcc7 --with-mpi-compilers=1 --with-mpi-dir=/opt/openmpi-4.1.0_gcc7 --with-cxx-dialect=C++14 --with-make-np=12 --with-shared-libraries=1 --with-debugging=yes --with-memalign=64 --with-visibility=0 --with-64-bit-indices=0 --download-ml=yes --download-mumps=yes --download-superlu=yes --download-hpddm=yes --download-slepc=yes --download-superlu_dist=yes --download-parmetis=yes --download-ptscotch=yes --download-metis=yes --download-strumpack=yes --download-suitesparse=yes --download-hypre=yes --with-blaslapack-dir=/opt/intel/oneapi/mkl/2021.1.1/env/../lib/intel64 --with-mkl_pardiso-dir=/opt/intel/oneapi/mkl/2021.1.1/env/.. --with-mkl_cpardiso-dir=/opt/intel/oneapi/mkl/2021.1.1/env/.. --with-scalapack=1 --with-scalapack-include=/opt/intel/oneapi/mkl/2021.1.1/env/../include --with-scalapack-lib="-L/opt/intel/oneapi/mkl/2021.1.1/env/../lib/intel64 -lmkl_scalapack_lp64 -lmkl_blacs_openmpi_lp64" [0]PETSC ERROR: #1 DMPlexGlobalToNaturalBegin() at /tmp/ompi-opt/petsc-3.15.0-debug/src/dm/impls/plex/plexnatural.c:245 What did I missed? Thanks a lot! Eric On 2021-07-14 3:09 p.m., Matthew Knepley wrote:
On Wed, Jul 14, 2021 at 1:18 PM Eric Chamberland <[email protected] <mailto:[email protected]>> wrote:
Hi,
I want to use DMPlexDistribute from PETSc for computing overlapping and play with the different partitioners supported.
However, after calling DMPlexDistribute, I noticed the elements are renumbered and then the original number is lost.
What would be the best way to keep track of the element renumbering?
a) Adding an optional parameter to let the user retrieve a vector or "IS" giving the old number?
b) Adding a DMLabel (seems a wrong good solution)
c) Other idea?
Of course, I don't want to loose performances with the need of this "mapping"...
You need to call
https://petsc.org/release/docs/manualpages/DM/DMSetUseNatural.html <https://petsc.org/release/docs/manualpages/DM/DMSetUseNatural.html>
before call DMPlexDistribute(). Then you can call
https://petsc.org/release/docs/manualpages/DMPLEX/DMPlexGlobalToNaturalBegin... <https://petsc.org/release/docs/manualpages/DMPLEX/DMPlexGlobalToNaturalBegin.html>
to map back to the original numbering if you want. This is the same thing that DMDA is doing.
Thanks,
Matt
Thanks,
Eric
-- Eric Chamberland, ing., M. Ing Professionnel de recherche GIREF/Université Laval (418) 656-2131 poste 41 22 42
-- What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead. -- Norbert Wiener
https://www.cse.buffalo.edu/~knepley/ <http://www.cse.buffalo.edu/~knepley/>
-- Eric Chamberland, ing., M. Ing Professionnel de recherche GIREF/Université Laval (418) 656-2131 poste 41 22 42