Do you know if Nvidia provides an API to determine how much GPU memory has been currently allocated?

Yes it does

The information is readily available through the nvidia-smi command line tool. Is there a good reason for providing the total allocated memory on GPUs (including non-PETSc memory) through PETSc? If so, why don't we already print the total system memory usage? Best regards, Karli