August 2014 - Acme-se - mailman3.cels.anl.gov

ACME quick tests
by Foucar, James G 14 Aug '14

14 Aug '14

Hi all, Is anyone aware of ACME tests that could be run on a desktop? Did CESG have any unit tests up and running at the point where we forked ACME? Are there any small integration tests? Thanks, -Jim

3 6

new / augmented ACME performance task
by Patrick Worley 12 Aug '14

12 Aug '14

Performance Team, I'll put this on Confluence later today, probably as part of tomorrow's telecon agenda, but we have an opportunity and a critical need to improve the testing process. The full CESM can take a long time to compile (especially using the PGI compiler). There are particular routines or files that take an inordinate amount of time to compile. This compilation time can often be reduced significantly by changing the optimization flags (e.g. setting them to -O0) for these files. My experience is that many of these routines are not performance critical, and lowering the optimization level has no significant impact. Often the change will even be BFB. So, I would like us to take a pass through the code, looking at routines that take a long time to compile, and then determine whether optimization is of any importance for these routines. This is primarily a C2 task, but also has implications for C1 and C5, so we may want to divvy up the work, at least for the performance impact evaluations. Perhaps the software engineers will want to get involved as well, if only to quantify the need for this (how fast must compilation be for testing to be viable?). In our natural workflow, we will be recompiling a lot, so this helps our own productivity. However, the testing will be dead in the water if the model takes hour(s) to build for different configurations. When we have refactored the model so that more options are determined at runtime, this will be less critical, but we are a long way from that. We can also do some testing with lowered optimization, but this worries me, introducing coverage gaps, and I'd prefer that we not have to go there. Pat P.S. - This adds another aspect to performance tracking ... if a new routine adds significantly to the compilation time, perhaps we need to flag this as well? Perhaps this can be offloaded to the workflow performance tracking.

3 4

Compiation error on Mira
by Gautam Bisht 06 Aug '14

06 Aug '14

Hi SE Team, I'm trying to build a standard case for the ICRUCLM45 compset on Mira. During the PIO build, I get an error regarding cmake. Following are the commands that I used to create the case: % ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ soft add +cmake ./create_newcase -case f09_f09_icruclm45 -res f09_f09 -mach mira -compset ICRUCLM45 cd f09_f09_icruclm45 ./xmlchange -file env_build.xml -id EXEROOT -val "/gpfs/mira-fs0/projects/EarthModel/\$CCSMUSER/scratch/exe/\$CASE/bld" ./xmlchange -file env_run.xml -id RUNDIR -val "/gpfs/mira-fs0/projects/EarthModel/\$CCSMUSER/scratch/exe/\$CASE/run" ./xmlchange -file env_run.xml -id DOUT_S_ROOT -val "/gpfs/mira-fs0/projects/EarthModel/$CCSMUSER/archive/\$CASE" ./xmlchange -file env_run.xml -id DIN_LOC_ROOT -val "/gpfs/mira-fs0/projects/EarthModel/gbisht/inputdata" ./xmlchange -file env_run.xml -id DIN_LOC_ROOT_CLMFORC -val "/gpfs/mira-fs0/projects/EarthModel/gbisht/inputdata/atm/datm7" ./cesm_setup ./f09_f09_icruclm45.build % ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ and below is the error % ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >cat /gpfs/mira-fs0/projects/EarthModel/gbisht/scratch/exe/f09_f09_icruclm45/bld/ibm/ibm/nodebug/nothreads/pio.bldlog.140806-151008 Wed Aug 6 15:12:21 UTC 2014 /gpfs/mira-fs0/projects/EarthModel/gbisht/scratch/exe/f09_f09_icruclm45/bld/ibm/ibm/nodebug/nothreads/pio.bldlog.140806-151008 set pio_dir=/gpfs/mira-fs0/projects/EarthModel/gbisht/scratch/exe/f09_f09_icruclm45/bld/ibm/ibm/nodebug/nothreads/pio cd /gpfs/mira-fs0/projects/EarthModel/gbisht/scratch/exe/f09_f09_icruclm45/bld/ibm/ibm/nodebug/nothreads/pio set cmake_opts= -D USER_CMAKE_MODULE_PATH=/gpfs/mira-home/gbisht/projects/ACME/repo/ACME/scripts/ccsm_utils/CMake set cmake_opts= -D USER_CMAKE_MODULE_PATH=/gpfs/mira-home/gbisht/projects/ACME/repo/ACME/scripts/ccsm_utils/CMake -D GENF90_PATH=/gpfs/mira-home/gbisht/projects/ACME/repo/ACME/tools/cprnc/genf90 gmake /gpfs/mira-fs0/projects/EarthModel/gbisht/scratch/exe/f09_f09_icruclm45/bld/ibm/ibm/nodebug/nothreads/pio/Makefile MODEL=pio USER_CMAKE_OPTS= -D USER_CMAKE_MODULE_PATH=/gpfs/mira-home/gbisht/projects/ACME/repo/ACME/scripts/ccsm_utils/CMake -D GENF90_PATH=/gpfs/mira-home/gbisht/projects/ACME/repo/ACME/tools/cprnc/genf90 PIO_LIBDIR=/gpfs/mira-fs0/projects/EarthModel/gbisht/scratch/exe/f09_f09_icruclm45/bld/ibm/ibm/nodebug/nothreads/pio -f /gpfs/mira-home/gbisht/projects/ACME/repo/ACME/scripts/f09_f09_icruclm45/Tools/Makefile cat: Filepath: No such file or directory cat: Srcfiles: No such file or directory /gpfs/mira-home/gbisht/projects/ACME/repo/ACME/scripts/f09_f09_icruclm45/Tools/mkSrcfiles cp -f /gpfs/mira-fs0/projects/EarthModel/gbisht/scratch/exe/f09_f09_icruclm45/bld/ibm/ibm/nodebug/nothreads/pio/Filepath /gpfs/mira-fs0/projects/EarthModel/gbisht/scratch/exe/f09_f09_icruclm45/bld/ibm/ibm/nodebug/nothreads/pio/Deppath /gpfs/mira-home/gbisht/projects/ACME/repo/ACME/scripts/f09_f09_icruclm45/Tools/mkDepends Deppath Srcfiles > /gpfs/mira-fs0/projects/EarthModel/gbisht/scratch/exe/f09_f09_icruclm45/bld/ibm/ibm/nodebug/nothreads/pio/Depends cd /gpfs/mira-fs0/projects/EarthModel/gbisht/scratch/exe/f09_f09_icruclm45/bld/ibm/ibm/nodebug/nothreads/pio; \ CC=mpixlc_r CXX= FC=mpixlf2003_r LDFLAGS="-Wl,--relax -Wl,--allow-multiple-definition -L/soft/libraries/hdf5/1.8.10/cnk-xl/current/lib -lhdf5 -lhdf5_hl " cmake -D CMAKE_Fortran_FLAGS:STRING="-g -qfullpath -qmaxmem=-1 -qspillsize=2500 -qextname=flush -O3 -qstrict -Q -WF,-DBGQ -WF,-DNDEBUG -WF,-DMCT_INTERFACE -WF,-DHAVE_MPI -WF,-DFORTRAN_SAME -WF,-DLINUX -WF,-DnoI8 -WF,-DBGQ -WF,-DCPRIBM -I. -I/gpfs/mira-fs0/projects/EarthModel/gbisht/scratch/exe/f09_f09_icruclm45/bld/ibm/ibm/nodebug/nothreads/include -I/gpfs/mira-fs0/projects/EarthModel/gbisht/scratch/exe/f09_f09_icruclm45/bld/ibm/ibm/nodebug/nothreads/MCT/noesmf/a1l1r1i1o1g1w1/csm_share -I/soft/libraries/netcdf/4.3.0-f4.2/cnk-xl/V1R2M0-20131211//include -I/soft/libraries/pnetcdf/1.3.1/cnk-xl/current//include -I/gpfs/mira-fs0/projects/EarthModel/gbisht/scratch/exe/f09_f09_icruclm45/bld/ibm/ibm/nodebug/nothreads/include -I/gpfs/mira-home/gbisht/projects/ACME/repo/ACME/models/csm_share/shr" -D CMAKE_C_FLAGS:STRING="-O2 -g -qfullpath -qmaxmem=-1 -DBGQ -DNDEBUG -DMCT_INTERFACE -DHAVE_MPI -DFORTRAN_SAME -DLINUX -DnoI8 -DBGQ -DCPRIBM -I. -I/gpfs/mira-fs0/projects/EarthModel/gbisht/scratch/exe/f09_f09_icruclm45/bld/ibm/ibm/nodebug/nothreads/include -I/gpfs/mira-fs0/projects/EarthModel/gbisht/scratch/exe/f09_f09_icruclm45/bld/ibm/ibm/nodebug/nothreads/MCT/noesmf/a1l1r1i1o1g1w1/csm_share -I/soft/libraries/netcdf/4.3.0-f4.2/cnk-xl/V1R2M0-20131211//include -I/soft/libraries/pnetcdf/1.3.1/cnk-xl/current//include -I/gpfs/mira-fs0/projects/EarthModel/gbisht/scratch/exe/f09_f09_icruclm45/bld/ibm/ibm/nodebug/nothreads/include -I/gpfs/mira-home/gbisht/projects/ACME/repo/ACME/models/csm_share/shr" -D CMAKE_CXX_FLAGS:STRING="-O2 -g -qfullpath -qmaxmem=-1 -DBGQ -DNDEBUG -DMCT_INTERFACE -DHAVE_MPI -DFORTRAN_SAME -DLINUX -DnoI8 -DBGQ -DCPRIBM -I. -I/gpfs/mira-fs0/projects/EarthModel/gbisht/scratch/exe/f09_f09_icruclm45/bld/ibm/ibm/nodebug/nothreads/include -I/gpfs/mira-fs0/projects/EarthModel/gbisht/scratch/exe/f09_f09_icruclm45/bld/ibm/ibm/nodebug/nothreads/MCT/noesmf/a1l1r1i1o1g1w1/csm_share -I/soft/libraries/netcdf/4.3.0-f4.2/cnk-xl/V1R2M0-20131211//include -I/soft/libraries/pnetcdf/1.3.1/cnk-xl/current//include -I/gpfs/mira-fs0/projects/EarthModel/gbisht/scratch/exe/f09_f09_icruclm45/bld/ibm/ibm/nodebug/nothreads/include -I/gpfs/mira-home/gbisht/projects/ACME/repo/ACME/models/csm_share/shr" -D CMAKE_VERBOSE_MAKEFILE:BOOL=ON -D NETCDF_DIR:STRING=/soft/libraries/netcdf/4.3.0-f4.2/cnk-xl/V1R2M0-20131211/ -D USER_CMAKE_MODULE_DIR:STRING=/gpfs/mira-home/gbisht/projects/ACME/repo/ACME/scripts/ccsm_utils/CMake -D PNETCDF_DIR:STRING="/soft/libraries/pnetcdf/1.3.1/cnk-xl/current/" -D PIO_FILESYSTEM_HINTS:STRING="gpfs " -D USER_CMAKE_MODULE_PATH=/gpfs/mira-home/gbisht/projects/ACME/repo/ACME/scripts/ccsm_utils/CMake -D GENF90_PATH=/gpfs/mira-home/gbisht/projects/ACME/repo/ACME/tools/cprnc/genf90 /gpfs/mira-home/gbisht/projects/ACME/repo/ACME/models/utils/pio /bin/sh: line 1: cmake: command not found gmake: *** [/gpfs/mira-fs0/projects/EarthModel/gbisht/scratch/exe/f09_f09_icruclm45/bld/ibm/ibm/nodebug/nothreads/pio/Makefile] Error 127 % ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Any ideas on how to fix this? Thanks, -Gautam.

2 6

[Confluence] Doug Jacobsen shared "Push notifications" with you
by Doug Jacobsen (Confluence) 01 Aug '14

01 Aug '14

1 0