January 2016 - Acme-se - mailman3.cels.anl.gov

Request to d/l missing data for MOSART on Titan
by Gautam Bisht 01 Feb '16

01 Feb '16

Hi Titan-POC, Could you download the following missing data on Titan? cd /lustre/atlas1/cli900/world-shared/cesm/inputdata/rof/mosart svn export \ https://acme-svn2.ornl.gov/acme-repo/acme/inputdata/rof/mosart/MOSART_Globa… Thanks, Gautam.

2 2

Documentation on freezes
by Robert Jacob 28 Jan '16

28 Jan '16

Hi all, There's confusion out there on what gets frozen when during development. I've tried to document it on a page. Although we were very good at explaining/promoting the feature freeze, we did not say anything about a "configuration freeze" which is when you decide what combination of all those feature you want to use. That probably should have been at the same time as the feature freeze, or after the integration was finished, but it wasn't. We still have a "code freeze" in our future but different parts of the code base can be frozen at different times. Anyway, take a look and comment: https://acme-climate.atlassian.net/wiki/display/Docs/Freezes+and+tags Also: do not put any v2 features on master until further notice. Rob

1 0

Re: [ACME-SE] Missing inputdata in ACME repo and Titan.
by Taylor, Mark A 27 Jan '16

27 Jan '16

NCASR's inputdata server is public. Anyone can get access, as documented on the ACME quick guide. The reason for this policy is to make it clear that NCAR produced data came from NCAR and was not produced by ACME. Mark -- Mark Taylor, mataylo(a)sandia.gov, +1-505-284-1874 1446 Multiphysics Applications Sandia National Labs, Albuquerque NM 87185-1320 From: Gautam Bisht <gbisht(a)lbl.gov<mailto:[email protected]>> Date: Wednesday, January 27, 2016 at 4:28 PM To: "Taylor, Mark A" <mataylo(a)sandia.gov<mailto:[email protected]>> Cc: Balwinder Singh <Balwinder.Singh(a)pnnl.gov<mailto:[email protected]>>, "acme-se(a)lists.mcs.anl.gov<mailto:[email protected]>" <acme-se(a)lists.mcs.anl.gov<mailto:[email protected]>> Subject: [EXTERNAL] Re: [ACME-SE] Missing inputdata in ACME repo and Titan. Some ACME developers/machine-pocs don't have access to NCAR's svn repo. -Gautam. On Wed, Jan 27, 2016 at 3:22 PM, Taylor, Mark A <mataylo(a)sandia.gov<mailto:[email protected]>> wrote: I thought the policy was that data sets created by NCAR stay in the NCAR repo? The ACME scripts will check both. Mark -- Mark Taylor, mataylo(a)sandia.gov<mailto:[email protected]>, +1-505-284-1874<tel:%2B1-505-284-1874> 1446 Multiphysics Applications Sandia National Labs, Albuquerque NM 87185-1320 From: <acme-se-bounces(a)lists.mcs.anl.gov<mailto:[email protected]>> on behalf of Gautam Bisht <gbisht(a)lbl.gov<mailto:[email protected]>> Date: Wednesday, January 27, 2016 at 4:10 PM To: Balwinder Singh <Balwinder.Singh(a)pnnl.gov<mailto:[email protected]>> Cc: "acme-se(a)lists.mcs.anl.gov<mailto:[email protected]>" <acme-se(a)lists.mcs.anl.gov<mailto:[email protected]>> Subject: [EXTERNAL] Re: [ACME-SE] Missing inputdata in ACME repo and Titan. Thanks, Balwinder. -Gautam. On Wed, Jan 27, 2016 at 2:57 PM, Singh, Balwinder <Balwinder.Singh(a)pnnl.gov<mailto:[email protected]>> wrote: I will put this file into the ACME input data repo. Best, Balwinder From:[email protected]<mailto:[email protected]> [mailto:[email protected]<mailto:[email protected]>] On Behalf Of Gautam Bisht Sent: Wednesday, January 27, 2016 2:53 PM To: acme-se(a)lists.mcs.anl.gov<mailto:[email protected]> Subject: [ACME-SE] Missing inputdata in ACME repo and Titan. Hi, Can someone put the following dataset from NCAR svn into ACME inputdata repo? https://svn-ccsm-inputdata.cgd.ucar.edu/trunk/inputdata/lnd/clm2/surfdata_m… Titan-POC: Could you put the new dataset on Titan (/lustre/atlas1/cli900/world-shared/cesm/inputdata/lnd/clm2/surfdata_map)? Thanks. Thanks, -Gautam.

3 2

Re: [ACME-SE] Missing inputdata in ACME repo and Titan.
by Taylor, Mark A 27 Jan '16

27 Jan '16

I thought the policy was that data sets created by NCAR stay in the NCAR repo? The ACME scripts will check both. Mark -- Mark Taylor, mataylo(a)sandia.gov, +1-505-284-1874 1446 Multiphysics Applications Sandia National Labs, Albuquerque NM 87185-1320 From: <acme-se-bounces(a)lists.mcs.anl.gov<mailto:[email protected]>> on behalf of Gautam Bisht <gbisht(a)lbl.gov<mailto:[email protected]>> Date: Wednesday, January 27, 2016 at 4:10 PM To: Balwinder Singh <Balwinder.Singh(a)pnnl.gov<mailto:[email protected]>> Cc: "acme-se(a)lists.mcs.anl.gov<mailto:[email protected]>" <acme-se(a)lists.mcs.anl.gov<mailto:[email protected]>> Subject: [EXTERNAL] Re: [ACME-SE] Missing inputdata in ACME repo and Titan. Thanks, Balwinder. -Gautam. On Wed, Jan 27, 2016 at 2:57 PM, Singh, Balwinder <Balwinder.Singh(a)pnnl.gov<mailto:[email protected]>> wrote: I will put this file into the ACME input data repo. Best, Balwinder From:[email protected]<mailto:[email protected]> [mailto:[email protected]<mailto:[email protected]>] On Behalf Of Gautam Bisht Sent: Wednesday, January 27, 2016 2:53 PM To: acme-se(a)lists.mcs.anl.gov<mailto:[email protected]> Subject: [ACME-SE] Missing inputdata in ACME repo and Titan. Hi, Can someone put the following dataset from NCAR svn into ACME inputdata repo? https://svn-ccsm-inputdata.cgd.ucar.edu/trunk/inputdata/lnd/clm2/surfdata_m… Titan-POC: Could you put the new dataset on Titan (/lustre/atlas1/cli900/world-shared/cesm/inputdata/lnd/clm2/surfdata_map)? Thanks. Thanks, -Gautam.

2 1

Missing inputdata in ACME repo and Titan.
by Gautam Bisht 27 Jan '16

27 Jan '16

Hi, Can someone put the following dataset from NCAR svn into ACME inputdata repo? https://svn-ccsm-inputdata.cgd.ucar.edu/trunk/inputdata/lnd/clm2/surfdata_m… Titan-POC: Could you put the new dataset on Titan (/lustre/atlas1/cli900/world-shared/cesm/inputdata/lnd/clm2/surfdata_map)? Thanks. Thanks, -Gautam.

2 2

Re: [ACME-SE] project directory on NERSC
by Patrick Worley 26 Jan '16

26 Jan '16

On 1/25/16 6:06 PM, McClean, Julie wrote: > I can't get into V0.1 Exposed now. I assume that these can be deleted as well, but will await further direction. Thanks. Pat

1 0

project directory on NERSC
by Bader, David C. 25 Jan '16

25 Jan '16

Mat or Julie, Is this one of the directories from the High-res project runs? Dave David C. Bader (bader2(a)llnl.gov) Lawrence Livermore National Laboratory +1-925-422-4843(w) +1-925-960-3981(c) From: <acme-se-bounces(a)lists.mcs.anl.gov<mailto:[email protected]>> on behalf of Hans Johansen <hjohansen(a)lbl.gov<mailto:[email protected]>> Date: Monday, January 25, 2016 2:17 PM To: Worley Patrick <worleyph(a)ornl.gov<mailto:[email protected]>> Cc: "acme-se(a)lists.mcs.anl.gov<mailto:[email protected]>" <acme-se(a)lists.mcs.anl.gov<mailto:[email protected]>> Subject: Re: [ACME-SE] Out of space in project directory on NERSC Removed that directory ... let me or Noel know if you need anything else removed? On Mon, Jan 25, 2016 at 1:27 PM, Patrick Worley <worleyph(a)ornl.gov<mailto:[email protected]>> wrote: I just tried, and it wouldn't let me. I don't have the necessary permissions for a number of files/subdirectories in the directory. E.g. > ls -ltrd ccsm4_init/b40_1850_c02c_76jpf drwxr-x--- 3 u6336 acme 512 Feb 26 2015 ccsm4_init/b40_1850_c02c_76jpf Hans (and others) will need to help out. Pat On 1/25/16 4:15 PM, Gautam Bisht wrote: Hi Pat, We are out of space. I was wondering if we can delete the following directory? /project/projectdirs/acme/data/inputdata -Gautam. _______________________________________________ ACME-SE mailing list ACME-SE(a)lists.mcs.anl.gov<mailto:[email protected]> https://lists.mcs.anl.gov/mailman/listinfo/acme-se _______________________________________________ ACME-SE mailing list ACME-SE(a)lists.mcs.anl.gov<mailto:[email protected]> https://lists.mcs.anl.gov/mailman/listinfo/acme-se

2 1

Out of space in project directory on NERSC
by Gautam Bisht 25 Jan '16

25 Jan '16

Hi Pat, We are out of space. I was wondering if we can delete the following directory? /project/projectdirs/acme/data/inputdata -Gautam.

3 2

Fwd: [SIAM-CSE] Deadline Extension: PDSEC-16 Workshop
by Robert Jacob 22 Jan '16

22 Jan '16

Another SE paper opportunity. "This year, we will shift the focus of PDSEC to methodologies and experiences of scientific and engineering applications and algorithms to achieve sustainable code development for better productivity and application performance." -------- Forwarded Message -------- Subject: [SIAM-CSE] Deadline Extension: PDSEC-16 Workshop Date: Fri, 22 Jan 2016 20:35:01 +0000 From: Teranishi, Keita <knteran(a)sandia.gov> To: siam-cse(a)siam.org <siam-cse(a)siam.org> (Apologies for cross-postings) ======================================================== DEADLINE: PDSEC-16: papers due (Extended) Jan 29 The 17th IEEE International Workshop on Parallel and Distributed Scientific and Engineering Computing, May 27, 2016, Chicago USA to be held in conjunction with IPDPS 2016. http://cse.stfx.ca/~pdsec16 Scope and Interests: The technological trends of HPC system evolution indicates increasing burden for application developers in management of the unprecedented levels of complexity in hardware and the associated performance characteristics. Many existing application codes are unlikely to perform well on future systems without major modifications or even complete rewrites. It will be important to utilize, in unison, many characteristics such as multiple levels of parallelism, many lightweight cores, complex memory hierarchies, novel I/O technology, power capping and system-wide temporal/spatial performance heterogeneity. The HPC community has developed new programming models, algorithms, libraries and tools to meet these challenges in order to accommodate productive code development and effective system use. However, the application community still needs to identify the benefit through practical evaluations. This year, we will shift the focus of PDSEC to methodologies and experiences of scientific and engineering applications and algorithms to achieve sustainable code development for better productivity and application performance. In particular, we will focus on the following topics in parallel and distributed scientific and engineering applications, but not limited to: * Code modernization methodologies and experiences for adapting the changes in future computing systems such as porting of legacy simulation code and libraries/tools to facilitate code refactoring and porting. * Application and algorithm development of various parallel and distributed programming models/framework such as CAF, UPC, Chapel, X10, Charm++, HPX, Uintah, Legion, and/or the interoperation of multiple model within single applications (e.g. MPI+X where X is OpenMP, OpenCL, CUDA etc.). We appreciate the experiences of early adopters of new programming models and platforms. * Experience in new tools and libraries for effective application development, including performance tools, application development frameworks, Domain Specific Languages (DSLs), etc. * Use cases of enterprise distributed computing technology (such as MapReduce, Data Analytics and Machine-learning tools) in scientific and engineering applications. * Large-scale parallel and distributed algorithms supporting science and engineering applications. * Methodologies and experiences in developing large-scale applications. Important Dates: Paper submission due . . . . . . . . . . . . . . January 29, 2016 Notification of Acceptance . . . . . . . . . . . February 17, 2016 Final camera-ready paper . . . . . . . . . . . . February 29, 2016 General Chairs Peter Strazdins, Australian National University, Australia Raphael Couturier, University of Franche-Comte, France Program Chairs Keita Teranishi, Sandia National Laboratories, USA Alan Gray, University of Edinburgh, United Kingdom Steering Committee Thomas Rauber, University of Bayreuth, Germany Gudula Runger, Chemnitz University of Technology, Germany Laurence T. Yang (Chair), St. Francis Xavier University, Canada Regards, Keita --------------------------------------------------------------------------- -- Keita Teranishi Principal Member of Technical Staff Scalable Modeling and Analysis Systems Sandia National Laboratories Livermore, CA 94551 +1 (925) 294-3738 _______________________________________________ SIAM-CSE mailing list To post messages to the list please send them to: SIAM-CSE(a)siam.org http://lists.siam.org/mailman/listinfo/siam-cse

1 0

Re: [ACME-SE] [EXTERNAL] Re: Request for a land inputdata repo under ACME-Climate account
by Foucar, James G 20 Jan '16

20 Jan '16

Coincidently, I was looking at a very similar issue yesterday. The command you want is this: ncgen -b -o somename.nc -k netCDF-4 inputfile.txt -Jim From: <acme-se-bounces(a)lists.mcs.anl.gov<mailto:[email protected]>> on behalf of "Thornton, Peter E." <thorntonpe(a)ornl.gov<mailto:[email protected]>> Date: Wednesday, January 20, 2016 at 6:32 AM To: Gautam Bisht <gbisht(a)lbl.gov<mailto:[email protected]>>, "Salinger, Andrew" <agsalin(a)sandia.gov<mailto:[email protected]>> Cc: "acme-se(a)lists.mcs.anl.gov<mailto:[email protected]>" <acme-se(a)lists.mcs.anl.gov<mailto:[email protected]>>, William Riley <wjriley(a)lbl.gov<mailto:[email protected]>> Subject: Re: [ACME-SE] [EXTERNAL] Re: Request for a land inputdata repo under ACME-Climate account Gautam, Given the clarity of being able to see changes in ascii version, that would be my preference if we could find the simple ascii to netcdf command mentioned by Forrest on our call. Petet ________________________________ From: Gautam Bisht Sent: Tuesday, January 19, 2016 9:02 PM To: "Salinger, Andrew" CC: "Taylor, Mark A" ,William Riley ,"Thornton, Peter E." ,acme-se(a)lists.mcs.anl.gov<mailto:[email protected]> Subject: Re: [EXTERNAL] Re: [ACME-SE] Request for a land inputdata repo under ACME-Climate account Thank you, Andy. -Gautam. On Tue, Jan 19, 2016 at 4:19 PM, Salinger, Andrew <agsalin(a)sandia.gov<mailto:[email protected]>> wrote: Gautam, I just went ahead and created ACME-Climate/LandParameters repo with the usual ACME developer list, and private access. Just a README.md file so far. Andy From: <acme-se-bounces(a)lists.mcs.anl.gov<mailto:[email protected]>> on behalf of Gautam Bisht <gbisht(a)lbl.gov<mailto:[email protected]>> Date: Tuesday, January 19, 2016 at 4:24 PM To: "Taylor, Mark A" <mataylo(a)sandia.gov<mailto:[email protected]>> Cc: William Riley <wjriley(a)lbl.gov<mailto:[email protected]>>, Peter Thornton <thorntonpe(a)ornl.gov<mailto:[email protected]>>, "acme-se(a)lists.mcs.anl.gov<mailto:[email protected]>" <acme-se(a)lists.mcs.anl.gov<mailto:[email protected]>> Subject: [EXTERNAL] Re: [ACME-SE] Request for a land inputdata repo under ACME-Climate account All, The land team doesn't want to add multiple version of "untested" parameters files in the inputdata server. The reason for this new repo is to share the experimental version of CLM parameter file with all land team members, so simulations with for various land compsets + resolution can be tested before a stable version of CLM parameter file is added to thr ACME inputdata server. To investigate the size of repo containing netcdf vs ascii version of the CLM parameter file, I created the following two repos: https://bitbucket.org/gbisht/clm-params-netcdf https://bitbucket.org/gbisht/clm-params-ascii/ I made multiple commits in clm-params-netcdf by modifying a single parameter at a time. The clm-params-ascii repo simply contained ncdump of the netcdf file in clm-params-netcdf. Each commit added ~18KB to both repos. Thus, the size of the netcdf repo is growing at the same rate as the ascii repo. One thing to note is that the differences in parameter values between commits in the ascii repo are obvious and that is not the case in the netcdf repo. But, the ascii repo will also need scripts to generate a netcdf version of the CLM parameter file. Peter, Bill: Btw, will the new repo to be public or private? -Gautam. Note: If anyone wants access to my bitbucket repo, send me a note and I will grant you access. On Tue, Jan 19, 2016 at 1:17 PM, Gautam Bisht <gbisht(a)lbl.gov<mailto:[email protected]>> wrote: Following this email, there was discussion on slack. I'm going to explore Doug's suggestion and will update the group. -Gautam. On Tue, Jan 19, 2016 at 1:15 PM, Taylor, Mark A <mataylo(a)sandia.gov<mailto:[email protected]>> wrote: what about using the inputdata server? github would not be very good at this - it does not work well with binary files. -- Mark Taylor, mataylo(a)sandia.gov<mailto:[email protected]>, +1-505-284-1874<tel:+1-505-284-1874> 1446 Multiphysics Applications Sandia National Labs, Albuquerque NM 87185-1320 From: <acme-se-bounces(a)lists.mcs.anl.gov<mailto:[email protected]>> on behalf of Gautam Bisht <gbisht(a)lbl.gov<mailto:[email protected]>> Date: Tuesday, January 19, 2016 at 1:19 PM To: "acme-se(a)lists.mcs.anl.gov<mailto:[email protected]>" <acme-se(a)lists.mcs.anl.gov<mailto:[email protected]>> Cc: Bill RIley <wjriley(a)lbl.gov<mailto:[email protected]>>, Thornton Peter <thorntonpe(a)ornl.gov<mailto:[email protected]>> Subject: [EXTERNAL] [ACME-SE] Request for a land inputdata repo under ACME-Climate account Hi Rob, Andy, The land team would like to have a separate repo which tracks the netcdf file (~100KB) that contains parameters for CLM. The purpose of this repo would be to let various colleagues test out the parameter file for different land-compsets/resolution before the file is added to the ACME inputdata server. Presently there are no scripts to create the CLM parameter file. Thus, the land team would eventually like to add scripts to automate the generation the CLM parameter file. Can a new repo for such a purpose be created under ACME-Climate account? -Gautam.

2 3