- Acme-argonne - mailman3.cels.anl.gov

CMDV's C++/Kokkos rewrite of HOMME
by Robert Jacob 24 Apr '18

24 Apr '18

The C++/Kokkos rewrite of HOMME has been successful, at least by its performance measurements. Andy Salinger says: "I thought that several of you E3SM folks might be interested in the progress we have made on the “HOMMEXX” code, the C++/Kokkos rewrite of HOMME being done under CMDV-SM. The conversion is now “end-to-end”, meaning all the code within one physics time step is converted to C++ (although setup and I/O are not), so the timings are real and no longer just for certain converted kernels (as we showed at the ACME all-hands last June). Attached is a paper that we submitted last month to the Supercomputing Conference on the current performance portability of the HOMMEXX code where we show large-scale results for Edison, Cori-Haswell, and Cori-KNL (e.g. Fig 7), and small-scale results with the P100 Pascal GPU as well (Fig 9). Since that submission, we are now getting preliminary results on the Volta GPU and Skylake CPU processors." I'm told the caveat is: it took a hero programmer at Sandia to make it all perform well. If the same programmer had focused on just the Fortran with OpenACC, probably would have had just as good performance portability. The paper is available at https://anl.box.com/s/7fcndg637qd7hypuk8hyacr7xo9kx8or Rob

1 0

Fwd: Re: [E3SM-ALL] E3SM v1 release - congratulations!
by Robert Jacob 23 Apr '18

23 Apr '18

E3SM v1 has been released! Messages below from Gary and Dorothy. Source code: https://github.com/E3SM-Project/E3SM web site: https://e3sm.org My thanks to everyone at Argonne who worked hard to make this happen. Rob -------- Forwarded Message -------- Subject: Re: [E3SM-ALL] E3SM v1 release - congratulations! Date: Mon, 23 Apr 2018 15:31:48 +0000 From: Geernaert, Gerald <Gerald.Geernaert(a)SCIENCE.DOE.GOV> Reply-To: E3SM All-Hands <E3SM-ALL(a)LISTSERV.LLNL.GOV>, Geernaert, Gerald <Gerald.Geernaert(a)SCIENCE.DOE.GOV> To: E3SM-ALL(a)LISTSERV.LLNL.GOV Dear everyone! Youï¿½ve just reached a landmark occasion with this v1 release. THANK YOU so much for your hard work, especially during the past few months. This is an exciting time for all of us here at DOE, and I look forward to the great community research thatï¿½s now possible with E3SM. Best regards Gary Sent from Email+ secured by MobileIron ------------------------------------------------------------------------ *From: *"Koch, Dorothy" <Dorothy.Koch(a)science.doe.gov <mailto:[email protected]>> *Date:* Monday, April 23, 2018 at 10:48:46 AM *To: *"E3SM-ALL(a)LISTSERV.LLNL.GOV" <E3SM-ALL(a)LISTSERV.LLNL.GOV <mailto:[email protected]>> *Cc: *"Weatherwax, Sharlene" <Sharlene.Weatherwax(a)science.doe.gov <mailto:[email protected]>>, "Geernaert, Gerald" <Gerald.Geernaert(a)science.doe.gov <mailto:[email protected]>> *Subject:* E3SM v1 release - congratulations! Dear E3SM project team, Congratulations to all of you for reaching this major milestone of releasing E3SM v1! https://www.llnl.gov/news/new-exascale-system-earth-simulation We appreciate all the hard work and dedication that each of you has put into developing, debugging, optimizing, testing and managing this new model. It was a significant team effort in which many of you put aside your personal gains in order to contribute to the larger outcome. I am confident that the hard work will bear significant rewards as you may now use v1 for science investigations, publish results, and share the model with collaborators. I look forward to seeing this next stage unfold, as well as the enhancements to come in v2-v3-v4. All the best from us at DOE, Dorothy Biological and Environmental Research Department of Energy 301-903-0105

1 0

Monthly meeting postponed 1 week
by Robert Jacob 09 Apr '18

09 Apr '18

Hello, Our monthly meeting of E3SM/CMDV staff will be postponed until next week, April 10, at the same time. I'm on travel today. Rob

1 1

E3SM v1 release update
by Robert Jacob 06 Apr '18

06 Apr '18

Some facts related to the upcoming release of E3SM v1: E3SM v1 release is scheduled for April 20th. Along with the v1 release, E3SM will be launching a quarterly newsletter and new website (beginning April 23). Website will be e3sm.org. LLNL is doing the press release. I'll arrange a companion one from Argonne. E3SM's github repo will be made public and we'll continue to do all our development there. AFAIK, its the first major climate model to have a completely open repository. Rob

1 0

Fwd: [E3SM-ALL] [acme-all] E3SM: Save the date - All Hands Webinar 4/12 at 11 am ET, 8 am PT
by Robert Jacob 06 Apr '18

06 Apr '18

Webinar about E3SM science. 2 presentations: Kai Zhang Study on water conservation in EAM Gautam Bisht VSFM hydrologic model web session: https://global.gotomeeting.com/join/570361173 call number: (571) 317-3122 Access Code: 570-361-173, If busy, use alternate number: (773) 945-1029 Joining from a video-conferencing room or system? Dial: 67.217.95.2##570361173 , Cisco devices: 570361173(a)67.217.95.2 -------- Forwarded Message -------- Subject: [E3SM-ALL] [acme-all] E3SM: Save the date - All Hands Webinar 4/12 at 11 am ET, 8 am PT Date: Fri, 6 Apr 2018 11:32:18 +0000 From: Bader, David C. <bader2(a)LLNL.GOV> Reply-To: all ACME members list <ACME-ALL(a)LISTSERV.LLNL.GOV>, Bader, David C. <bader2(a)LLNL.GOV> To: E3SM-ALL(a)LISTSERV.LLNL.GOV There will be two presentations next Thursday, April 12 starting at 11 am ET via GoToWebinar desktop conferencing by Kai Zhang of PNNL and Gautem Bisht from LBNL. Dave

1 0

Fwd: [CMDV-software-all] CMDV-SM Funded for a 3rd Year
by Robert Jacob 30 Mar '18

30 Mar '18

The generous FY18 budget included support for CMDV-SM. -------- Forwarded Message -------- Subject: [CMDV-software-all] CMDV-SM Funded for a 3rd Year Date: Fri, 30 Mar 2018 00:01:21 +0000 From: Salinger, Andrew <agsalin(a)sandia.gov> To: CMDV-software-all(a)lists.mcs.anl.gov <CMDV-software-all(a)lists.mcs.anl.gov> Hi all CMDV-SM, I found out from Dorothy yesterday that CMDV-SM is surprisingly funded again for a third year! Yay! Congress called it out explicitly in last week’s spending bill. This is FY18 money to mostly spend in FY19. I am writing to let everyone know of the funding situation and of the process I just invented to move forward. Since we all expected the project to end after 2 years, I know that many of us have planned to move our best ideas and many staff to other projects, particularly to E3SM Phase 2 NGD and Core projects. Therefore, I do not want to move forward with the usual default idea that everyone gets the same money to complete their year 3 proposal tasks. We instead need to, or get to, do a quick reboot. Dorothy is asking for a list of tasks that we will fund with the 3^rd year of funding in just 2 weeks on April 11. (That defines “quick”. ) My thought is that the budget can be conceptually split into 3 categories of tasks that add up to 1 year’s budget plus any carryover. 1.Work that was part of the original proposal or a direct follow-on, just like year 3 of a normal project that didn’t prepare to end. 2.Work that is in the 3-yr E3SM Phase 2 proposal, that CMDV would take over for the first year, but would return to E3SM NGD/Core funding for years 2 and 3. 3.Work that is new, but which adheres enough to the themes of CMDV Software Modernization so that we can fund it without triggering a new review. I talked to the site-PIs yesterday -- Peter, Rob, Hui, Salil – and got an initial (non-binding) reaction to the question of what we could fund. I will continue to work with the site-PIs to work on a list of topics. I am here asking those four that we try and get far along in the process by next Friday 4/6 so we can complete it on 4/10. If you have inspiration, I ask that you talk with your site-PI. Some more detail: ·I just talked to Dave Bader regarding the category 2 funding, and he very clearly and emphatically stated that anyone that is part of Phase 2 and works on those tasks with CMDV funding will seamlessly move onto E3SM funding when the CMDV money runs out. This will help him with near term funding issues in the proposal. ·Dorothy agreed that it would be possible to carryover the money into FY20, subject to usual scrutiny, so you can think about spending the money at a slower rate. ·By default I am expecting that each lab’s budget stays what is in the proposal, but that doesn’t have to be the case. I am in fact exploring the option of funding some verification work at LANL and reduce the funding sent to Sandia. ·Regarding Category 3, new ideas: I remain proud of the project that we scoped for this project, and even more so in the major successes we are having in delivering capabilities in just 2 years. I want any work we propose to continue to be of high value to E3SM and to focus on improving the state of the code going forward, in trustworthiness, algorithms, software, infrastructure, leverage, or agility. Thanks for your excellent work on this project to date, Andy

2 1

E3SM phase 2 proposal final copy
by Robert Jacob 16 Mar '18

16 Mar '18

The E3SM phase 2 proposal has been submitted to BER. A version is available on our box account: https://anl.box.com/s/8lw3gkazunwob6qfqb9nfvqwkf23wmhm Feel free to share with others inside, but not outside, the lab. Rob

1 0

E3SM phase 2 proposal draft; meeting tomorrow
by Robert Jacob 07 Mar '18

07 Mar '18

E3SM Argonne staff, A first draft of the Phase 2 proposal has gone out to red team reviewers. That version is available here: https://anl.box.com/s/50liixvzmpx1qk975iba3ifeo71wtbf7 Do not forward outside the lab. If there's anything that needs to be changed, let me know. We'll have our monthly meeting tomorrow. Topic: the proposal. Details below. Rob Meeting: Tuesday, March 6 Room 7172, Building 240 Remote: To join the Meeting: https://bluejeans.com/966187949 To join via Room System: Video Conferencing System: bjn.vc -or-199.48.152.152 Meeting ID : 966187949 To join via phone : 1) Dial: +1.408.317.9254 (BlueJeans U.S. Toll) +1.866.226.4650 (US Toll Free) (see all numbers - http://bluejeans.com/numbers) 2) Enter Conference ID : 966187949

1 2

Monthly meeting today at 2pm
by Robert Jacob 06 Feb '18

06 Feb '18

We'll have our monthly meeting of E3SM/CMDV staff today at 2pm in 2178. Topics: What I learned at LLNL last week. Phase 2 proposal status. Land model inter-comparison DECK experiments Watch the Falcon-Heavy test flight (2:45pm) To join the Meeting: https://bluejeans.com/966187949 To join via Room System: Video Conferencing System: bjn.vc -or-199.48.152.152 Meeting ID : 966187949 To join via phone : 1) Dial: +1.408.317.9254 (BlueJeans U.S. Toll) +1.866.226.4650 (US Toll Free) (see all numbers - http://bluejeans.com/numbers) 2) Enter Conference ID : 966187949

1 0

Fwd: [E3SM-ALL] [acme-all] E3SM Dedicated and Regular Staff List
by Robert Jacob 08 Jan '18

08 Jan '18

The list of dedicated staff. Rob -------- Forwarded Message -------- Subject: [E3SM-ALL] [acme-all] E3SM Dedicated and Regular Staff List Date: Fri, 22 Dec 2017 06:26:22 +0000 From: Bader, David C. <bader2(a)LLNL.GOV> Reply-To: all ACME members list <ACME-ALL(a)LISTSERV.LLNL.GOV>, Bader, David C. <bader2(a)LLNL.GOV> To: E3SM-ALL(a)LISTSERV.LLNL.GOV TO: All E3SM Project Participants Below is the list of Phase 2 Dedicated and Regular Staff /Core Only members. The Executive Committee read the applications and selected an initial set of Dedicated Staff members. From that list, we identified Group Leaders for the 5 groups. We then asked each of the Group Leaders to suggest additional Dedicated and Regular /Core Activities-only staff members. Finally, the Executive Committee and the 5 Group Leaders discussed the entire list, and made a very few final additions to complete the team. Everyone who applied should have received personal notification via email a few weeks ago, except LANL scientists, who should have been notified via their management. If you applied and did not receive a response, or if the information below is different from that which you received, please contact me immediately. I hope everyone has a safe and happy holiday. Dave Name Position Total Core Type Effort Effort Azamat Mametjanov Dedicated 100% 100% ANL Rob Jacob Dedicated 100% 75% ANL Beth Drewniak Dedicated 100% 75% ANL Jason Sarich Dedicated 100% 75% ANL Iulian Grindeanu Dedicated 75% 50% ANL Lukasz Lacinski Dedicated 75% 50% ANL Jayesh Krishna Dedicated 100% 90% ANL Wuyin Lin Dedicated 100% 75% BNL Adrian Turner Dedicated 100% 50% LANL Jon Wolfe Dedicated 100% 100% LANL Mark Petersen Dedicated 100% 50% LANL Todd Ringler Dedicated 75% 50% LANL Phil Jones Dedicated 100% 50% LANL Luke van Roekel Regular 50% 50% LANL Matt Hoffman Dedicated 75% 50% LANL Mathew Maltrud Dedicated 100% 80% LANL Nicole Jeffery Regular 50% 50% LANL stephen price Regular 50% 50% LANL Shanlin Wang Regular 50% 50% LANL Xylar Asay-Davis Dedicated 75% 50% LANL David Gunter Regular 50% 50% LANL Gautam Bisht Dedicated 85% 60% LBNL Noel Keen Dedicated 100% 75% LBNL Mathias Jacquelin Regular 50% 50% LBNL Hongzhang Shan Dedicated 75% 75% LBNL Qing Zhu Dedicated 75% 50% LBNL Chris Golaz Dedicated 100% 65% LLNL Jill Zhang Dedicated 90% 75% LLNL Qi Tang Dedicated 75% 75% LLNL Xue Zheng Dedicated 75% 50% LLNL Zeshawn Shaheen Regular 50% 50% LLNL Sterling Baldwin Dedicated 75% 75% LLNL Peter Thornton Dedicated 75% 60% ORNL Salil Mahajan Regular 50% 50% ORNL Joe Kennedy Regular 50% 50% ORNL Junqi Yin Regular 50% 50% ORNL Patrick Worley Regular 50% 50% other Balwinder Singh Dedicated 75% 50% PNNL Kate Calvin Regular 70% 50% PNNL Susannah Burrows Dedicated 75% 50% PNNL Po-Lun Ma Dedicated 75% 50% PNNL Bibi Raju Dedicated 75% 50% PNNL Kai Zhang Dedicated 75% 50% PNNL Bryce Harrop Regular 50% 50% PNNL Karthik Balaguru Regular 50% 50% PNNL Tian Zhou Dedicated 80% 50% PNNL Teklu Tesfa Dedicated 90% 50% PNNL James Foucar Dedicated 75% 75% Sandia Oksana Guba Dedicated 100% 50% Sandia Michael Deakin Dedicated 100% 50% Sandia Wade Burgess Regular 40% 40% Sandia

1 0