April 2014 - Asg - mailman3.cels.anl.gov

Weekly report
by guoxinl＠clemson.edu 28 Apr '14

28 Apr '14

Dear all, In the last week, we were working on the design that uses current hierarchical overlay and SWARM replication strategies to support the data movement among different clusters, and the data movement among servers inside a cluster. Best Regards! Guoxin Liu PHD Candidate ECE, Clemson University

1 0

ANL Weekly Status - 20140428
by Harms, Kevin N. 28 Apr '14

28 Apr '14

Triton: * continue to work on ASG API * testing libtrion against the test code for the reference ASG implementation * added in bulk data transfer to read/write operations * added in pipelining for read/write operations Simulation: * adding capabilities to simulation our replication protocols * still working on the fault detection simulation kevin

1 0

20140428 - Sandia Status
by Danielson, Geoffrey Charles 28 Apr '14

28 Apr '14

All, Last week, Sandia continued to implement localstore and debug the SSM portion of mercury. Regards, Geoff Danielson Geoffrey.Danielson(a)hp.com gcdanie(a)sandia.gov Cell: (505) 263-0751

1 0

[aesop] #70: mechanism to query overal aesop blocking function state
by aesop 27 Apr '14

27 Apr '14

#70: mechanism to query overal aesop blocking function state ---------------------------+------------------------------------------------ Reporter: carns | Owner: Type: enhancement | Status: new Priority: major | Component: aesop functions Version: git repository | Keywords: ---------------------------+------------------------------------------------ It would be very helpful if there were a function that could be called to produce a list of all in-progress blocking functions in Aesop at run time. This would be roughly analogous to "info threads" in gdb, though it does not have to be so detailed. The use case is to get some information diagnostic information if an Aesop program hangs. In many cases a debugger will just show the main loop waiting on libev and a bunch of worker threads waiting for work, with no indication of where Aesop execution has gotten stuck. -- Ticket URL: <https://trac.mcs.anl.gov/projects/aesop/ticket/70> aesop <https://trac.mcs.anl.gov/projects/aesop> The Aesop Language

1 1

branch, master, updated. v0.2-31-gb66a2db
by noreply＠mcs.anl.gov 25 Apr '14

25 Apr '14

This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "". The branch, master has been updated via b66a2dbc5b36876d3ef312f3986b5d82b7063ad4 (commit) from a6d8ad3d281aa71ea3246ca064c6aee863dee987 (commit) Those revisions listed above that are new to this repository have not appeared on any other notification email; so we list those revisions in full, below. - Log ----------------------------------------------------------------- commit b66a2dbc5b36876d3ef312f3986b5d82b7063ad4 Author: Phil Carns <carns(a)mcs.anl.gov> Date: Fri Apr 25 22:53:27 2014 -0400 bug fix: wrong thread pool used for some aebdb ops - caused hangs in some cases under load, probably caused excessive deadlocks in other cases by inadverdently switching which thread was in charge of a txn. ----------------------------------------------------------------------- Summary of changes: src/aebdb/aebdb.ae | 6 +++--- 1 files changed, 3 insertions(+), 3 deletions(-) Diff of changes: diff --git a/src/aebdb/aebdb.ae b/src/aebdb/aebdb.ae index ca765cc..49f83aa 100644 --- a/src/aebdb/aebdb.ae +++ b/src/aebdb/aebdb.ae @@ -405,7 +405,7 @@ __blocking int aebdb_cursor_close( if(ot) th_group = ot->th_group; - AETHREAD_RUN(NULL); + AETHREAD_RUN(th_group); ret = DBCursor->c_close(DBCursor); return(ret); @@ -425,7 +425,7 @@ __blocking int aebdb_cursor_get( if(ot) th_group = ot->th_group; - AETHREAD_RUN(NULL); + AETHREAD_RUN(th_group); ret = DBcursor->c_get(DBcursor, key, data, flags); return(ret); @@ -443,7 +443,7 @@ __blocking int aebdb_cursor_del( if(ot) th_group = ot->th_group; - AETHREAD_RUN(NULL); + AETHREAD_RUN(th_group); ret = DBcursor->c_del(DBcursor, flags); return(ret); hooks/post-receive --

1 0

UAB Weekly Update
by Shane Farmer 21 Apr '14

21 Apr '14

All, Here's our status for the week: - We are in the final stages of knowledge transfer on our test suite to prepare for Seok's absence - We're getting ready to release an 0.6.7 release candidate with additional bugfixes - We're getting a roadmap together on the next few big improvements - It's also our finals week :) Shane

1 0

TAMU Update
by Gim Jongmin 21 Apr '14

21 Apr '14

Dear all, We were writing a code to reduce the overhead metadata management according to increasing number of files for a given directory. This work includes works for a wrapper for read API (provides accessing multiple records with 1 read command), directory cache problem, and reverse hash table for managing record info. Now, we can get 25-30% performance improvement against previous work, but this result is only for wrapper and directory cache issue. In this week, we will be continuing this work. Sincerely, Jongmin -- Jongmin Gim Post-Doctoral Research Associate Dept. of Elecrical and Computer Enginerring Texas A&M University 333D Wisenbaker College Station, TX 77843-3259 Phone: 979-587-8311

1 0

weekly report
by jingxuan 21 Apr '14

21 Apr '14

Hi, Everyone, last week, we figured out how to use mercury based on SSM and it worked for multiple clients with one server right now. Also, we finished simple implementation for Kerberos including using password to get credential and verify that credential. This week, we will keep on integrating all the code including client, authorization server and file servers. Hopefully, we can finish this week, and begin our prototype test next week. Jingxuan SUN Holcombe Department of Electrical and Computer Engineering Clemson University Tel:864-643-8210 Email: jingxus(a)g.clemson.edu

1 0

Weekly report
by guoxinl＠clemson.edu 21 Apr '14

21 Apr '14

Dear all, In the last week, we were working on the detailed design of a hierarchical overlay with locality awareness to store the metadata of files in a distributed manner using DHT in order to support the requirement that data can be stored any where. Best Regards! Guoxin Liu PHD Candidate ECE, Clemson University

1 0

20140421 - Sandia Status
by Danielson, Geoffrey Charles 21 Apr '14

21 Apr '14

All, Last week, Sandia continued work on implementing localstore and debugging SSM support in mercury. Regards, Geoff Danielson Geoffrey.Danielson(a)hp.com gcdanie(a)sandia.gov Cell: (505) 263-0751

1 0