October 2014 - Triton-commits - mailman3.cels.anl.gov

branch, master, updated. 3d903e37ee2433505effdccfa9bb5083c7d05cce
by noreply＠mcs.anl.gov 31 Oct '14

31 Oct '14

This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "". The branch, master has been updated via 3d903e37ee2433505effdccfa9bb5083c7d05cce (commit) via b3c83ce31bfac63fcd724180ff70e513c48121f3 (commit) from bccd70c72838849662a5bd83cfceda2c99ead4e3 (commit) Those revisions listed above that are new to this repository have not appeared on any other notification email; so we list those revisions in full, below. - Log ----------------------------------------------------------------- commit 3d903e37ee2433505effdccfa9bb5083c7d05cce Author: John Jenkins <jenkins(a)mcs.anl.gov> Date: Fri Oct 31 18:08:58 2014 +0000 added locking to queue access - fixes race condition commit b3c83ce31bfac63fcd724180ff70e513c48121f3 Author: John Jenkins <jenkins(a)mcs.anl.gov> Date: Fri Oct 31 14:16:36 2014 +0000 remove unconditional tosd status print ----------------------------------------------------------------------- Summary of changes: code/src/remote/mercury-engine.ae | 3 +++ code/src/transactional-osd/transactional-osd.ae | 8 -------- 2 files changed, 3 insertions(+), 8 deletions(-) Diff of changes: diff --git a/code/src/remote/mercury-engine.ae b/code/src/remote/mercury-engine.ae index a8065a5..f4c3703 100644 --- a/code/src/remote/mercury-engine.ae +++ b/code/src/remote/mercury-engine.ae @@ -208,6 +208,7 @@ static __blocking triton_ret_t triton_mercury_handler_dequeue(struct handler_fn* struct handler_entry *he; char* err_str; + /* TODO: cond vars are the more appropriate construct here */ triton_debug(triton_dbg_mercury, "calling aesop_sem_down() in triton_mercury_handler_dequeue()\n"); ret = aesop_sem_down(&handler_queue_sem); triton_debug(triton_dbg_mercury, "aesop_sem_down() returned %d in triton_mercury_handler_dequeue()\n", ret); @@ -216,7 +217,9 @@ static __blocking triton_ret_t triton_mercury_handler_dequeue(struct handler_fn* if(ret != AE_SUCCESS) return(TRITON_ERR_UNKNOWN); + triton_mutex_lock(&handler_queue_lock); tmp_link = triton_queue_dequeue(&handler_queue); + triton_mutex_unlock(&handler_queue_lock); /* NOTE: there _must_ be at least one element in the queue for this call * to have gotten past the semaphore */ diff --git a/code/src/transactional-osd/transactional-osd.ae b/code/src/transactional-osd/transactional-osd.ae index 42002ff..eb98201 100644 --- a/code/src/transactional-osd/transactional-osd.ae +++ b/code/src/transactional-osd/transactional-osd.ae @@ -4614,10 +4614,6 @@ __blocking triton_ret_t tosd_probe_object ( *count = 0; return tret; } - else - { - triton_error_print(tret, "tosd_probe_object"); - } *next = lmk.oid_fork; *count = i; @@ -4730,10 +4726,6 @@ __blocking triton_ret_t tosd_probe_fork ( *count = 0; return tret; } - else - { - triton_error_print(tret, "tosd_probe_fork"); - } triton_error_destroy(tret); *next = (lmk.oid_fork != fork) ? UINT64_MAX : tmp_next; hooks/post-receive --

1 0

branch, master, updated. bccd70c72838849662a5bd83cfceda2c99ead4e3
by noreply＠mcs.anl.gov 30 Oct '14

30 Oct '14

This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "". The branch, master has been updated via bccd70c72838849662a5bd83cfceda2c99ead4e3 (commit) from c31c487b829eaa50f523eb626e7723783e5a8c39 (commit) Those revisions listed above that are new to this repository have not appeared on any other notification email; so we list those revisions in full, below. - Log ----------------------------------------------------------------- commit bccd70c72838849662a5bd83cfceda2c99ead4e3 Author: Phil Carns <carns(a)mcs.anl.gov> Date: Thu Oct 30 17:54:22 2014 -0400 set 100 MB db cache size ----------------------------------------------------------------------- Summary of changes: code/src/transactional-osd/transactional-osd.ae | 7 +++++++ 1 files changed, 7 insertions(+), 0 deletions(-) Diff of changes: diff --git a/code/src/transactional-osd/transactional-osd.ae b/code/src/transactional-osd/transactional-osd.ae index e3e1dd0..42002ff 100644 --- a/code/src/transactional-osd/transactional-osd.ae +++ b/code/src/transactional-osd/transactional-osd.ae @@ -1769,6 +1769,13 @@ triton_ret_t tosd_init(void) tret = triton_ret_from_bdb(ret); goto tosd_init_error; } + + /* TODO: temporary, to avoid "BDB3017 unable to allocate space from + * the buffer cache" error when doing a big txn with snapshot + * isolation, see trac #341 + */ + ret = envp->set_cachesize(envp, 0, (100*1024*1024), 0); + assert(ret == 0); env_flags = DB_CREATE | /* Create the environment if it does not exist */ hooks/post-receive --

1 0

branch, master, updated. c31c487b829eaa50f523eb626e7723783e5a8c39
by noreply＠mcs.anl.gov 30 Oct '14

30 Oct '14

This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "". The branch, master has been updated via c31c487b829eaa50f523eb626e7723783e5a8c39 (commit) from 19506c804687568098d003bdb33f25f226f87e93 (commit) Those revisions listed above that are new to this repository have not appeared on any other notification email; so we list those revisions in full, below. - Log ----------------------------------------------------------------- commit c31c487b829eaa50f523eb626e7723783e5a8c39 Author: Phil Carns <carns(a)mcs.anl.gov> Date: Thu Oct 30 17:12:24 2014 -0400 fix print to refer to right function ----------------------------------------------------------------------- Summary of changes: code/src/transactional-osd/transactional-osd.ae | 2 +- 1 files changed, 1 insertions(+), 1 deletions(-) Diff of changes: diff --git a/code/src/transactional-osd/transactional-osd.ae b/code/src/transactional-osd/transactional-osd.ae index 945d9e6..e3e1dd0 100644 --- a/code/src/transactional-osd/transactional-osd.ae +++ b/code/src/transactional-osd/transactional-osd.ae @@ -4609,7 +4609,7 @@ __blocking triton_ret_t tosd_probe_object ( } else { - triton_error_print(tret, "tosd_probe_fork"); + triton_error_print(tret, "tosd_probe_object"); } *next = lmk.oid_fork; hooks/post-receive --

1 0

branch, master, updated. 19506c804687568098d003bdb33f25f226f87e93
by noreply＠mcs.anl.gov 30 Oct '14

30 Oct '14

This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "". The branch, master has been updated via 19506c804687568098d003bdb33f25f226f87e93 (commit) from 90eba3e38b5e6531e25dc5eeb1c65b4024204135 (commit) Those revisions listed above that are new to this repository have not appeared on any other notification email; so we list those revisions in full, below. - Log ----------------------------------------------------------------- commit 19506c804687568098d003bdb33f25f226f87e93 Author: Phil Carns <carns(a)mcs.anl.gov> Date: Thu Oct 30 16:29:37 2014 -0400 minor tweak to install doc ----------------------------------------------------------------------- Summary of changes: code/INSTALL | 2 +- 1 files changed, 1 insertions(+), 1 deletions(-) Diff of changes: diff --git a/code/INSTALL b/code/INSTALL index 5eded73..19c0849 100644 --- a/code/INSTALL +++ b/code/INSTALL @@ -67,9 +67,9 @@ export TRITON_PREFIX=/home/pcarns/triton-install <retrieve and initialize the Mercury repository via: git clone git://git.mcs.anl.gov/radix/mercury + cd mercury git submodule update --init git checkout topic_callback - cd mercury mkdir build cd build <run one of the following build commands, but be sure to adjust the BMI hooks/post-receive --

1 0

branch, master, updated. 90eba3e38b5e6531e25dc5eeb1c65b4024204135
by noreply＠mcs.anl.gov 29 Oct '14

29 Oct '14

This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "". The branch, master has been updated via 90eba3e38b5e6531e25dc5eeb1c65b4024204135 (commit) from 0c5585a0e4bff88c9bf74039ca48fede5f3e0e0a (commit) Those revisions listed above that are new to this repository have not appeared on any other notification email; so we list those revisions in full, below. - Log ----------------------------------------------------------------- commit 90eba3e38b5e6531e25dc5eeb1c65b4024204135 Author: Phil Carns <carns(a)mcs.anl.gov> Date: Wed Oct 29 09:37:10 2014 -0400 update Mercury install doc: - use TRITON_PREFIX convention - drop the option to disable verbose logging - note about how to use system OPA and Boost libraries ----------------------------------------------------------------------- Summary of changes: code/INSTALL | 31 ++++++++++++++++--------------- 1 files changed, 16 insertions(+), 15 deletions(-) Diff of changes: diff --git a/code/INSTALL b/code/INSTALL index 191b69e..5eded73 100644 --- a/code/INSTALL +++ b/code/INSTALL @@ -76,31 +76,32 @@ export TRITON_PREFIX=/home/pcarns/triton-install and Mercury install prefixes according to your environment> - When using BMI: + + # NOTE: omit the OPA and Boost_INCLUDE arguments if you are using system + # libraries for OPA and Boost dependencies. cmake -DNA_USE_BMI:BOOL=ON \ - -DBMI_INCLUDE_DIR:PATH=<BMI_INSTALL_PREFIX>/include \ - -DBMI_LIBRARY:FILEPATH=<BMI_INSTALL_PREFIX>/lib/libbmi.a \ - -DOPA_INCLUDE_DIR:PATH=<OPENPA_INSTALL_PREFIX>/include \ - -DOPA_LIBRARY:FILEPATH=<OPENPA_INSTALL_PREFIX>/lib/libopa.a \ + -DBMI_INCLUDE_DIR:PATH=$TRITON_PREFIX/include \ + -DBMI_LIBRARY:FILEPATH=$TRITON_PREFIX/lib/libbmi.a \ + -DOPA_INCLUDE_DIR:PATH=$TRITON_PREFIX/include \ + -DOPA_LIBRARY:FILEPATH=$TRITON_PREFIX/lib/libopa.a \ -DMERCURY_USE_BOOST_PP:BOOL=ON \ - -DMERCURY_Boost_INCLUDE_DIR:PATH=<BOOST_INSTALL_PREFIX>/include \ - -DMERCURY_ENABLE_VERBOSE_ERROR:BOOL=OFF \ + -DMERCURY_Boost_INCLUDE_DIR:PATH=$TRITON_PREFIX/include \ -DCMAKE_BUILD_TYPE:STRING=RelWithDebInfo \ - -DCMAKE_INSTALL_PREFIX=<MERCURY_INSTALL_PREFIX> ../ + -DCMAKE_INSTALL_PREFIX=$TRITON_PREFIX ../ - When using SSM (over TCP): cmake -DNA_USE_SSM:BOOL=ON \ - -DSSM_INCLUDE_DIR:PATH=<SSM_INSTALL_PREFIX>/include \ - -DSSM_LIBRARY:FILEPATH=<SSM_INSTALL_PREFIX>/lib/libssm.a \ - -SSM_LIBRARY_SSMPTCP:FILEPATH=<SSM_INSTALL_PREFIX>/lib/libssmptcp.a \ - -DOPA_INCLUDE_DIR:PATH=<OPENPA_INSTALL_PREFIX>/include \ - -DOPA_LIBRARY:FILEPATH=<OPENPA_INSTALL_PREFIX>/lib/libopa.a \ + -DSSM_INCLUDE_DIR:PATH=$TRITON_PREFIX/include \ + -DSSM_LIBRARY:FILEPATH=$TRITON_PREFIX/lib/libssm.a \ + -SSM_LIBRARY_SSMPTCP:FILEPATH=$TRITON_PREFIX/lib/libssmptcp.a \ + -DOPA_INCLUDE_DIR:PATH=$TRITON_PREFIX/include \ + -DOPA_LIBRARY:FILEPATH=$TRITON_PREFIX/lib/libopa.a \ -DMERCURY_USE_BOOST_PP:BOOL=ON \ - -DMERCURY_Boost_INCLUDE_DIR:PATH=<BOOST_INSTALL_PREFIX>/include \ - -DMERCURY_ENABLE_VERBOSE_ERROR:BOOL=OFF \ + -DMERCURY_Boost_INCLUDE_DIR:PATH=$TRITON_PREFIX/include \ -DCMAKE_BUILD_TYPE:STRING=RelWithDebInfo \ - -DCMAKE_INSTALL_PREFIX=<MERCURY_INSTALL_PREFIX> ../ + -DCMAKE_INSTALL_PREFIX=$TRITON_PREFIX ../ make make install hooks/post-receive --

1 0

branch, master, updated. 0c5585a0e4bff88c9bf74039ca48fede5f3e0e0a
by noreply＠mcs.anl.gov 29 Oct '14

29 Oct '14

This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "". The branch, master has been updated via 0c5585a0e4bff88c9bf74039ca48fede5f3e0e0a (commit) from 452d9c43e3d2cce2b98675c3d91af765f0b40f1b (commit) Those revisions listed above that are new to this repository have not appeared on any other notification email; so we list those revisions in full, below. - Log ----------------------------------------------------------------- commit 0c5585a0e4bff88c9bf74039ca48fede5f3e0e0a Author: Phil Carns <carns(a)mcs.anl.gov> Date: Wed Oct 29 09:32:32 2014 -0400 typo fix ----------------------------------------------------------------------- Summary of changes: code/INSTALL | 2 +- 1 files changed, 1 insertions(+), 1 deletions(-) Diff of changes: diff --git a/code/INSTALL b/code/INSTALL index df1ee5a..191b69e 100644 --- a/code/INSTALL +++ b/code/INSTALL @@ -68,7 +68,7 @@ export TRITON_PREFIX=/home/pcarns/triton-install <retrieve and initialize the Mercury repository via: git clone git://git.mcs.anl.gov/radix/mercury git submodule update --init - git checkout topic_callback> + git checkout topic_callback cd mercury mkdir build cd build hooks/post-receive --

1 0

branch, master, updated. 452d9c43e3d2cce2b98675c3d91af765f0b40f1b
by noreply＠mcs.anl.gov 29 Oct '14

29 Oct '14

This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "". The branch, master has been updated via 452d9c43e3d2cce2b98675c3d91af765f0b40f1b (commit) from 04c0e504c2fa59f85c3d0f61be6638689947c1ba (commit) Those revisions listed above that are new to this repository have not appeared on any other notification email; so we list those revisions in full, below. - Log ----------------------------------------------------------------- commit 452d9c43e3d2cce2b98675c3d91af765f0b40f1b Author: Phil Carns <carns(a)mcs.anl.gov> Date: Wed Oct 29 09:31:12 2014 -0400 minor doc update (bmi repo needs ./prepare) ----------------------------------------------------------------------- Summary of changes: code/INSTALL | 1 + 1 files changed, 1 insertions(+), 0 deletions(-) Diff of changes: diff --git a/code/INSTALL b/code/INSTALL index 89ceccd..df1ee5a 100644 --- a/code/INSTALL +++ b/code/INSTALL @@ -38,6 +38,7 @@ export TRITON_PREFIX=/home/pcarns/triton-install * one of either BMI or SSM: * BMI (git clone git://git.mcs.anl.gov/bmi) + ./prepare ./configure --prefix=$TRITON_PREFIX make make install hooks/post-receive --

1 0

branch, master, updated. 9244b3f1f7f8441f1f565717a5d647adc739616a
by noreply＠mcs.anl.gov 28 Oct '14

28 Oct '14

This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "". The branch, master has been updated via 9244b3f1f7f8441f1f565717a5d647adc739616a (commit) from 174def1db177fdaf17c3c149c33a5d2e274fd730 (commit) Those revisions listed above that are new to this repository have not appeared on any other notification email; so we list those revisions in full, below. - Log ----------------------------------------------------------------- commit 9244b3f1f7f8441f1f565717a5d647adc739616a Author: John Jenkins <jenkins(a)mcs.anl.gov> Date: Tue Oct 28 16:29:31 2014 -0500 xtreemfs publications link ----------------------------------------------------------------------- Summary of changes: notes/jenkins_related-data-analytics.pptx | Bin 4658285 -> 4658452 bytes 1 files changed, 0 insertions(+), 0 deletions(-) Diff of changes: diff --git a/notes/jenkins_related-data-analytics.pptx b/notes/jenkins_related-data-analytics.pptx index 1f113c5..713ed3e 100644 Binary files a/notes/jenkins_related-data-analytics.pptx and b/notes/jenkins_related-data-analytics.pptx differ hooks/post-receive --

1 0

branch, master, updated. 04c0e504c2fa59f85c3d0f61be6638689947c1ba
by noreply＠mcs.anl.gov 28 Oct '14

28 Oct '14

This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "". The branch, master has been updated via 04c0e504c2fa59f85c3d0f61be6638689947c1ba (commit) via da5542ef86c311728cd7d5b3341453a0bed784bf (commit) from 102e7b6b98929dde9de200c24051fc18fee1f6d7 (commit) Those revisions listed above that are new to this repository have not appeared on any other notification email; so we list those revisions in full, below. - Log ----------------------------------------------------------------- commit 04c0e504c2fa59f85c3d0f61be6638689947c1ba Author: John Jenkins <jenkins(a)mcs.anl.gov> Date: Tue Oct 28 11:35:10 2014 -0500 enhancements to running - better tempid usage, sweeps over client counts commit da5542ef86c311728cd7d5b3341453a0bed784bf Author: John Jenkins <jenkins(a)mcs.anl.gov> Date: Tue Oct 28 11:34:26 2014 -0500 fix rep. factor printing if config template already has it ----------------------------------------------------------------------- Summary of changes: code/scripts/simple-mgmt/generate-config.sh | 30 +++++++++++++++++-- misc/experiments/ior-asg/ior-run.sh | 42 ++++++++++++++++++-------- 2 files changed, 56 insertions(+), 16 deletions(-) Diff of changes: diff --git a/code/scripts/simple-mgmt/generate-config.sh b/code/scripts/simple-mgmt/generate-config.sh index 54635e0..9093dfd 100755 --- a/code/scripts/simple-mgmt/generate-config.sh +++ b/code/scripts/simple-mgmt/generate-config.sh @@ -11,6 +11,10 @@ function assert_error () { fi } +function replace_cfg_val () { + sed "s!$$1.*=$.*!\1 $2!" +} + function usage () { local app=$(basename $0) cat >&2 <<EOF @@ -63,6 +67,8 @@ g_output= g_scriptdir="$( cd "$( dirname "${BASH_SOURCE[0]}" )" && pwd )" # replication factor g_repfactor=1 +# shorthand for the replication factor key +g_rf_key=triton_rosd_default_replication_factor while getopts :hf:p:c:n:m:s:r: flag; do case $flag in @@ -123,20 +129,38 @@ for (( h = 0; h < ${#g_hosts[@]}; h++ )) ; do done g_hoststring+=$(echo -e "\n}") +g_has_rep_factor=no ### generate the rest of the config file if [[ -r $g_config ]] ; then cfg=$(cat $g_config) assert_error + grep $g_rf_key $g_config >/dev/null 2>&1 + [[ $? != 0 ]] && g_has_rep_factor=yes else cfg=$(cat <<EOF triton_debug_masks = $g_mask triton_debug_file = $g_tdir/triton-server-%TRITON_SERVER_NAME%-log triton_tosd_db_path = $g_tdir/triton-server-%TRITON_SERVER_NAME%-meta triton_tosd_data_path = $g_tdir/triton-server-%TRITON_SERVER_NAME%-data -triton_rosd_default_replication_factor = $g_repfactor +$g_rf_key = $g_repfactor EOF ) fi -### dump the configuration to standard out -echo -e "$cfg\n\n$g_hoststring" +g_repstring="\n$g_rf_key = $g_repfactor" + +g_cfg_withrep="$cfg\n$g_repstring\n\n$g_hoststring" +g_cfg_norep="$cfg\n\n$g_hoststring" + +### dump the configuration to standard out, putting in replication factor +### if not already there +if [[ -r $g_config ]] ; then + if [[ $g_has_rep_factor == yes ]] ; then + echo -e "$cfg\n$g_repstring\n\n$g_hoststring" + else + echo -e "$cfg\n\n$g_hoststring" \ + | replace_cfg_val $g_rf_key $g_repfactor + fi +else + echo -e "$cfg\n\n$g_hoststring" +fi diff --git a/misc/experiments/ior-asg/ior-run.sh b/misc/experiments/ior-asg/ior-run.sh index 87c28df..18c97a1 100755 --- a/misc/experiments/ior-asg/ior-run.sh +++ b/misc/experiments/ior-asg/ior-run.sh @@ -17,6 +17,7 @@ usage: $app [-h] [-e <path to triton executables>] [-s <triton storage directory>] [-x <IOR executable path>] [-p <ranks per node>] + [-w] [-d <tempfile dir>] [-i <temp ID>] [-r <replication factor>] @@ -35,13 +36,15 @@ usage: $app [-h] [-e <path to triton executables>] (default - assumes the executable is on PATH) -p processes per client node to run IOR on (default - 1) + -w run a parameter sweep over the number of clients, in + an exponential progression (1, 2, 4, 8, ... num_clients) -t path where job temporaries + output will be placed. This location must be reachable by all nodes in the job. This location will be created via mkdir -p if it doesn't exist. (default - current working directory) -i temporary ID to use with temp files - (default - use the bash process ID) + (default - none) -r replication factor for each object created (default - 1) <num clients> number of IO client nodes @@ -77,9 +80,10 @@ g_triton_storage_path= g_working_path=$(pwd) g_ior_exe= g_ior_ppn=1 -g_temp_id=$$ +g_temp_id= g_repfactor=1 -while getopts :he:m:c:s:x:p:t:i:r: flag ; do +g_do_sweep=no +while getopts :he:m:c:s:x:p:wt:i:r: flag ; do case $flag in h) usage ;; @@ -95,9 +99,11 @@ while getopts :he:m:c:s:x:p:t:i:r: flag ; do ;; p) g_ior_ppn=${OPTARG%%/} ;; + w) g_do_sweep=yes + ;; t) g_working_path=${OPTARG%%/} ;; - i) g_temp_id=$OPTARG + i) g_temp_id=.$OPTARG ;; r) g_repfactor=$OPTARG ;; @@ -158,8 +164,8 @@ fi ### partition set up the servers and clients (use process ID for both) -g_hostfile_tmp=$g_working_path/hosts.tmp.$g_temp_id -g_clifile_tmp=$g_working_path/clients.tmp.$g_temp_id +g_hostfile_tmp=$g_working_path/hosts${g_temp_id}.tmp +g_clifile_tmp=$g_working_path/clients${g_temp_id}.tmp head -n -$g_num_clients $g_host_file > $g_hostfile_tmp tail -n $g_num_clients $g_host_file > $g_clifile_tmp @@ -183,7 +189,7 @@ sed -ri "s/^.*\$/&:$g_ior_ppn/g" $g_clifile_tmp [[ -n $g_triton_storage_path ]] && \ g_triton_storage_arg="-s $g_triton_storage_path" || g_triton_storage_arg= -g_triton_cfg_file=$g_working_path/triton_ior.conf.$g_temp_id +g_triton_cfg_file=$g_working_path/triton_ior.conf.gen${g_temp_id} ${g_script_prefix}generate-config.sh \ -f $g_hostfile_tmp -r $g_repfactor \ @@ -214,7 +220,7 @@ done # for now, we're just grabbing the first host from the config - we should # probably think harder about how this works to avoid bottlenecking -g_ior_cfg=$g_working_path/ior.tmp.$g_temp_id +g_ior_cfg=$g_working_path/ior${g_temp_id}.tmp # note: need parse hosts here instead of head g_hostfile_tmp for the "decorated" # hostname g_ior_init_hostname=\ @@ -222,13 +228,23 @@ $(${g_script_prefix}parse-hosts.sh -n $g_triton_cfg_file | head -n 1) assert_error sed "s!REPLACEME!asg:$g_ior_init_hostname!" < $g_ior_template > $g_ior_cfg +# set up potential parameter sweep client counts +i=$((g_num_clients*g_ior_ppn)) +if [[ $g_do_sweep == yes ]] ; then + i=1 +else + i=$((g_num_clients*g_ior_ppn)) +fi + # run it!!! # TODO: better way of controlling rank to node mapping? -timeout 3m mpirun -n $((g_num_clients*g_ior_ppn)) \ - -f $g_clifile_tmp $g_ior_exe -f $g_ior_cfg \ - > $g_working_path/ior.$g_temp_id.out 2> $g_working_path/ior.$g_temp_id.err - -err=$? +for (( ; i <= $g_num_clients*$g_ior_ppn ; i*=2 )) ; do + timeout 3m mpirun -n $i -f $g_clifile_tmp \ + $g_ior_exe -f $g_ior_cfg \ + >> $g_working_path/ior.$i${g_temp_id}.out \ + 2>> $g_working_path/ior.$i${g_temp_id}.err + err=$? ; [[ $err == 0 ]] || ( echo mpirun failed, exiting... >&2 ; break ) +done ### shutdown the servers and perform cleanup hooks/post-receive --

1 0

branch, master, updated. 174def1db177fdaf17c3c149c33a5d2e274fd730
by noreply＠mcs.anl.gov 27 Oct '14

27 Oct '14

This is an automated email from the git hooks/post-receive script. It was generated because a ref change was pushed to the repository containing the project "". The branch, master has been updated via 174def1db177fdaf17c3c149c33a5d2e274fd730 (commit) from 72079d3191e12c1b31c9648b4a19420a219cd035 (commit) Those revisions listed above that are new to this repository have not appeared on any other notification email; so we list those revisions in full, below. - Log ----------------------------------------------------------------- commit 174def1db177fdaf17c3c149c33a5d2e274fd730 Author: John Jenkins <jenkins(a)mcs.anl.gov> Date: Mon Oct 27 14:52:20 2014 -0500 a bit of xtreemfs ----------------------------------------------------------------------- Summary of changes: notes/jenkins_related-data-analytics.pptx | Bin 4657169 -> 4658285 bytes 1 files changed, 0 insertions(+), 0 deletions(-) Diff of changes: diff --git a/notes/jenkins_related-data-analytics.pptx b/notes/jenkins_related-data-analytics.pptx index 31c3494..1f113c5 100644 Binary files a/notes/jenkins_related-data-analytics.pptx and b/notes/jenkins_related-data-analytics.pptx differ hooks/post-receive --

1 0