https://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=1044 Summary: PBS provider generates incorrect submit file directives for coaster worker logging Product: Swift Version: 0.94 Platform: PC OS/Version: Mac OS Status: ASSIGNED Severity: normal Priority: P2 Component: Providers AssignedTo: [email protected] ReportedBy: [email protected] CC: [email protected], [email protected], [email protected] The PBS provider (at least for for Beagle) is generating submit scripts (as below) with an incorrect sequence: #PBS -e /lustre/beagle/wilde/swift.scripts/.globus/scripts/PBS5571451098073124465.submit.stderr export WORKER_LOGGING_LEVEL=NONE #PBS -v WORKER_LOGGING_LEVEL The intervening "export" above causes PBS to stop reading directives; hence it never processes the directive "#PBS -v WORKER_LOGGING_LEVEL". I did not verify that that causes the WORKER_LOGGING_LEVEL to fail to get to the worker, but I suspect that it does. The PBS guideline for directives is: "The qsub command scans the lines of the script file for directives. An initial line in the script that begins with the characters "#!" or the character ":" will be ignored and scanning will start with the next line. Scanning will continue until the first executable line, that is a line that is not blank, not a directive line, nor a line whose first non white space character is "#". If directives occur on subsequent lines, they will be ignored." I suspect the same directive scanning takes place for SGE and other schedulers, so we should check this logic across the local scheduler providers and ensure that we are turning on worker logging correctly. The full submit file is below. #CoG This script generated by CoG #CoG by class: class org.globus.cog.abstraction.impl.scheduler.pbs.PBSExecutor #CoG on date: Thu Jul 18 12:12:27 CDT 2013 #PBS -S /bin/bash #PBS -N B0718-0912550-0 #PBS -m n #PBS -l mppwidth=1,mppnppn=1,mppdepth=24 #PBS -l walltime=00:59:00 #PBS -o /lustre/beagle/wilde/swift.scripts/.globus/scripts/PBS5571451098073124465.submit.stdout #PBS -e /lustre/beagle/wilde/swift.scripts/.globus/scripts/PBS5571451098073124465.submit.stderr export WORKER_LOGGING_LEVEL=NONE #PBS -v WORKER_LOGGING_LEVEL cd / && aprun -n 1 -N 1 -cc none -d 24 -F exclusive /bin/sh -c '/usr/bin/perl /lustre/beagle/wilde/swift.scripts/.globus/coasters/cscript2826962948194385482.pl http://10.128.2.244:50000,http://127.0.0.2:50000,http://192.5.86.104:50000 0718-0912550-000009 NOLOGGING' /bin/echo $?
/lustre/beagle/wilde/swift.scripts/.globus/scripts/PBS5571451098073124465.submit.exitcode
-- Configure bugmail: https://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are watching all bug changes.