March 2013 - swift-bugs - mailman3.cels.anl.gov

[Bug 722] New: fprintf presents hanging situation
by bugzilla-daemon＠mcs.anl.gov 18 Oct '14

18 Oct '14

https://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=722 Summary: fprintf presents hanging situation Product: Swift Version: 0.93 Platform: PC OS/Version: Mac OS Status: NEW Severity: normal Priority: P2 Component: General AssignedTo: hategan(a)mcs.anl.gov ReportedBy: jonmon(a)utexas.edu CC: wilde(a)mcs.anl.gov If using %i and passing a float variable in the argument list, seems to have fprintf hang -- Configure bugmail: https://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are watching all bug changes.

1 2

[Bug 688] New: Testing env interactions
by bugzilla-daemon＠mcs.anl.gov 18 Oct '14

18 Oct '14

https://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=688 Summary: Testing env interactions Product: Swift Version: trunk Platform: PC OS/Version: Mac OS Status: NEW Severity: normal Priority: P2 Component: Testing AssignedTo: jonmon(a)utexas.edu ReportedBy: jonmon(a)utexas.edu CC: wilde(a)mcs.anl.gov, skenny(a)uchicago.edu, davidk(a)ci.uchicago.edu, wozniak(a)mcs.anl.gov, ketan(a)mcs.anl.gov Testing and documenting interactions with setting environment variables using the env profile. Justin I believe had specific testing situation and questions. -- Configure bugmail: https://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are watching all bug changes.

1 1

[Bug 923] New: @toFloat() error gives no line number
by bugzilla-daemon＠mcs.anl.gov 12 Oct '14

12 Oct '14

https://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=923 Summary: @toFloat() error gives no line number Product: Swift Version: 0.93 Platform: PC OS/Version: Mac OS Status: ASSIGNED Severity: minor Priority: P4 Component: Error messages AssignedTo: davidk(a)ci.uchicago.edu ReportedBy: wilde(a)mcs.anl.gov CC: wozniak(a)mcs.anl.gov In this expression, -startingjump was null, and the error message from @tofloat() gave no line number: (outfile,lossfile) = multi_annealing(best_filename, @tofloat(@arg("tstart", "2.0")), @tofloat(@arg("tend", "0.01")), @tofloat(@arg("trejection", "0.3")), @toint(@arg("evoreruns", "100")), @tofloat(@arg("startingjump", "2.3")), [ @tofloat(@arg("alphai", "0.0")), @tofloat(@arg("alpham", "0.0")), @tofloat(@arg("beta", "4.0")), @tofloat(@arg("gamma", "50.0")), @tofloat(@arg("delta", "-1.0")) ], @tofloat(target_innov), @toint(@arg("annealingcycles", "50")) ); } Need to see if this is still the case in 0.94. Log said: 2013-01-06 11:57:21,066-0600 INFO ExecutionContext Detailed exception: Could not convert value "" to type float at org.griphyn.vdl.karajan.lib.swiftscript.Misc.swiftscript_tofloat(Misc.java:318) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) stdout/err said: Swift 0.93 swift-r6113 (swift modified locally) cog-r3532 RunID: 20130106-1157-z0voc3r9 Progress: time: Sun, 06 Jan 2013 11:57:20 -0600 Execution failed: Could not convert value "" to type float -- Configure bugmail: https://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are watching all bug changes.

1 2

[Bug 919] New: Misleading error message when a structure type field is missing
by bugzilla-daemon＠mcs.anl.gov 12 Oct '14

12 Oct '14

https://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=919 Summary: Misleading error message when a structure type field is missing Product: Swift Version: 0.94 Platform: PC OS/Version: Mac OS Status: ASSIGNED Severity: minor Priority: P2 Component: Error messages AssignedTo: davidk(a)ci.uchicago.edu ReportedBy: wilde(a)mcs.anl.gov CC: wozniak(a)mcs.anl.gov If an expression refers to a non-existent structure field, swift gives an error like: Compile error in assignment at line 134: Type Checkpoint is not defined. instead of: in expression ckpt.ref1: field ref1 of Type Checkpoint is not defined. -- Configure bugmail: https://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are watching all bug changes.

1 2

[Bug 907] New: Dangling coaster workers interfere with subsequent Swift runs
by bugzilla-daemon＠mcs.anl.gov 08 Sep '14

08 Sep '14

https://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=907 Summary: Dangling coaster workers interfere with subsequent Swift runs Product: Swift Version: 0.94 Platform: PC OS/Version: Mac OS Status: ASSIGNED Severity: normal Priority: P2 Component: Providers AssignedTo: hategan(a)mcs.anl.gov ReportedBy: wilde(a)mcs.anl.gov CC: hategan(a)mcs.anl.gov, davidk(a)ci.uchicago.edu, wozniak(a)mcs.anl.gov Two problems here: - workers are not always cleaned up - such "dangling: workers interfere with subsequent runs Lorenzo has a log file (first message below) showing at least one manifestation of this problem. Second message indicates killing the abandoned workers solves the problems. Can we: - do a better job cleaning up abandoned workers? - make it so an abandoned worker cant connect to a subsequent server (or that if they do, no bad things, and only good things, happen?) --- ----- Forwarded Message ----- From: "Lorenzo Pesce" <lpesce(a)uchicago.edu> To: "Michael Wilde" <wilde(a)mcs.anl.gov> Sent: Saturday, December 15, 2012 12:43:06 PM Subject: 500 nodes failed again failed 500 node run: lpesce@login3:/lustre/beagle/GCNet/RG/Oreo/o080522_BS1> pwd /lustre/beagle/GCNet/RG/Oreo/o080522_BS1 -rw-rw-r-- 1 lpesce ci-users 549729889 2012-12-15 12:40 PackAndCausalTestCore_app-20121215-1801-2d9bnr57.log -rw-rw-r-- 1 lpesce ci-users 569522 2012-12-15 12:40 PackAndCausalTestCore_app.swift_2012-12-15_12:01:12_screen.log drwxrwxr-x 2 lpesce ci-users 4096 2012-12-15 12:40 PackAndCausalTestCore_app-20121215-1801-2d9bnr57.d In case you are interested in doing some post mortem. ----- Forwarded Message ----- From: "Lorenzo Pesce" <lpesce(a)uchicago.edu> To: "Michael Wilde" <wilde(a)mcs.anl.gov> Sent: Saturday, December 15, 2012 7:40:19 PM Subject: I know why it doesn't work sometimes I just realized that sometimes when swift gets killed or stops some jobs are left queued or running. These jobs create interference when the new jobs are sent. I tried a couple of times and if I clean up the queue, there seem to be no issues. I sent out a 500 nodes job and it has been happily churning for a while. -- Configure bugmail: https://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are watching all bug changes.

1 1

[Bug 871] New: Multiple client support for persistent coaster service
by bugzilla-daemon＠mcs.anl.gov 08 Sep '14

08 Sep '14

https://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=871 Summary: Multiple client support for persistent coaster service Product: Swift Version: trunk Platform: All OS/Version: All Status: NEW Severity: enhancement Priority: Medium Component: Providers AssignedTo: hategan(a)mcs.anl.gov ReportedBy: hategan(a)mcs.anl.gov CC: hategan(a)mcs.anl.gov, davidk(a)ci.uchicago.edu, wozniak(a)mcs.anl.gov A persistent coaster service should support multiple clients. There should be three modes of operation: 1. Manual workers - jobsPerNode (and possibly other relevant settings) should be specifiable either when the service is started or when the workers are started 2. Shared pool - clients would be able to re-use existing workers - all settings should be specified when starting the service and clients should not be able to override them 3. Per-client pool - each client will get its own pool of workers that is only used for one client connection - settings are specified by the client -- Configure bugmail: https://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are watching all bug changes.

1 2

[Bug 949] New: Document the scratch tag
by bugzilla-daemon＠mcs.anl.gov 12 Jul '14

12 Jul '14

https://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=949 Summary: Document the scratch tag Product: Swift Version: unspecified Platform: PC OS/Version: Mac OS Status: NEW Severity: normal Priority: P2 Component: Documentation AssignedTo: davidk(a)ci.uchicago.edu ReportedBy: davidk(a)ci.uchicago.edu Document the scratch tag -- Configure bugmail: https://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are watching all bug changes.

1 1

[Bug 921] New: swift -typecheck proceeds to execute script
by bugzilla-daemon＠mcs.anl.gov 12 Jul '14

12 Jul '14

https://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=921 Summary: swift -typecheck proceeds to execute script Product: Swift Version: 0.94 Platform: PC OS/Version: Mac OS Status: ASSIGNED Severity: minor Priority: Low Component: SwiftScript language AssignedTo: davidk(a)ci.uchicago.edu ReportedBy: wilde(a)mcs.anl.gov -typecheck is advertised as doing a compile and type check, but not executing. When no errors are detected, it seems to try to execute: login1$ swift -typecheck annealing.swift no sites file specified, setting to default: /home/wilde/swift/src/0.93/cog/modules/swift/dist/swift-svn/etc/sites.xml Swift 0.93 swift-r6113 (swift modified locally) cog-r3532 RunID: 20130106-1153-c5sv56ca Progress: time: Sun, 06 Jan 2013 11:54:03 -0600 multi_loss appCalls=1 [0.0,0.0,4.0,50.0,-1.0] multi_loss: entered: ci=0 cj=0 target_innov=58.0 evolve_reruns=100 x=[0.0,0.0,4.0,50.0,-1.0] multi_loss: i=1 calling evolve, args=[0,0,4,50,-1,58,40000,20,100,2,1,2,0.01,50,0.3,2.3,0,0,0,0,0,m,4,0] multi_annealing: AR: i=1 ....T = 2.0 multi_annealing: AR: 0.4402700913512941 0 Execution failed: sumloss/T58.0.0.sumloss (No such file or directory) login1$ -- Configure bugmail: https://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are watching all bug changes.

1 2

[Bug 869] New: Enable multiple local coaster provider pools
by bugzilla-daemon＠mcs.anl.gov 12 Jul '14

12 Jul '14

https://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=869 Summary: Enable multiple local coaster provider pools Product: Swift Version: trunk Platform: PC OS/Version: Mac OS Status: ASSIGNED Severity: normal Priority: P2 Component: Providers AssignedTo: hategan(a)mcs.anl.gov ReportedBy: wilde(a)mcs.anl.gov CC: hategan(a)mcs.anl.gov, davidk(a)ci.uchicago.edu, wozniak(a)mcs.anl.gov For mixed MPI-serial scripts, we need to have at least two pools on the local cluster (eg, midway): one for serial jobs, and one for MPI jobs. This does not seem to work for automatic coasters. There were 3 cases of interest here: Case 1: The preferred config here is case 1: to use two pools which both specify local:slurm. This case failed: it seemed that different app jobs, differentiated by tc entry, were sent indiscriminately to the wrong pool (ie they got the wrong maxtime entries etc). Case 2: Next I tried using two pools with ssh-cl:slurm, hoping that Swift would start two separate external coaster service processes. This failed with complaints that required ports were already bound. I think it also demanded that a valid proxy was in place. This solution would be fine, and quite transparent to the user, if it works without requiring the user to create an X509 proxy. Case 3: I think I finally got a third config working with two manually started coaster services, a valid proxy, and then automatic worker launch did seem to work. This would have been acceptable (but not so great for the user) if it didnt require the proxy. I will try to replicate and document the failing test cases. Mihael, it would be great if you can make cases 1 or 2 work. Or provide a simple way for the user to create the proxy needed for case 3. -- Configure bugmail: https://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are watching all bug changes.

1 3

[Bug 666] New: Ability to have sitewise provider-staging policy in a single run
by bugzilla-daemon＠mcs.anl.gov 12 Jul '14

12 Jul '14

https://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=666 Summary: Ability to have sitewise provider-staging policy in a single run Product: Swift Version: 0.93 Platform: All OS/Version: Linux Status: NEW Severity: normal Priority: P2 Component: Providers AssignedTo: hategan(a)mcs.anl.gov ReportedBy: ketan(a)mcs.anl.gov CC: hategan(a)mcs.anl.gov, davidk(a)ci.uchicago.edu, wozniak(a)mcs.anl.gov In the SCEC application ported to TG and OSG, the TG part runs using the SGE provider which does not need provider staging while the OSG part of the script needs provider staging. Currently, a script-wide single config file dictates whether to have provider-staging or not. However, in cases like this, it is desirable to have provider staging set site-wise. So that, with a sites.xml property, one may specify provider staging policy. -- Configure bugmail: https://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are watching all bug changes.

1 3