https://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=1223 Summary: Hang checker messages after task was completed Product: Swift Version: 0.94 Platform: PC OS/Version: Mac OS Status: NEW Severity: normal Priority: P2 Component: General AssignedTo: [email protected] ReportedBy: [email protected] I was just testing a simple script that runs hostname once and records the output to a file. The job was submitted to condor and ran, but the printed hang checker messages after it was finished. Log at http://web.ci.uchicago.edu/~davidk/logs/hostname-20140320-0141-8dscb5n4.log ... Final status: Thu, 20 Mar 2014 01:52:05 +0000 Finished successfully:1 No events in 10s. Finding dependency loops... Registered futures: Waiting threads: ---- No dependency loops found. Waiting JVM threads: Thread "Thread-12" (0x00000020) TIMED_WAITING Stack trace: java.lang.Thread.sleep org.globus.cog.abstraction.coaster.service.CoasterService$1.run:323 Thread "PullThread" (0x000000a5) TIMED_WAITING waiting for org.globus.cog.abstraction.coaster.service.job.manager.PullThread (0x4b8bbb61) Stack trace: java.lang.Object.wait org.globus.cog.abstraction.coaster.service.job.manager.PullThread.mwait:151 org.globus.cog.abstraction.coaster.service.job.manager.PullThread.run:122 Thread "Timer-3" (0x000000a3) TIMED_WAITING waiting for java.util.TaskQueue (0x2d9f90e3) Stack trace: java.lang.Object.wait java.util.TimerThread.mainLoop:531 java.util.TimerThread.run:484 Thread "Condor provider queue poller" (0x0000002a) TIMED_WAITING Stack trace: java.lang.Thread.sleep org.globus.cog.abstraction.impl.scheduler.common.AbstractQueuePoller.run:90 java.lang.Thread.run:679 Thread "Block Submitter" (0x00000028) WAITING waiting for java.util.LinkedList (0x46e13e7b) Stack trace: java.lang.Object.wait java.lang.Object.wait:502 org.globus.cog.abstraction.coaster.service.job.manager.BlockTaskSubmitter.run:56 Thread "Block Queue Processor" (0x00000027) TIMED_WAITING waiting for java.util.ArrayList (0x6dcd2197) Stack trace: java.lang.Object.wait org.globus.cog.abstraction.coaster.service.job.manager.BlockQueueProcessor.run:148 Thread "Timer-2" (0x00000026) WAITING waiting for java.util.TaskQueue (0x365878d2) Stack trace: java.lang.Object.wait java.lang.Object.wait:502 java.util.TimerThread.mainLoop:505 java.util.TimerThread.run:484 Thread "Piped Channel Sender" (0x00000025) WAITING waiting for java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject (0x6a643edd) Stack trace: sun.misc.Unsafe.park java.util.concurrent.locks.LockSupport.park:186 java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await:2043 java.util.concurrent.LinkedBlockingQueue.take:386 org.globus.cog.karajan.workflow.service.channels.AbstractPipedChannel$Sender.run:113 Thread "Local Queue Processor" (0x00000023) WAITING waiting for java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject (0x29949f78) Stack trace: sun.misc.Unsafe.park java.util.concurrent.locks.LockSupport.park:186 java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await:2043 java.util.concurrent.LinkedBlockingQueue.take:386 org.globus.cog.abstraction.coaster.service.job.manager.AbstractQueueProcessor.take:43 org.globus.cog.abstraction.coaster.service.job.manager.LocalQueueProcessor.run:37 Thread "Timer-1" (0x0000001f) WAITING waiting for java.util.TaskQueue (0x24d37b87) Stack trace: java.lang.Object.wait java.lang.Object.wait:502 java.util.TimerThread.mainLoop:505 java.util.TimerThread.run:484 Thread "Thread-10" (0x0000001e) TIMED_WAITING waiting for org.globus.cog.abstraction.coaster.service.CoasterService (0x3852eef4) Stack trace: java.lang.Object.wait org.globus.cog.abstraction.coaster.service.CoasterService.waitFor:251 org.globus.cog.abstraction.coaster.service.CoasterService.main:417 org.globus.cog.abstraction.impl.execution.coaster.ServiceManager$1.run:206 java.lang.Thread.run:679 Thread "NBS3" (0x00000017) WAITING waiting for java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject (0x2b302b69) Stack trace: sun.misc.Unsafe.park java.util.concurrent.locks.LockSupport.park:186 java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await:2043 java.util.concurrent.LinkedBlockingQueue.take:386 java.util.concurrent.ThreadPoolExecutor.getTask:1069 java.util.concurrent.ThreadPoolExecutor.runWorker:1131 java.util.concurrent.ThreadPoolExecutor$Worker.run:615 java.lang.Thread.run:679 Thread "NBS2" (0x00000016) WAITING waiting for java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject (0x2b302b69) Stack trace: sun.misc.Unsafe.park java.util.concurrent.locks.LockSupport.park:186 java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await:2043 java.util.concurrent.LinkedBlockingQueue.take:386 java.util.concurrent.ThreadPoolExecutor.getTask:1069 java.util.concurrent.ThreadPoolExecutor.runWorker:1131 java.util.concurrent.ThreadPoolExecutor$Worker.run:615 java.lang.Thread.run:679 Thread "NBS1" (0x00000015) WAITING waiting for java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject (0x2b302b69) Stack trace: sun.misc.Unsafe.park java.util.concurrent.locks.LockSupport.park:186 java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await:2043 java.util.concurrent.LinkedBlockingQueue.take:386 java.util.concurrent.ThreadPoolExecutor.getTask:1069 java.util.concurrent.ThreadPoolExecutor.runWorker:1131 java.util.concurrent.ThreadPoolExecutor$Worker.run:615 java.lang.Thread.run:679 Thread "Scheduler" (0x00000010) TIMED_WAITING waiting for org.griphyn.vdl.karajan.VDSAdaptiveScheduler (0x6ac67a88) Stack trace: java.lang.Object.wait org.globus.cog.karajan.scheduler.LateBindingScheduler.sleep:303 org.globus.cog.karajan.scheduler.LateBindingScheduler.run:257 Thread "Progress ticker" (0x00000014) TIMED_WAITING Stack trace: java.lang.Thread.sleep org.griphyn.vdl.karajan.lib.RuntimeStats$ProgressTicker.run:183 Thread "Restart Log Sync" (0x00000012) WAITING waiting for org.globus.cog.karajan.workflow.nodes.restartLog.SyncThread (0x677210a5) Stack trace: java.lang.Object.wait java.lang.Object.wait:502 org.globus.cog.karajan.workflow.nodes.restartLog.SyncThread.run:47 Thread "Overloaded Host Monitor" (0x00000011) TIMED_WAITING Stack trace: java.lang.Thread.sleep org.globus.cog.karajan.scheduler.OverloadedHostMonitor.run:47 Thread "Timer-0" (0x0000000f) TIMED_WAITING waiting for java.util.TaskQueue (0x71a2f5b1) Stack trace: java.lang.Object.wait java.util.TimerThread.mainLoop:531 java.util.TimerThread.run:484 Thread "NBS0" (0x0000000e) WAITING waiting for java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject (0x2b302b69) Stack trace: sun.misc.Unsafe.park java.util.concurrent.locks.LockSupport.park:186 java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await:2043 java.util.concurrent.LinkedBlockingQueue.take:386 java.util.concurrent.ThreadPoolExecutor.getTask:1069 java.util.concurrent.ThreadPoolExecutor.runWorker:1131 java.util.concurrent.ThreadPoolExecutor$Worker.run:615 java.lang.Thread.run:679 Thread "pool-1-thread-4" (0x0000000d) WAITING waiting for java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject (0x01b071c0) Stack trace: sun.misc.Unsafe.park java.util.concurrent.locks.LockSupport.park:186 java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await:2043 java.util.concurrent.LinkedBlockingQueue.take:386 java.util.concurrent.ThreadPoolExecutor.getTask:1069 java.util.concurrent.ThreadPoolExecutor.runWorker:1131 java.util.concurrent.ThreadPoolExecutor$Worker.run:615 java.lang.Thread.run:679 Thread "pool-1-thread-3" (0x0000000c) WAITING waiting for java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject (0x01b071c0) Stack trace: sun.misc.Unsafe.park java.util.concurrent.locks.LockSupport.park:186 java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await:2043 java.util.concurrent.LinkedBlockingQueue.take:386 java.util.concurrent.ThreadPoolExecutor.getTask:1069 java.util.concurrent.ThreadPoolExecutor.runWorker:1131 java.util.concurrent.ThreadPoolExecutor$Worker.run:615 java.lang.Thread.run:679 Thread "pool-1-thread-2" (0x0000000b) WAITING waiting for java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject (0x01b071c0) Stack trace: sun.misc.Unsafe.park java.util.concurrent.locks.LockSupport.park:186 java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await:2043 java.util.concurrent.LinkedBlockingQueue.take:386 java.util.concurrent.ThreadPoolExecutor.getTask:1069 java.util.concurrent.ThreadPoolExecutor.runWorker:1131 java.util.concurrent.ThreadPoolExecutor$Worker.run:615 java.lang.Thread.run:679 Thread "pool-1-thread-1" (0x0000000a) WAITING waiting for java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject (0x01b071c0) Stack trace: sun.misc.Unsafe.park java.util.concurrent.locks.LockSupport.park:186 java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await:2043 java.util.concurrent.LinkedBlockingQueue.take:386 java.util.concurrent.ThreadPoolExecutor.getTask:1069 java.util.concurrent.ThreadPoolExecutor.runWorker:1131 java.util.concurrent.ThreadPoolExecutor$Worker.run:615 java.lang.Thread.run:679 Thread "AsyncAppender-Dispatcher-Thread-0" (0x00000008) WAITING waiting for java.util.ArrayList (0x66fbf51d) Stack trace: java.lang.Object.wait java.lang.Object.wait:502 org.apache.log4j.AsyncAppender$Dispatcher.run:548 java.lang.Thread.run:679 Thread "Finalizer" (0x00000003) WAITING waiting for java.lang.ref.ReferenceQueue$Lock (0x279977bd) Stack trace: java.lang.Object.wait java.lang.ref.ReferenceQueue.remove:133 java.lang.ref.ReferenceQueue.remove:149 java.lang.ref.Finalizer$FinalizerThread.run:189 Thread "Reference Handler" (0x00000002) WAITING waiting for java.lang.ref.Reference$Lock (0x4c842d9a) Stack trace: java.lang.Object.wait java.lang.Object.wait:502 java.lang.ref.Reference$ReferenceHandler.run:133 Thread "main" (0x00000001) WAITING waiting for org.globus.cog.abstraction.coaster.service.CoasterService$1 (0x5b6b9e62) Monitors held: java.lang.Class (0x79ce00b4) Stack trace: java.lang.Object.wait java.lang.Thread.join:1203 java.lang.Thread.join:1256 java.lang.ApplicationShutdownHooks.run:97 java.lang.Shutdown.runHooks:106 java.lang.Shutdown.sequence:150 java.lang.Shutdown.exit:195 -> locked java.lang.Class (0x79ce00b4) java.lang.Runtime.exit:107 java.lang.System.exit:923 org.griphyn.vdl.karajan.Loader.main:247 -- Configure bugmail: https://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are watching all bug changes.