Blocker Launcher for Jetty needs to enforce use of BlockingChannelConnector on Windows platforms instead of SelectChannelConnector.
- https://github.com/sonatype/nexus/blob/master/nexus/nexus-test-harness/nexus-test-harness-launcher/src/main/java/org/sonatype/nexus/test/booter/Jetty8NexusBooter.java#L386
- https://bugs.eclipse.org/bugs/show_bug.cgi?id=357318#c62
—
A hang caused by using SelectChannelConnector has appeared in latest ITs using new Launcher.
I saw NexusStartAndStopParameterizedIT was hanging on this grid build. After confirming the Nexus launched by this IT was still started, I tried to connect to its HTTP port - I connected and then it just hung and never returned a response.
> curl -v http://slave04.grid.sonatype.com:59528/nexus/ * About to connect() to slave04.grid.sonatype.com port 59528 (#0) * Trying 172.16.2.9... connected * Connected to slave04.grid.sonatype.com (172.16.2.9) port 59528 (#0) > GET /nexus/ HTTP/1.1 > User-Agent: curl/7.21.4 (universal-apple-darwin11.0) libcurl/7.21.4 OpenSSL/0.9.8r zlib/1.2.5 > Host: slave04.grid.sonatype.com:59528 > Accept: */* > HANGS FOREVER HERE
Thread dump of Nexus reveals SelectChannelConnector still in use and locked, so we need to implement a workaround like this.
$ /cygdrive/x/s/tools/java-6x/bin/jstack -l 6260 2012-08-05 12:31:59 Full thread dump Java HotSpot(TM) 64-Bit Server VM (20.5-b03 mixed mode): "Thread-13" daemon prio=6 tid=0x0000000004ef4000 nid=0x1f84 waiting on condition [0x00000000062df000] java.lang.Thread.State: TIMED_WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x00000000c0e64b98> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) at java.util.concurrent.DelayQueue.take(DelayQueue.java:164) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "qtp1041301507-38" prio=6 tid=0x00000000088d9800 nid=0x1150 waiting on condition [0x000000000a50f000] java.lang.Thread.State: TIMED_WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x00000000c126d260> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:337) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:516) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:39) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:562) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "qtp1041301507-37" prio=6 tid=0x00000000088d9000 nid=0x16a0 waiting on condition [0x000000000a40f000] java.lang.Thread.State: TIMED_WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x00000000c126d260> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:337) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:516) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:39) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:562) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "qtp1041301507-36" prio=6 tid=0x00000000088d8000 nid=0x1730 waiting on condition [0x000000000a30f000] java.lang.Thread.State: TIMED_WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x00000000c126d260> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:337) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:516) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:39) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:562) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "qtp1041301507-35" prio=6 tid=0x00000000088d7800 nid=0x1018 waiting on condition [0x000000000a20f000] java.lang.Thread.State: TIMED_WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x00000000c126d260> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:337) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:516) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:39) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:562) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "qtp1041301507-34" prio=6 tid=0x00000000088d6800 nid=0x115c waiting on condition [0x000000000a10f000] java.lang.Thread.State: TIMED_WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x00000000c126d260> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:337) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:516) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:39) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:562) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "qtp1041301507-33" prio=6 tid=0x00000000088d6000 nid=0x1550 waiting on condition [0x000000000a00f000] java.lang.Thread.State: TIMED_WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x00000000c126d260> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:337) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:516) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:39) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:562) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "qtp1041301507-32 Selector0" prio=6 tid=0x00000000088d5800 nid=0x1128 runnable [0x0000000009f0f000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.WindowsSelectorImpl.discardUrgentData(Native Method) at sun.nio.ch.WindowsSelectorImpl.access$2200(WindowsSelectorImpl.java:32) at sun.nio.ch.WindowsSelectorImpl$SubSelector.processFDSet(WindowsSelectorImpl.java:336) at sun.nio.ch.WindowsSelectorImpl$SubSelector.processSelectedKeys(WindowsSelectorImpl.java:299) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$2900(WindowsSelectorImpl.java:255) at sun.nio.ch.WindowsSelectorImpl.updateSelectedKeys(WindowsSelectorImpl.java:471) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:149) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) - locked <0x00000000c121abe8> (a sun.nio.ch.Util$2) - locked <0x00000000c121abd8> (a java.util.Collections$UnmodifiableSet) - locked <0x00000000c121a930> (a sun.nio.ch.WindowsSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:560) at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:277) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:598) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:533) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "qtp1041301507-31 Acceptor0 SelectChannelConnector@0.0.0.0:59528 STARTING" prio=6 tid=0x0000000004f00800 nid=0x1d74 runnable [0x0000000009e0f000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152) - locked <0x00000000c124ce90> (a java.lang.Object) at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:97) at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:833) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:598) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:533) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Index-BottleWarmer-thirdparty-ctx" daemon prio=6 tid=0x0000000004eff800 nid=0x14a8 waiting on condition [0x0000000009d0f000] java.lang.Thread.State: TIMED_WAITING (sleeping) at java.lang.Thread.sleep(Native Method) at org.apache.maven.index.context.DefaultIndexingContext$1.run(DefaultIndexingContext.java:1187) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Index-BottleWarmer-snapshots-ctx" daemon prio=6 tid=0x0000000004eff000 nid=0x1f90 waiting on condition [0x0000000009c0f000] java.lang.Thread.State: TIMED_WAITING (sleeping) at java.lang.Thread.sleep(Native Method) at org.apache.maven.index.context.DefaultIndexingContext$1.run(DefaultIndexingContext.java:1187) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Index-BottleWarmer-releases-ctx" daemon prio=6 tid=0x0000000004efe000 nid=0x1090 waiting on condition [0x0000000009b0f000] java.lang.Thread.State: TIMED_WAITING (sleeping) at java.lang.Thread.sleep(Native Method) at org.apache.maven.index.context.DefaultIndexingContext$1.run(DefaultIndexingContext.java:1187) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Index-BottleWarmer-codehaus-snapshots-ctx" daemon prio=6 tid=0x0000000004efd800 nid=0x738 waiting on condition [0x0000000009a0f000] java.lang.Thread.State: TIMED_WAITING (sleeping) at java.lang.Thread.sleep(Native Method) at org.apache.maven.index.context.DefaultIndexingContext$1.run(DefaultIndexingContext.java:1187) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "RepositoryStatusChecker-codehaus-snapshots" daemon prio=6 tid=0x0000000004efd000 nid=0x1cf8 waiting on condition [0x000000000990f000] java.lang.Thread.State: TIMED_WAITING (sleeping) at java.lang.Thread.sleep(Native Method) at org.sonatype.nexus.proxy.repository.RepositoryStatusCheckerThread.run(RepositoryStatusCheckerThread.java:116) Locked ownable synchronizers: - None "Index-BottleWarmer-apache-snapshots-ctx" daemon prio=6 tid=0x0000000004efc000 nid=0x14bc waiting on condition [0x000000000980f000] java.lang.Thread.State: TIMED_WAITING (sleeping) at java.lang.Thread.sleep(Native Method) at org.apache.maven.index.context.DefaultIndexingContext$1.run(DefaultIndexingContext.java:1187) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "RepositoryStatusChecker-apache-snapshots" daemon prio=6 tid=0x0000000004efb800 nid=0x1320 waiting on condition [0x000000000970f000] java.lang.Thread.State: TIMED_WAITING (sleeping) at java.lang.Thread.sleep(Native Method) at org.sonatype.nexus.proxy.repository.RepositoryStatusCheckerThread.run(RepositoryStatusCheckerThread.java:116) Locked ownable synchronizers: - None "Index-BottleWarmer-central-ctx" daemon prio=6 tid=0x0000000004efa000 nid=0x1ae8 waiting on condition [0x000000000950f000] java.lang.Thread.State: TIMED_WAITING (sleeping) at java.lang.Thread.sleep(Native Method) at org.apache.maven.index.context.DefaultIndexingContext$1.run(DefaultIndexingContext.java:1187) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "RepositoryStatusChecker-central" daemon prio=6 tid=0x0000000004ef9000 nid=0x1ee4 waiting on condition [0x000000000940f000] java.lang.Thread.State: TIMED_WAITING (sleeping) at java.lang.Thread.sleep(Native Method) at org.sonatype.nexus.proxy.repository.RepositoryStatusCheckerThread.run(RepositoryStatusCheckerThread.java:116) Locked ownable synchronizers: - None "HashSessionScavenger-0" daemon prio=6 tid=0x0000000004ef7000 nid=0x244 in Object.wait() [0x0000000007eaf000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00000000c0080610> (a java.util.TaskQueue) at java.util.TimerThread.mainLoop(Timer.java:509) - locked <0x00000000c0080610> (a java.util.TaskQueue) at java.util.TimerThread.run(Timer.java:462) Locked ownable synchronizers: - None "jetty7-main-thread-1" prio=6 tid=0x0000000004ef6800 nid=0xee8 in Object.wait() [0x00000000065df000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00000000c0068018> (a java.lang.Object) at java.lang.Object.wait(Object.java:485) at org.eclipse.jetty.util.thread.QueuedThreadPool.join(QueuedThreadPool.java:385) - locked <0x00000000c0068018> (a java.lang.Object) at org.eclipse.jetty.server.Server.join(Server.java:402) at org.sonatype.plexus.jetty.Jetty7$JettyWrapperThread.run(Jetty7.java:151) Locked ownable synchronizers: - None "Wrapper-Connection" daemon prio=10 tid=0x0000000004ef5000 nid=0x1be4 runnable [0x00000000063df000] java.lang.Thread.State: RUNNABLE at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.read(SocketInputStream.java:129) at java.net.SocketInputStream.read(SocketInputStream.java:182) at java.io.DataInputStream.readByte(DataInputStream.java:248) at org.tanukisoftware.wrapper.WrapperManager.handleSocket(WrapperManager.java:3737) at org.tanukisoftware.wrapper.WrapperManager.run(WrapperManager.java:4084) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Wrapper-Control-Event-Monitor" daemon prio=6 tid=0x0000000004ef3800 nid=0xa08 waiting on condition [0x00000000061df000] java.lang.Thread.State: TIMED_WAITING (sleeping) at java.lang.Thread.sleep(Native Method) at org.tanukisoftware.wrapper.WrapperManager$3.run(WrapperManager.java:731) Locked ownable synchronizers: - None "Shutdown if not alive" daemon prio=6 tid=0x0000000004ef2800 nid=0x14a4 waiting on condition [0x00000000059ff000] java.lang.Thread.State: TIMED_WAITING (sleeping) at java.lang.Thread.sleep(Native Method) at org.sonatype.sisu.jsw.monitor.ShutdownIfNotAliveThread.run(ShutdownIfNotAliveThread.java:74) Locked ownable synchronizers: - None "Bootstrap Command Monitor" daemon prio=6 tid=0x0000000004ef2000 nid=0xd1c runnable [0x000000000578f000] java.lang.Thread.State: RUNNABLE at java.net.PlainSocketImpl.socketAccept(Native Method) at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408) - locked <0x00000000c0096590> (a java.net.SocksSocketImpl) at java.net.ServerSocket.implAccept(ServerSocket.java:462) at java.net.ServerSocket.accept(ServerSocket.java:430) at org.sonatype.sisu.jsw.monitor.CommandMonitorThread.run(CommandMonitorThread.java:65) Locked ownable synchronizers: - None "Low Memory Detector" daemon prio=6 tid=0x0000000004ef1000 nid=0x1dc0 runnable [0x0000000000000000] java.lang.Thread.State: RUNNABLE Locked ownable synchronizers: - None "C2 CompilerThread1" daemon prio=10 tid=0x000000000052f800 nid=0x1630 waiting on condition [0x0000000000000000] java.lang.Thread.State: RUNNABLE Locked ownable synchronizers: - None "C2 CompilerThread0" daemon prio=10 tid=0x000000000052c000 nid=0x984 waiting on condition [0x0000000000000000] java.lang.Thread.State: RUNNABLE Locked ownable synchronizers: - None "Attach Listener" daemon prio=10 tid=0x000000000052a800 nid=0x11b8 waiting on condition [0x0000000000000000] java.lang.Thread.State: RUNNABLE Locked ownable synchronizers: - None "Signal Dispatcher" daemon prio=10 tid=0x0000000004ed0800 nid=0x1ca8 runnable [0x0000000000000000] java.lang.Thread.State: RUNNABLE Locked ownable synchronizers: - None "Finalizer" daemon prio=8 tid=0x0000000000515800 nid=0xd30 in Object.wait() [0x0000000004e8f000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00000000c0096d20> (a java.lang.ref.ReferenceQueue$Lock) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118) - locked <0x00000000c0096d20> (a java.lang.ref.ReferenceQueue$Lock) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134) at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159) Locked ownable synchronizers: - None "Reference Handler" daemon prio=10 tid=0x000000000050c800 nid=0xcd8 in Object.wait() [0x0000000004d8f000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00000000c00806e0> (a java.lang.ref.Reference$Lock) at java.lang.Object.wait(Object.java:485) at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116) - locked <0x00000000c00806e0> (a java.lang.ref.Reference$Lock) Locked ownable synchronizers: - None "main" prio=6 tid=0x000000000060d800 nid=0x158c in Object.wait() [0x00000000012ce000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x00000000c00603f0> (a java.lang.Object) at java.lang.Object.wait(Object.java:485) at org.sonatype.plexus.jetty.Jetty7CWEnhancedWrapperListener.main(Jetty7CWEnhancedWrapperListener.java:77) - locked <0x00000000c00603f0> (a java.lang.Object) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409) at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.sonatype.sisu.jsw.monitor.Launcher.main(Launcher.java:82) Locked ownable synchronizers: - None "VM Thread" prio=10 tid=0x0000000000504000 nid=0x590 runnable "GC task thread#0 (ParallelGC)" prio=6 tid=0x0000000000461000 nid=0x204 runnable "GC task thread#1 (ParallelGC)" prio=6 tid=0x0000000000462800 nid=0x1b90 runnable "VM Periodic Task Thread" prio=10 tid=0x0000000004f09800 nid=0x1f24 waiting on condition JNI global references: 1502
Thread dump of surefire IT, showing hung request for status:
$ /cygdrive/x/s/tools/java-6x/bin/jstack -l 2792 2012-08-05 12:38:10 Full thread dump Java HotSpot(TM) 64-Bit Server VM (20.5-b03 mixed mode): "Thread-32" daemon prio=6 tid=0x0000000007e51800 nid=0x17f8 in Object.wait() [0x000000001123f000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.apache.tools.ant.taskdefs.StreamPumper.waitForInput(StreamPumper.java:229) - locked <0x00000000f21b0078> (a org.apache.tools.ant.taskdefs.StreamPumper) at org.apache.tools.ant.taskdefs.StreamPumper.run(StreamPumper.java:126) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Thread-33" daemon prio=6 tid=0x0000000007e51000 nid=0x1458 in Object.wait() [0x000000001113f000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.apache.tools.ant.taskdefs.StreamPumper.waitForInput(StreamPumper.java:229) - locked <0x00000000f21b01c8> (a org.apache.tools.ant.taskdefs.StreamPumper) at org.apache.tools.ant.taskdefs.StreamPumper.run(StreamPumper.java:126) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Keep Alive" daemon prio=6 tid=0x0000000008643000 nid=0x1330 runnable [0x000000000685f000] java.lang.Thread.State: RUNNABLE at java.net.PlainSocketImpl.socketAccept(Native Method) at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408) - locked <0x00000000f224e418> (a java.net.SocksSocketImpl) at java.net.ServerSocket.implAccept(ServerSocket.java:462) at java.net.ServerSocket.accept(ServerSocket.java:430) at org.sonatype.sisu.jsw.monitor.KeepAliveThread.run(KeepAliveThread.java:61) Locked ownable synchronizers: - None "Thread-29" daemon prio=6 tid=0x0000000007e50000 nid=0x8e4 in Object.wait() [0x000000001103f000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.apache.tools.ant.taskdefs.StreamPumper.waitForInput(StreamPumper.java:229) - locked <0x00000000f21b03e8> (a org.apache.tools.ant.taskdefs.StreamPumper) at org.apache.tools.ant.taskdefs.StreamPumper.run(StreamPumper.java:126) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Thread-30" daemon prio=6 tid=0x0000000007e4f800 nid=0xc6c in Object.wait() [0x0000000010f3f000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.apache.tools.ant.taskdefs.StreamPumper.waitForInput(StreamPumper.java:229) - locked <0x00000000f21c6780> (a org.apache.tools.ant.taskdefs.StreamPumper) at org.apache.tools.ant.taskdefs.StreamPumper.run(StreamPumper.java:126) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Thread-26" daemon prio=6 tid=0x000000000864a800 nid=0x1440 in Object.wait() [0x0000000010e3f000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.apache.tools.ant.taskdefs.StreamPumper.waitForInput(StreamPumper.java:229) - locked <0x00000000c09574a8> (a org.apache.tools.ant.taskdefs.StreamPumper) at org.apache.tools.ant.taskdefs.StreamPumper.run(StreamPumper.java:126) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Thread-27" daemon prio=6 tid=0x0000000008649800 nid=0x112c in Object.wait() [0x0000000010d3f000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.apache.tools.ant.taskdefs.StreamPumper.waitForInput(StreamPumper.java:229) - locked <0x00000000c095eed0> (a org.apache.tools.ant.taskdefs.StreamPumper) at org.apache.tools.ant.taskdefs.StreamPumper.run(StreamPumper.java:126) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Thread-23" daemon prio=6 tid=0x0000000008649000 nid=0xc60 in Object.wait() [0x0000000010a3f000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.apache.tools.ant.taskdefs.StreamPumper.waitForInput(StreamPumper.java:229) - locked <0x00000000c095f1c0> (a org.apache.tools.ant.taskdefs.StreamPumper) at org.apache.tools.ant.taskdefs.StreamPumper.run(StreamPumper.java:126) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Thread-24" daemon prio=6 tid=0x0000000008648000 nid=0x1520 in Object.wait() [0x000000001093f000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.apache.tools.ant.taskdefs.StreamPumper.waitForInput(StreamPumper.java:229) - locked <0x00000000c0974d00> (a org.apache.tools.ant.taskdefs.StreamPumper) at org.apache.tools.ant.taskdefs.StreamPumper.run(StreamPumper.java:126) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Thread-20" daemon prio=6 tid=0x0000000008647800 nid=0xd44 in Object.wait() [0x000000001083f000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.apache.tools.ant.taskdefs.StreamPumper.waitForInput(StreamPumper.java:229) - locked <0x00000000c09233f8> (a org.apache.tools.ant.taskdefs.StreamPumper) at org.apache.tools.ant.taskdefs.StreamPumper.run(StreamPumper.java:126) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Thread-21" daemon prio=6 tid=0x0000000008646800 nid=0xe1c in Object.wait() [0x000000001073f000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.apache.tools.ant.taskdefs.StreamPumper.waitForInput(StreamPumper.java:229) - locked <0x00000000c0923548> (a org.apache.tools.ant.taskdefs.StreamPumper) at org.apache.tools.ant.taskdefs.StreamPumper.run(StreamPumper.java:126) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Thread-17" daemon prio=6 tid=0x0000000008646000 nid=0x172c in Object.wait() [0x000000000e69f000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.apache.tools.ant.taskdefs.StreamPumper.waitForInput(StreamPumper.java:229) - locked <0x00000000c092b408> (a org.apache.tools.ant.taskdefs.StreamPumper) at org.apache.tools.ant.taskdefs.StreamPumper.run(StreamPumper.java:126) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Thread-18" daemon prio=6 tid=0x0000000008645000 nid=0x1224 in Object.wait() [0x000000000e59f000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.apache.tools.ant.taskdefs.StreamPumper.waitForInput(StreamPumper.java:229) - locked <0x00000000c092ef90> (a org.apache.tools.ant.taskdefs.StreamPumper) at org.apache.tools.ant.taskdefs.StreamPumper.run(StreamPumper.java:126) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Thread-14" daemon prio=6 tid=0x0000000008644800 nid=0x16a8 in Object.wait() [0x000000000c4ff000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.apache.tools.ant.taskdefs.StreamPumper.waitForInput(StreamPumper.java:229) - locked <0x00000000c092f280> (a org.apache.tools.ant.taskdefs.StreamPumper) at org.apache.tools.ant.taskdefs.StreamPumper.run(StreamPumper.java:126) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Thread-15" daemon prio=6 tid=0x0000000008644000 nid=0x1b5c in Object.wait() [0x000000000c3ff000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.apache.tools.ant.taskdefs.StreamPumper.waitForInput(StreamPumper.java:229) - locked <0x00000000c0941d48> (a org.apache.tools.ant.taskdefs.StreamPumper) at org.apache.tools.ant.taskdefs.StreamPumper.run(StreamPumper.java:126) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Thread-11" daemon prio=6 tid=0x0000000009a17800 nid=0x1c60 in Object.wait() [0x000000000b32f000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.apache.tools.ant.taskdefs.StreamPumper.waitForInput(StreamPumper.java:229) - locked <0x00000000c06e2a28> (a org.apache.tools.ant.taskdefs.StreamPumper) at org.apache.tools.ant.taskdefs.StreamPumper.run(StreamPumper.java:126) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Thread-12" daemon prio=6 tid=0x0000000007b44800 nid=0x1ac0 in Object.wait() [0x000000000b22f000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.apache.tools.ant.taskdefs.StreamPumper.waitForInput(StreamPumper.java:229) - locked <0x00000000c0706900> (a org.apache.tools.ant.taskdefs.StreamPumper) at org.apache.tools.ant.taskdefs.StreamPumper.run(StreamPumper.java:126) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Thread-8" daemon prio=6 tid=0x00000000062b4000 nid=0xedc in Object.wait() [0x000000000b12f000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.apache.tools.ant.taskdefs.StreamPumper.waitForInput(StreamPumper.java:229) - locked <0x00000000c053c628> (a org.apache.tools.ant.taskdefs.StreamPumper) at org.apache.tools.ant.taskdefs.StreamPumper.run(StreamPumper.java:126) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Thread-9" daemon prio=6 tid=0x0000000008faa800 nid=0x70c in Object.wait() [0x000000000a03f000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.apache.tools.ant.taskdefs.StreamPumper.waitForInput(StreamPumper.java:229) - locked <0x00000000c053cc90> (a org.apache.tools.ant.taskdefs.StreamPumper) at org.apache.tools.ant.taskdefs.StreamPumper.run(StreamPumper.java:126) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Thread-5" daemon prio=6 tid=0x00000000060cd800 nid=0x7a8 in Object.wait() [0x0000000009f3f000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.apache.tools.ant.taskdefs.StreamPumper.waitForInput(StreamPumper.java:229) - locked <0x00000000c053cee8> (a org.apache.tools.ant.taskdefs.StreamPumper) at org.apache.tools.ant.taskdefs.StreamPumper.run(StreamPumper.java:126) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Thread-6" daemon prio=6 tid=0x000000000955b800 nid=0xc30 in Object.wait() [0x0000000009e3f000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.apache.tools.ant.taskdefs.StreamPumper.waitForInput(StreamPumper.java:229) - locked <0x00000000c053d550> (a org.apache.tools.ant.taskdefs.StreamPumper) at org.apache.tools.ant.taskdefs.StreamPumper.run(StreamPumper.java:126) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Thread-2" daemon prio=6 tid=0x0000000007756000 nid=0x610 in Object.wait() [0x0000000009c3f000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.apache.tools.ant.taskdefs.StreamPumper.waitForInput(StreamPumper.java:229) - locked <0x00000000c047b458> (a org.apache.tools.ant.taskdefs.StreamPumper) at org.apache.tools.ant.taskdefs.StreamPumper.run(StreamPumper.java:126) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Thread-3" daemon prio=6 tid=0x000000000771a000 nid=0x1ee8 in Object.wait() [0x0000000006a5f000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.apache.tools.ant.taskdefs.StreamPumper.waitForInput(StreamPumper.java:229) - locked <0x00000000c0497170> (a org.apache.tools.ant.taskdefs.StreamPumper) at org.apache.tools.ant.taskdefs.StreamPumper.run(StreamPumper.java:126) at java.lang.Thread.run(Thread.java:662) Locked ownable synchronizers: - None "Low Memory Detector" daemon prio=6 tid=0x0000000004f3f000 nid=0x1e10 runnable [0x0000000000000000] java.lang.Thread.State: RUNNABLE Locked ownable synchronizers: - None "C2 CompilerThread1" daemon prio=10 tid=0x0000000004f23000 nid=0x1d0c waiting on condition [0x0000000000000000] java.lang.Thread.State: RUNNABLE Locked ownable synchronizers: - None "C2 CompilerThread0" daemon prio=10 tid=0x000000000052f000 nid=0x820 waiting on condition [0x0000000000000000] java.lang.Thread.State: RUNNABLE Locked ownable synchronizers: - None "Attach Listener" daemon prio=10 tid=0x0000000000525800 nid=0x1774 waiting on condition [0x0000000000000000] java.lang.Thread.State: RUNNABLE Locked ownable synchronizers: - None "Signal Dispatcher" daemon prio=10 tid=0x0000000004f20800 nid=0xb88 runnable [0x0000000000000000] java.lang.Thread.State: RUNNABLE Locked ownable synchronizers: - None "Finalizer" daemon prio=8 tid=0x0000000000510800 nid=0x1f6c in Object.wait() [0x0000000004edf000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118) - locked <0x00000000c0000330> (a java.lang.ref.ReferenceQueue$Lock) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134) at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159) Locked ownable synchronizers: - None "Reference Handler" daemon prio=10 tid=0x0000000000507800 nid=0xa2c in Object.wait() [0x0000000004ddf000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:485) at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116) - locked <0x00000000c00003d0> (a java.lang.ref.Reference$Lock) Locked ownable synchronizers: - None "main" prio=6 tid=0x000000000026b800 nid=0x1c20 runnable [0x000000000125d000] java.lang.Thread.State: RUNNABLE at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.read(SocketInputStream.java:129) at java.io.BufferedInputStream.fill(BufferedInputStream.java:218) at java.io.BufferedInputStream.read1(BufferedInputStream.java:258) at java.io.BufferedInputStream.read(BufferedInputStream.java:317) - locked <0x00000000f21cc210> (a java.io.BufferedInputStream) at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:697) at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:640) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1195) - locked <0x00000000f21cc2b8> (a sun.net.www.protocol.http.HttpURLConnection) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:379) at org.sonatype.sisu.litmus.testsupport.hamcrest.URLRespondsWithStatusMatcher.matchesSafely(URLRespondsWithStatusMatcher.java:87) at org.sonatype.sisu.litmus.testsupport.hamcrest.URLRespondsWithStatusMatcher.matchesSafely(URLRespondsWithStatusMatcher.java:23) at org.hamcrest.TypeSafeMatcher.matches(TypeSafeMatcher.java:65) at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:12) at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:8) at org.sonatype.nexus.testsuite.support.StartAndStopNexusParametrizedIT.startAndStop(StartAndStopNexusParametrizedIT.java:70) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:45) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:42) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:30) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:47) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:47) at org.junit.rules.RunRules.evaluate(RunRules.java:18) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:263) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:68) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:47) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:60) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:229) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:50) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:222) at org.junit.runners.ParentRunner.run(ParentRunner.java:300) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:24) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:60) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:229) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:50) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:222) at org.junit.runners.ParentRunner.run(ParentRunner.java:300) at org.apache.maven.surefire.junit4.JUnit4TestSet.execute(JUnit4TestSet.java:53) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:123) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:104) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164) at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110) at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:175) at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:107) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:68) Locked ownable synchronizers: - None "VM Thread" prio=10 tid=0x00000000004ff000 nid=0xa58 runnable "GC task thread#0 (ParallelGC)" prio=6 tid=0x000000000045e000 nid=0x1be8 runnable "GC task thread#1 (ParallelGC)" prio=6 tid=0x0000000000461000 nid=0x1910 runnable "VM Periodic Task Thread" prio=10 tid=0x0000000004f50000 nid=0xa64 waiting on condition JNI global references: 1485