[jboss-user] [JBoss Messaging] - Too many Timer-XXXX threads

Mon Jul 7 15:08:35 EDT 2008

Hello there! We've got our system on production a few weeks ago (I swear that I'm doing my best to convince the customer to go from free-to-fee and buy a subscription), and since that, JBoss had stopped a few times due a problem of memory (too many threads, and it could not create a native thread). Since we start monitoring the application. We noticed that the number of active threads just sums up. Most of them are Timer threads on waiting state.

Our plataform is most based on JMS with messaging (actually we use ESB in front of it), and we are really having a hard time trying to figure out where in our code we are leaking those threads.

We are using JBoss 4.2.1, JBM 1.4.0SP3. And we have a bridge configured on the other side with a JBoss 4.2.0 with 1.4.0.SP3 as well.

I know, that this might not be a JBM issue, but the only place I've searched on the forums and found something mentioning the timer threads and waiting state issues were here.

I'm attaching the thread dump. If someone has at least a pointer to where should we look at I would be really thankful.

anonymous wrote : 
  | 2008/07/07 15:51:28 | Full thread dump Java HotSpot(TM) Server VM (1.5.0_15-b04 mixed mode):
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "RMI ConnectionExpiration-[csm:1098]" daemon prio=6 tid=0x59d9e2c8 nid=0x2348 waiting on condition [0x58c2f000..0x58c2fc1c]
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.sleep(Native Method)
  | 2008/07/07 15:51:28 | 	at sun.rmi.transport.tcp.TCPChannel$Reaper.run(TCPChannel.java:446)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "RMI TCP Connection(128)-10.10.192.11" daemon prio=6 tid=0x5504dc18 nid=0x1308 runnable [0x58b6f000..0x58b6fc9c]
  | 2008/07/07 15:51:28 | 	at java.net.SocketInputStream.socketRead0(Native Method)
  | 2008/07/07 15:51:28 | 	at java.net.SocketInputStream.read(SocketInputStream.java:129)
  | 2008/07/07 15:51:28 | 	at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
  | 2008/07/07 15:51:28 | 	at java.io.BufferedInputStream.read(BufferedInputStream.java:235)
  | 2008/07/07 15:51:28 | 	- locked <0x1b069c90> (a java.io.BufferedInputStream)
  | 2008/07/07 15:51:28 | 	at java.io.FilterInputStream.read(FilterInputStream.java:66)
  | 2008/07/07 15:51:28 | 	at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:448)
  | 2008/07/07 15:51:28 | 	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:707)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "DefaultUDPTransportMapping_10.10.192.11/0" daemon prio=6 tid=0x56c99858 nid=0x7c4 runnable [0x60d3f000..0x60d3fc1c]
  | 2008/07/07 15:51:28 | 	at java.net.PlainDatagramSocketImpl.receive0(Native Method)
  | 2008/07/07 15:51:28 | 	at java.net.PlainDatagramSocketImpl.receive(PlainDatagramSocketImpl.java:136)
  | 2008/07/07 15:51:28 | 	- locked <0x1ab7c838> (a java.net.PlainDatagramSocketImpl)
  | 2008/07/07 15:51:28 | 	at java.net.DatagramSocket.receive(DatagramSocket.java:712)
  | 2008/07/07 15:51:28 | 	- locked <0x4ed78218> (a java.net.DatagramPacket)
  | 2008/07/07 15:51:28 | 	- locked <0x1ab7c6d8> (a java.net.DatagramSocket)
  | 2008/07/07 15:51:28 | 	at org.snmp4j.transport.DefaultUdpTransportMapping$ListenThread.run(Unknown Source)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "Timer-2455" daemon prio=6 tid=0x007ba280 nid=0xba4 in Object.wait() [0x607ff000..0x607ffc9c]
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Native Method)
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Object.java:474)
  | 2008/07/07 15:51:28 | 	at java.util.TimerThread.mainLoop(Timer.java:483)
  | 2008/07/07 15:51:28 | 	- locked <0x1ab8e5b8> (a java.util.TaskQueue)
  | 2008/07/07 15:51:28 | 	at java.util.TimerThread.run(Timer.java:462)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "DefaultUDPTransportMapping_10.10.192.11/0" daemon prio=6 tid=0x56f32c18 nid=0x408 runnable [0x6050f000..0x6050fd9c]
  | 2008/07/07 15:51:28 | 	at java.net.PlainDatagramSocketImpl.receive0(Native Method)
  | 2008/07/07 15:51:28 | 	at java.net.PlainDatagramSocketImpl.receive(PlainDatagramSocketImpl.java:136)
  | 2008/07/07 15:51:28 | 	- locked <0x1ab8f0c0> (a java.net.PlainDatagramSocketImpl)
  | 2008/07/07 15:51:28 | 	at java.net.DatagramSocket.receive(DatagramSocket.java:712)
  | 2008/07/07 15:51:28 | 	- locked <0x4ed78aa8> (a java.net.DatagramPacket)
  | 2008/07/07 15:51:28 | 	- locked <0x1ab8f000> (a java.net.DatagramSocket)
  | 2008/07/07 15:51:28 | 	at org.snmp4j.transport.DefaultUdpTransportMapping$ListenThread.run(Unknown Source)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "Timer-2454" daemon prio=6 tid=0x57164a70 nid=0x1d5c in Object.wait() [0x5f98f000..0x5f98fd1c]
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Native Method)
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Object.java:474)
  | 2008/07/07 15:51:28 | 	at java.util.TimerThread.mainLoop(Timer.java:483)
  | 2008/07/07 15:51:28 | 	- locked <0x1ab8f7b8> (a java.util.TaskQueue)
  | 2008/07/07 15:51:28 | 	at java.util.TimerThread.run(Timer.java:462)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "DefaultUDPTransportMapping_10.10.192.11/0" daemon prio=6 tid=0x56f21808 nid=0x21c4 runnable [0x60c3f000..0x60c3fb9c]
  | 2008/07/07 15:51:28 | 	at java.net.PlainDatagramSocketImpl.receive0(Native Method)
  | 2008/07/07 15:51:28 | 	at java.net.PlainDatagramSocketImpl.receive(PlainDatagramSocketImpl.java:136)
  | 2008/07/07 15:51:28 | 	- locked <0x1aa096c8> (a java.net.PlainDatagramSocketImpl)
  | 2008/07/07 15:51:28 | 	at java.net.DatagramSocket.receive(DatagramSocket.java:712)
  | 2008/07/07 15:51:28 | 	- locked <0x4ed6f918> (a java.net.DatagramPacket)
  | 2008/07/07 15:51:28 | 	- locked <0x1aa8eee8> (a java.net.DatagramSocket)
  | 2008/07/07 15:51:28 | 	at org.snmp4j.transport.DefaultUdpTransportMapping$ListenThread.run(Unknown Source)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "Timer-2448" daemon prio=6 tid=0x56bf29f8 nid=0x14e8 in Object.wait() [0x5f84f000..0x5f84fc1c]
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Native Method)
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Object.java:474)
  | 2008/07/07 15:51:28 | 	at java.util.TimerThread.mainLoop(Timer.java:483)
  | 2008/07/07 15:51:28 | 	- locked <0x1aa09e28> (a java.util.TaskQueue)
  | 2008/07/07 15:51:28 | 	at java.util.TimerThread.run(Timer.java:462)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "Timer-2445" daemon prio=6 tid=0x55703c18 nid=0x2694 in Object.wait() [0x60b3f000..0x60b3fd9c]
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Native Method)
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Object.java:474)
  | 2008/07/07 15:51:28 | 	at java.util.TimerThread.mainLoop(Timer.java:483)
  | 2008/07/07 15:51:28 | 	- locked <0x1a96f4f0> (a java.util.TaskQueue)
  | 2008/07/07 15:51:28 | 	at java.util.TimerThread.run(Timer.java:462)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-12-thread-8" prio=6 tid=0x53d83bd8 nid=0xa30 waiting on condition [0x60d7f000..0x60d7fc1c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-10-thread-10" prio=6 tid=0x57c44dc8 nid=0x183c waiting on condition [0x60aff000..0x60affa1c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-10-thread-9" prio=6 tid=0x54320a60 nid=0xa14 waiting on condition [0x60a7f000..0x60a7fa1c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "Thread-4897" prio=6 tid=0x54d85318 nid=0x2108 in Object.wait() [0x60cbf000..0x60cbfb1c]
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Native Method)
  | 2008/07/07 15:51:28 | 	- waiting on <0x1a7225d0> (a java.lang.Object)
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Object.java:474)
  | 2008/07/07 15:51:28 | 	at EDU.oswego.cs.dl.util.concurrent.LinkedQueue.take(LinkedQueue.java:122)
  | 2008/07/07 15:51:28 | 	- locked <0x1a7225d0> (a java.lang.Object)
  | 2008/07/07 15:51:28 | 	at EDU.oswego.cs.dl.util.concurrent.QueuedExecutor$RunLoop.run(QueuedExecutor.java:83)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "RMI TCP Connection(123)-10.10.192.11" daemon prio=6 tid=0x569e50d8 nid=0x2730 runnable [0x60c7f000..0x60c7fc9c]
  | 2008/07/07 15:51:28 | 	at java.net.SocketInputStream.socketRead0(Native Method)
  | 2008/07/07 15:51:28 | 	at java.net.SocketInputStream.read(SocketInputStream.java:129)
  | 2008/07/07 15:51:28 | 	at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
  | 2008/07/07 15:51:28 | 	at java.io.BufferedInputStream.read(BufferedInputStream.java:235)
  | 2008/07/07 15:51:28 | 	- locked <0x1a865e90> (a java.io.BufferedInputStream)
  | 2008/07/07 15:51:28 | 	at java.io.FilterInputStream.read(FilterInputStream.java:66)
  | 2008/07/07 15:51:28 | 	at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:448)
  | 2008/07/07 15:51:28 | 	at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:707)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "Thread-4863" daemon prio=6 tid=0x573c8dc8 nid=0x4a4 in Object.wait() [0x609ff000..0x609ffc9c]
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Native Method)
  | 2008/07/07 15:51:28 | 	- waiting on <0x1a727008> (a java.lang.Object)
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Object.java:474)
  | 2008/07/07 15:51:28 | 	at EDU.oswego.cs.dl.util.concurrent.LinkedQueue.take(LinkedQueue.java:122)
  | 2008/07/07 15:51:28 | 	- locked <0x1a727008> (a java.lang.Object)
  | 2008/07/07 15:51:28 | 	at EDU.oswego.cs.dl.util.concurrent.QueuedExecutor$RunLoop.run(QueuedExecutor.java:83)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "control: Socket[addr=srvbhz-wsh001/200.150.13.250,port=4458,localport=1775]" daemon prio=6 tid=0x55876008 nid=0x2058 runnable [0x609bf000..0x609bfd1c]
  | 2008/07/07 15:51:28 | 	at java.net.SocketInputStream.socketRead0(Native Method)
  | 2008/07/07 15:51:28 | 	at java.net.SocketInputStream.read(SocketInputStream.java:129)
  | 2008/07/07 15:51:28 | 	at java.net.SocketInputStream.read(SocketInputStream.java:182)
  | 2008/07/07 15:51:28 | 	at java.io.FilterInputStream.read(FilterInputStream.java:66)
  | 2008/07/07 15:51:28 | 	at org.jboss.remoting.transport.bisocket.BisocketServerInvoker$ControlConnectionThread.run(BisocketServerInvoker.java:741)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-10-thread-8" prio=6 tid=0x5679ae38 nid=0x27a0 waiting on condition [0x6067f000..0x6067fd9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-10-thread-7" prio=6 tid=0x555bae38 nid=0x150c waiting on condition [0x606ff000..0x606ffa1c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-12-thread-7" prio=6 tid=0x55c42c40 nid=0x1ef4 waiting on condition [0x60a3f000..0x60a3fb9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "http-0.0.0.0-8080-25" daemon prio=6 tid=0x57303c08 nid=0xb4 in Object.wait() [0x6048f000..0x6048fc1c]
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Native Method)
  | 2008/07/07 15:51:28 | 	- waiting on <0x195df1e0> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Object.java:474)
  | 2008/07/07 15:51:28 | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)
  | 2008/07/07 15:51:28 | 	- locked <0x195df1e0> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
  | 2008/07/07 15:51:28 | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "http-0.0.0.0-8080-24" daemon prio=6 tid=0x57df7dd0 nid=0x1edc in Object.wait() [0x603cf000..0x603cfb9c]
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Native Method)
  | 2008/07/07 15:51:28 | 	- waiting on <0x195df1f8> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Object.java:474)
  | 2008/07/07 15:51:28 | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)
  | 2008/07/07 15:51:28 | 	- locked <0x195df1f8> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
  | 2008/07/07 15:51:28 | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "http-0.0.0.0-8080-23" daemon prio=6 tid=0x54dd2750 nid=0x1578 in Object.wait() [0x6010f000..0x6010fd1c]
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Native Method)
  | 2008/07/07 15:51:28 | 	- waiting on <0x195df1b0> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Object.java:474)
  | 2008/07/07 15:51:28 | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)
  | 2008/07/07 15:51:28 | 	- locked <0x195df1b0> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
  | 2008/07/07 15:51:28 | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "http-0.0.0.0-8080-22" daemon prio=6 tid=0x5610cc20 nid=0xfec in Object.wait() [0x5f8cf000..0x5f8cfc9c]
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Native Method)
  | 2008/07/07 15:51:28 | 	- waiting on <0x195df210> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Object.java:474)
  | 2008/07/07 15:51:28 | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)
  | 2008/07/07 15:51:28 | 	- locked <0x195df210> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
  | 2008/07/07 15:51:28 | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "http-0.0.0.0-8080-21" daemon prio=6 tid=0x5798dc48 nid=0xbe8 in Object.wait() [0x5f64f000..0x5f64fd9c]
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Native Method)
  | 2008/07/07 15:51:28 | 	- waiting on <0x196368c0> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Object.java:474)
  | 2008/07/07 15:51:28 | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)
  | 2008/07/07 15:51:28 | 	- locked <0x196368c0> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
  | 2008/07/07 15:51:28 | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "http-0.0.0.0-8080-20" daemon prio=6 tid=0x57cc5c18 nid=0x140c in Object.wait() [0x5f5cf000..0x5f5cfa1c]
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Native Method)
  | 2008/07/07 15:51:28 | 	- waiting on <0x195df1c8> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Object.java:474)
  | 2008/07/07 15:51:28 | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)
  | 2008/07/07 15:51:28 | 	- locked <0x195df1c8> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
  | 2008/07/07 15:51:28 | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "http-0.0.0.0-8080-19" daemon prio=6 tid=0x54befdb0 nid=0x1230 in Object.wait() [0x5f21f000..0x5f21fa9c]
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Native Method)
  | 2008/07/07 15:51:28 | 	- waiting on <0x195df198> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Object.java:474)
  | 2008/07/07 15:51:28 | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)
  | 2008/07/07 15:51:28 | 	- locked <0x195df198> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
  | 2008/07/07 15:51:28 | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-15-thread-10" prio=6 tid=0x559ede80 nid=0xccc waiting on condition [0x6044f000..0x6044fc9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-15-thread-9" prio=6 tid=0x5751ad98 nid=0x8bc waiting on condition [0x5f38f000..0x5f38fb1c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-12-thread-6" prio=6 tid=0x5694ac48 nid=0x1fa8 waiting on condition [0x5fd8f000..0x5fd8fc1c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-15-thread-8" prio=6 tid=0x57aabe60 nid=0xbf8 waiting on condition [0x5966f000..0x5966fc9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-15-thread-7" prio=6 tid=0x5656fa28 nid=0x20dc waiting on condition [0x6024f000..0x6024fb9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-12-thread-5" prio=6 tid=0x57258e28 nid=0x2584 waiting on condition [0x6077f000..0x6077fc1c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-12-thread-4" prio=6 tid=0x55818d88 nid=0x93c waiting on condition [0x5f6cf000..0x5f6cfb9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-15-thread-6" prio=6 tid=0x55d88d68 nid=0x10b4 waiting on condition [0x5fa0f000..0x5fa0fa9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "http-0.0.0.0-8080-18" daemon prio=6 tid=0x579ca540 nid=0x1740 in Object.wait() [0x6097f000..0x6097fb9c]
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Native Method)
  | 2008/07/07 15:51:28 | 	- waiting on <0x18c25a18> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Object.java:474)
  | 2008/07/07 15:51:28 | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)
  | 2008/07/07 15:51:28 | 	- locked <0x18c25a18> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
  | 2008/07/07 15:51:28 | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "http-0.0.0.0-8080-17" daemon prio=6 tid=0x5716cb20 nid=0xc40 in Object.wait() [0x6087f000..0x6087fc1c]
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Native Method)
  | 2008/07/07 15:51:28 | 	- waiting on <0x18c25a00> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Object.java:474)
  | 2008/07/07 15:51:28 | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)
  | 2008/07/07 15:51:28 | 	- locked <0x18c25a00> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
  | 2008/07/07 15:51:28 | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "http-0.0.0.0-8080-16" daemon prio=6 tid=0x574f6e60 nid=0x1fd4 in Object.wait() [0x6083f000..0x6083fc9c]
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Native Method)
  | 2008/07/07 15:51:28 | 	- waiting on <0x18c259e8> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Object.java:474)
  | 2008/07/07 15:51:28 | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)
  | 2008/07/07 15:51:28 | 	- locked <0x18c259e8> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
  | 2008/07/07 15:51:28 | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-15-thread-5" prio=6 tid=0x54c37dc0 nid=0x1400 waiting on condition [0x5e59f000..0x5e59fb1c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "WorkerThread#2[200.150.13.245:52567]" prio=6 tid=0x55204dd8 nid=0xfd8 runnable [0x5e75f000..0x5e75fc9c]
  | 2008/07/07 15:51:28 | 	at java.net.SocketInputStream.socketRead0(Native Method)
  | 2008/07/07 15:51:28 | 	at java.net.SocketInputStream.read(SocketInputStream.java:129)
  | 2008/07/07 15:51:28 | 	at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
  | 2008/07/07 15:51:28 | 	at java.io.BufferedInputStream.read(BufferedInputStream.java:235)
  | 2008/07/07 15:51:28 | 	- locked <0x1a7272b0> (a java.io.BufferedInputStream)
  | 2008/07/07 15:51:28 | 	at java.io.FilterInputStream.read(FilterInputStream.java:66)
  | 2008/07/07 15:51:28 | 	at org.jboss.remoting.transport.socket.ServerThread.readVersion(ServerThread.java:824)
  | 2008/07/07 15:51:28 | 	at org.jboss.remoting.transport.socket.ServerThread.processInvocation(ServerThread.java:510)
  | 2008/07/07 15:51:28 | 	at org.jboss.remoting.transport.socket.ServerThread.dorun(ServerThread.java:387)
  | 2008/07/07 15:51:28 | 	at org.jboss.remoting.transport.socket.ServerThread.run(ServerThread.java:166)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "http-0.0.0.0-8080-15" daemon prio=6 tid=0x57b63a50 nid=0x23e4 in Object.wait() [0x5996f000..0x5996fc9c]
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Native Method)
  | 2008/07/07 15:51:28 | 	- waiting on <0x180768e8> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Object.java:474)
  | 2008/07/07 15:51:28 | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)
  | 2008/07/07 15:51:28 | 	- locked <0x180768e8> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
  | 2008/07/07 15:51:28 | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "http-0.0.0.0-8080-14" daemon prio=6 tid=0x5544ce40 nid=0x23d0 in Object.wait() [0x595af000..0x595afd1c]
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Native Method)
  | 2008/07/07 15:51:28 | 	- waiting on <0x1808ac78> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Object.java:474)
  | 2008/07/07 15:51:28 | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:416)
  | 2008/07/07 15:51:28 | 	- locked <0x1808ac78> (a org.apache.tomcat.util.net.JIoEndpoint$Worker)
  | 2008/07/07 15:51:28 | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:442)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "http-0.0.0.0-8080-13" daemon prio=6 tid=0x5751ac10 nid=0xd24 runnable [0x58e2f000..0x58e2fd9c]
  | 2008/07/07 15:51:28 | 	at java.net.SocketInputStream.socketRead0(Native Method)
  | 2008/07/07 15:51:28 | 	at java.net.SocketInputStream.read(SocketInputStream.java:129)
  | 2008/07/07 15:51:28 | 	at org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:700)
  | 2008/07/07 15:51:28 | 	at org.apache.coyote.http11.InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:366)
  | 2008/07/07 15:51:28 | 	at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:805)
  | 2008/07/07 15:51:28 | 	at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:580)
  | 2008/07/07 15:51:28 | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-16-thread-10" prio=6 tid=0x56ee1e40 nid=0x1858 waiting on condition [0x6040f000..0x6040fc1c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-12-thread-3" prio=6 tid=0x54d00da0 nid=0x1e54 waiting on condition [0x5f50f000..0x5f50fc9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-15-thread-4" prio=6 tid=0x57f40c18 nid=0xb68 waiting on condition [0x6058f000..0x6058fc9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-16-thread-9" prio=6 tid=0x56f11c18 nid=0x13d4 waiting on condition [0x6054f000..0x6054fb9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-15-thread-3" prio=6 tid=0x575fe0f8 nid=0xad4 waiting on condition [0x604cf000..0x604cfa1c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-12-thread-2" prio=6 tid=0x5828dc18 nid=0x24e0 waiting on condition [0x6030f000..0x6030fa9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-10-thread-6" prio=6 tid=0x54c44dc0 nid=0x1658 waiting on condition [0x6028f000..0x6028fb9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-10-thread-5" prio=6 tid=0x5654d3f0 nid=0x38c waiting on condition [0x602cf000..0x602cfc9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-10-thread-4" prio=6 tid=0x568d9cf0 nid=0x1e20 waiting on condition [0x6038f000..0x6038fd1c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-9-thread-10" prio=6 tid=0x55622c18 nid=0x1ca4 waiting on condition [0x6034f000..0x6034fd9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-12-thread-1" prio=6 tid=0x56cb7250 nid=0xb00 waiting on condition [0x601cf000..0x601cfc9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "Thread-904" prio=6 tid=0x53e56978 nid=0x1c0c in Object.wait() [0x6018f000..0x6018fd1c]
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Native Method)
  | 2008/07/07 15:51:28 | 	- waiting on <0x168e8f58> (a java.lang.Object)
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Object.java:474)
  | 2008/07/07 15:51:28 | 	at EDU.oswego.cs.dl.util.concurrent.LinkedQueue.take(LinkedQueue.java:122)
  | 2008/07/07 15:51:28 | 	- locked <0x168e8f58> (a java.lang.Object)
  | 2008/07/07 15:51:28 | 	at EDU.oswego.cs.dl.util.concurrent.QueuedExecutor$RunLoop.run(QueuedExecutor.java:83)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-16-thread-8" prio=6 tid=0x56dc1978 nid=0x9a4 waiting on condition [0x6014f000..0x6014fd9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-15-thread-2" prio=6 tid=0x56c98ae0 nid=0x3dc waiting on condition [0x5f88f000..0x5f88fa1c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-16-thread-7" prio=6 tid=0x56d20e70 nid=0x1760 waiting on condition [0x6020f000..0x6020fb1c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-16-thread-6" prio=6 tid=0x543f9de0 nid=0x16d4 waiting on condition [0x5f58f000..0x5f58fa1c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-16-thread-5" prio=6 tid=0x53e57d38 nid=0xc8c waiting on condition [0x5fe4f000..0x5fe4fb9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-11-thread-10" prio=6 tid=0x56bfa538 nid=0x1478 waiting on condition [0x5ee1f000..0x5ee1fc1c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-10-thread-3" prio=6 tid=0x54389928 nid=0x2074 waiting on condition [0x5fc8f000..0x5fc8fa1c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-10-thread-2" prio=6 tid=0x57b25b88 nid=0x1ec0 waiting on condition [0x600cf000..0x600cfb9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-10-thread-1" prio=6 tid=0x54ee4808 nid=0x1710 waiting on condition [0x6008f000..0x6008fa1c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-16-thread-4" prio=6 tid=0x56b12670 nid=0x13f8 waiting on condition [0x6004f000..0x6004fd1c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "Thread-559" prio=6 tid=0x559a7ae8 nid=0x1600 in Object.wait() [0x6000f000..0x6000fc1c]
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Native Method)
  | 2008/07/07 15:51:28 | 	- waiting on <0x168e7720> (a java.lang.Object)
  | 2008/07/07 15:51:28 | 	at java.lang.Object.wait(Object.java:474)
  | 2008/07/07 15:51:28 | 	at EDU.oswego.cs.dl.util.concurrent.LinkedQueue.take(LinkedQueue.java:122)
  | 2008/07/07 15:51:28 | 	- locked <0x168e7720> (a java.lang.Object)
  | 2008/07/07 15:51:28 | 	at EDU.oswego.cs.dl.util.concurrent.QueuedExecutor$RunLoop.run(QueuedExecutor.java:83)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-17-thread-10" prio=6 tid=0x56770e60 nid=0x2228 waiting on condition [0x5ff0f000..0x5ff0fa1c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-9-thread-9" prio=6 tid=0x583e1a60 nid=0x1924 waiting on condition [0x5facf000..0x5facfc9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-11-thread-9" prio=6 tid=0x548c7be0 nid=0x1fbc waiting on condition [0x5ff4f000..0x5ff4fd9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-17-thread-9" prio=6 tid=0x57e79030 nid=0x1970 waiting on condition [0x5ffcf000..0x5ffcfd1c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-11-thread-8" prio=6 tid=0x53d97f10 nid=0x79c waiting on condition [0x5ff8f000..0x5ff8fa9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-17-thread-8" prio=6 tid=0x54538be0 nid=0x768 waiting on condition [0x5fb8f000..0x5fb8fa1c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-16-thread-3" prio=6 tid=0x559c7718 nid=0x17e0 waiting on condition [0x5fbcf000..0x5fbcfb1c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-17-thread-7" prio=6 tid=0x553eeb30 nid=0x1368 waiting on condition [0x5f74f000..0x5f74fc9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-9-thread-8" prio=6 tid=0x56b12d80 nid=0x22e8 waiting on condition [0x5fecf000..0x5fecfb1c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-11-thread-7" prio=6 tid=0x56b124e8 nid=0x121c waiting on condition [0x5fd0f000..0x5fd0fd9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-9-thread-7" prio=6 tid=0x55bc8808 nid=0xb74 waiting on condition [0x5fe8f000..0x5fe8fb9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-11-thread-6" prio=6 tid=0x57986c18 nid=0x215c waiting on condition [0x5f78f000..0x5f78fc1c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-17-thread-6" prio=6 tid=0x53d98b80 nid=0x15c waiting on condition [0x5fd4f000..0x5fd4fc9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-17-thread-5" prio=6 tid=0x57ef4dc8 nid=0x1fec waiting on condition [0x593ef000..0x593efd9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-11-thread-5" prio=6 tid=0x57e9e8e8 nid=0x1340 waiting on condition [0x5fe0f000..0x5fe0fd9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-17-thread-4" prio=6 tid=0x5760edc0 nid=0x138c waiting on condition [0x5fdcf000..0x5fdcfb9c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java.lang.Thread.run(Thread.java:595)
  | 2008/07/07 15:51:28 | 
  | 2008/07/07 15:51:28 | "pool-11-thread-4" prio=6 tid=0x56dc3c48 nid=0x9bc waiting on condition [0x5f9cf000..0x5f9cfd1c]
  | 2008/07/07 15:51:28 | 	at sun.misc.Unsafe.park(Native Method)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:118)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1841)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:470)
  | 2008/07/07 15:51:28 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
  | 2008/07/07 15:51:28 | 	at java

View the original post : http://www.jboss.com/index.html?module=bb&op=viewtopic&p=4162935#4162935

Reply to the post : http://www.jboss.com/index.html?module=bb&op=posting&mode=reply&p=4162935