[prev in list] [next in list] [prev in thread] [next in thread]
List: jboss-user
Subject: [jboss-user] [JBoss Remoting] - Re: Remote
From: david malechek <do-not-reply () jboss ! com>
Date: 2011-04-28 20:32:20
Message-ID: 2-599414-3-68819-1303429082006-2-602613-3-68819-1304022717781.jivesbs.jivemailuser () http://community ! jboss ! org
[Download RAW message or body]
[Attachment #2 (multipart/alternative)]
david malechek [http://community.jboss.org/people/dmalechek] created the discussion
"Re: Remote Client.addCallbackListener hang"
To view the discussion, visit: http://community.jboss.org/message/602613#602613
--------------------------------------------------------------
Ron,
Unfortunately we had an incident with the 2.2.4 jar that locked up all remote client \
activity. I tried my hand at analyzing the thread dump, let me know if you think I'm \
wrong. I think it may be related to JBREM-1242 but too involved for me to figure \
out. Assuming that Object@383d87 is connectionValidatorLock and Object@8ecb42 is \
clientLeaseLock, the threads below show that Timer-9954 and Thread-390047 block each \
other. Which would only be slightly bad, but then Timer-2 blocks and then all the \
WorkerThreads like WorkerThread#1664 is blocked since handleClientFailure is \
synchronized. There was actually a thread Timer-9953 exactly like Timer-9954 as \
well.
Thread: Timer-9954 : priority:5, demon:true, threadId:782301, threadState:BLOCKED, \
lockName:java.lang.Object@383d87 \
org.jboss.remoting.Client.notifyListeners(Client.java:1781)
...
Thread: Thread-390047 : priority:5, demon:true, threadId:778140, threadState:BLOCKED, \
lockName:java.lang.Object@8ecb42
org.jboss.remoting.MicroRemoteClientInvoker.establishLease(MicroRemoteClientInvoker.java:458)
...
Thread: Timer-2 : priority:5, demon:true, threadId:39, threadState:BLOCKED, \
lockName:java.lang.Object@383d87 \
org.jboss.remoting.Client.disconnect(Client.java:735)
org.jboss.remoting.callback.ServerInvokerCallbackHandler.destroy(ServerInvokerCallbackHandler.java:1016)
org.jboss.remoting.callback.ServerInvokerCallbackHandler.shutdown(ServerInvokerCallbackHandler.java:1028)
org.jboss.jms.server.endpoint.ServerConnectionEndpoint.closeCallbackClient(ServerConnectionEndpoint.java:474)
org.jboss.jms.server.connectionmanager.SimpleConnectionManager.cleanupForSessionID(SimpleConnectionManager.java:468)
org.jboss.jms.server.connectionmanager.SimpleConnectionManager.handleClientFailure(SimpleConnectionManager.java:201)
org.jboss.jms.server.connectionmanager.SimpleConnectionManager.handleConnectionException(SimpleConnectionManager.java:241)
...
Thread: WorkerThread#1664[10.48.16.175:56059] : priority:5, demon:false, \
threadId:786648, threadState:BLOCKED, \
lockName:org.jboss.jms.server.connectionmanager.SimpleConnectionManager@2cf63
org.jboss.jms.server.connectionmanager.SimpleConnectionManager.handleClientFailure(SimpleConnectionManager.java:201)
...
Thanks,
David
--------------------------------------------------------------
Reply to this message by going to Community
[http://community.jboss.org/message/602613#602613]
Start a new discussion in JBoss Remoting at Community
[http://community.jboss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2050]
[Attachment #5 (text/html)]
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<html>
<body link="#355491" alink="#4262a1" vlink="#355491" style="background: #e2e2e2; \
margin: 0; padding: 20px;">
<div>
<table cellpadding="0" bgcolor="#FFFFFF" border="0" cellspacing="0" style="border: \
1px solid #dadada; margin-bottom: 30px; width: 100%; -moz-border-radius: 6px; \
-webkit-border-radius: 6px;"> <tbody>
<tr>
<td>
<table border="0" cellpadding="0" cellspacing="0" bgcolor="#FFFFFF" \
style="border: solid 2px #ccc; background: #dadada; width: 100%; -moz-border-radius: \
6px; -webkit-border-radius: 6px;"> <tbody>
<tr>
<td bgcolor="#000000" valign="middle" height="58px" style="border-bottom: 1px \
solid #ccc; padding: 20px; -moz-border-radius-topleft: 3px; \
-moz-border-radius-topright: 3px; -webkit-border-top-right-radius: 5px; \
-webkit-border-top-left-radius: 5px;">
<h1 style="color: #333333; font: bold 22px Arial, Helvetica, sans-serif; \
margin: 0; display: block !important;">
<!-- To have a header image/logo replace the name below with your img tag \
-->
<!-- Email clients will render the images when the message is read so any \
image -->
<!-- must be made available on a public server, so that all recipients can \
load the image. -->
<a href="http://community.jboss.org/index.jspa" style="text-decoration: \
none; color: #E1E1E1">JBoss Community</a></h1> </td>
</tr>
<tr>
<td bgcolor="#FFFFFF" style="font: normal 12px Arial, Helvetica, sans-serif; \
color:#333333; padding: 20px; -moz-border-radius-bottomleft: 4px; \
-moz-border-radius-bottomright: 4px; -webkit-border-bottom-right-radius: 5px; \
-webkit-border-bottom-left-radius: 5px;"><h3 style="margin: 10px 0 5px; font-size: \
17px; font-weight: normal;"> Re: Remote Client.addCallbackListener hang
</h3>
<span style="margin-bottom: 10px;">
created by <a href="http://community.jboss.org/people/dmalechek">david \
malechek</a> in <i>JBoss Remoting</i> - <a \
href="http://community.jboss.org/message/602613#602613">View the full discussion</a> \
</span> <hr style="margin: 20px 0; border: none; background-color: #dadada; height: \
1px;">
<div class="jive-rendered-content"><p>Ron,</p><p>Unfortunately we had an incident \
with the 2.2.4 jar that locked up all remote client activity.</p><p>I tried my hand \
at analyzing the thread dump, let me know if you think I'm wrong.  I think it \
may be related to JBREM-1242 but too involved for me to figure out.</p><p>Assuming \
that Object@383d87 is connectionValidatorLock and Object@8ecb42 is clientLeaseLock, \
the threads below show that Timer-9954 and Thread-390047 block each other.  \
Which would only be slightly bad, but then Timer-2 blocks and then all the \
WorkerThreads like WorkerThread#1664 is blocked since handleClientFailure is \
synchronized.  There was actually a thread Timer-9953 exactly like Timer-9954 as \
well.</p><p style="min-height: 8pt; height: 8pt; padding: 0px;"> </p><p \
style="min-height: 8pt; height: 8pt; padding: 0px;"> </p><p>Thread: Timer-9954 : \
priority:5, demon:true, threadId:782301, threadState:BLOCKED, \
lockName:java.lang.Object@383d87</p><p>    \
org.jboss.remoting.Client.notifyListeners(Client.java:1781) </p><p>    \
...</p><p style="min-height: 8pt; height: 8pt; padding: 0px;"> </p><p>Thread: \
Thread-390047 : priority:5, demon:true, threadId:778140, threadState:BLOCKED, \
lockName:java.lang.Object@8ecb42</p><p>    \
org.jboss.remoting.MicroRemoteClientInvoker.establishLease(MicroRemoteClientInvoker.java:458)</p><p>    \
...</p><p style="min-height: 8pt; height: 8pt; padding: 0px;"> </p><p>Thread: \
Timer-2 : priority:5, demon:true, threadId:39, threadState:BLOCKED, \
lockName:java.lang.Object@383d87</p><p>    \
org.jboss.remoting.Client.disconnect(Client.java:735)</p><p>    \
org.jboss.remoting.callback.ServerInvokerCallbackHandler.destroy(ServerInvokerCallbackHandler.java:1016)</p><p>    \
org.jboss.remoting.callback.ServerInvokerCallbackHandler.shutdown(ServerInvokerCallbackHandler.java:1028)</p><p>    \
org.jboss.jms.server.endpoint.ServerConnectionEndpoint.closeCallbackClient(ServerConnectionEndpoint.java:474)</p><p>    \
org.jboss.jms.server.connectionmanager.SimpleConnectionManager.cleanupForSessionID(SimpleConnectionManager.java:468)</p><p>    \
org.jboss.jms.server.connectionmanager.SimpleConnectionManager.handleClientFailure(SimpleConnectionManager.java:201)</p><p>    \
org.jboss.jms.server.connectionmanager.SimpleConnectionManager.handleConnectionException(SimpleConnectionManager.java:241)</p><p>    \
...</p><p>    </p><p>Thread: WorkerThread#1664[10.48.16.175:56059] : \
priority:5, demon:false, threadId:786648, threadState:BLOCKED, \
lockName:org.jboss.jms.server.connectionmanager.SimpleConnectionManager@2cf63</p><p>    \
org.jboss.jms.server.connectionmanager.SimpleConnectionManager.handleClientFailure(SimpleConnectionManager.java:201)</p><p>    \
...</p><p style="min-height: 8pt; height: 8pt; padding: \
0px;"> </p><p>Thanks,</p><p>David</p></div>
<div style="background-color: #f4f4f4; padding: 10px; margin-top: 20px;">
<p style="margin: 0;">Reply to this message by <a \
href="http://community.jboss.org/message/602613#602613">going to Community</a></p> \
<p style="margin: 0;">Start a new discussion in JBoss Remoting at <a \
href="http://community.jboss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2050">Community</a></p>
</div></td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</div>
</body>
</html>
_______________________________________________
jboss-user mailing list
jboss-user@lists.jboss.org
https://lists.jboss.org/mailman/listinfo/jboss-user
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic