[jboss-user] [Clustering/JBoss] - Re: Cache locking issue after one node of the cluster is res

Monday, 10 November 2008

Another locking issue resulting in transaction rollback

  | 2008-11-07 11:03:38,984 INFO  [org.hibernate.event.def.DefaultLoadEventListener] Error
performing load command
  | 
  | org.hibernate.cache.CacheException: org.jboss.cache.lock.TimeoutException read lock
for
/zcapitalspreads_ear,services_jar,capital_spreads/com/chaucerdigital/capitalspreads/user/User/com.chaucerdigital.capitalspreads.user.User#200003
could not be acquired by GlobalTransaction:<10.0.0.24:4021>:17766 after 15000 ms.
Locks: Read lock owners: []
  | Write lock owner: GlobalTransaction:<10.0.0.24:4021>:17762
  | , lock info: write owner=GlobalTransaction:<10.0.0.24:4021>:17762
(activeReaders=0, activeWriter=Thread[http-0.0.0.0-8080-2,5,jboss], waitingReaders=0,
waitingWriters=0, waitingUpgrader=0)
  | 
  | 	at org.jboss.cache.lock.IdentityLock.acquireReadLock0(IdentityLock.java:323)
  | 
  | 	at org.jboss.cache.lock.IdentityLock.acquireReadLock(IdentityLock.java:267)
  | 
  | 	at org.jboss.cache.lock.IdentityLock.acquire(IdentityLock.java:493)
  | 
  | 	at
org.jboss.cache.interceptors.PessimisticLockInterceptor.acquireNodeLock(PessimisticLockInterceptor.java:526)
  | 
  | 	at
org.jboss.cache.interceptors.PessimisticLockInterceptor.lock(PessimisticLockInterceptor.java:420)
  | 
  | 	at
org.jboss.cache.interceptors.PessimisticLockInterceptor.acquireLocksWithTimeout(PessimisticLockInterceptor.java:348)
  | 
  | 	at
org.jboss.cache.interceptors.PessimisticLockInterceptor.handleGetKeyValueMethod(PessimisticLockInterceptor.java:295)
  | 
  | 	at
org.jboss.cache.interceptors.MethodDispacherInterceptor.invoke(MethodDispacherInterceptor.java:87)
  | 
  | 	at
org.jboss.cache.interceptors.PessimisticLockInterceptor.invoke(PessimisticLockInterceptor.java:83)
  | 
  | 	at org.jboss.cache.interceptors.Interceptor.nextInterceptor(Interceptor.java:111)
  | 
  | 	at
org.jboss.cache.interceptors.MethodDispacherInterceptor.invoke(MethodDispacherInterceptor.java:62)
  | 
  | 	at org.jboss.cache.interceptors.Interceptor.nextInterceptor(Interceptor.java:111)
  | 
  | 	at
org.jboss.cache.interceptors.MethodDispacherInterceptor.invoke(MethodDispacherInterceptor.java:62)
  | 
  | 	at org.jboss.cache.interceptors.Interceptor.nextInterceptor(Interceptor.java:111)
  | 
  | 	at
org.jboss.cache.interceptors.TxInterceptor.handleNonTxMethod(TxInterceptor.java:452)
  | 
  | 	at
org.jboss.cache.interceptors.TxInterceptor.handleGetKeyValueMethod(TxInterceptor.java:250)
  | 
  | 	at
org.jboss.cache.interceptors.MethodDispacherInterceptor.invoke(MethodDispacherInterceptor.java:87)
  | 
  | 	at org.jboss.cache.interceptors.Interceptor.nextInterceptor(Interceptor.java:111)
  | 
  | 	at
org.jboss.cache.interceptors.CacheMgmtInterceptor.handleGetKeyValueMethod(CacheMgmtInterceptor.java:81)
  | 
  | 	at
org.jboss.cache.interceptors.MethodDispacherInterceptor.invoke(MethodDispacherInterceptor.java:87)
  | 
  | 	at org.jboss.cache.interceptors.Interceptor.nextInterceptor(Interceptor.java:111)
  | 
  | 	at
org.jboss.cache.interceptors.InvocationContextInterceptor.invoke(InvocationContextInterceptor.java:73)
  | 
  | 	at
org.jboss.cache.invocation.AbstractInvocationDelegate.invoke(AbstractInvocationDelegate.java:123)
  | 
  | 	at
org.jboss.cache.invocation.AbstractInvocationDelegate.invoke(AbstractInvocationDelegate.java:64)
  | 
  | 	at
org.jboss.cache.invocation.CacheInvocationDelegate.get(CacheInvocationDelegate.java:403)
  | 
  | 	at org.jboss.ejb3.entity.JBCCache.read(JBCCache.java:111)
  | 
  | 	at org.hibernate.cache.TransactionalCache.get(TransactionalCache.java:31)
  | 
  | 	at
org.hibernate.event.def.DefaultLoadEventListener.loadFromSecondLevelCache(DefaultLoadEventListener.java:486)
  | 
  | 	at
org.hibernate.event.def.DefaultLoadEventListener.doLoad(DefaultLoadEventListener.java:357)
  | 
  | 	at
org.hibernate.event.def.DefaultLoadEventListener.load(DefaultLoadEventListener.java:139)
  | 
  | 	at
org.hibernate.event.def.DefaultLoadEventListener.proxyOrLoad(DefaultLoadEventListener.java:195)
  | 
  | 	at
org.hibernate.event.def.DefaultLoadEventListener.onLoad(DefaultLoadEventListener.java:103)
  | 
  | 	at org.hibernate.impl.SessionImpl.fireLoad(SessionImpl.java:878)
  | 
  | 	at org.hibernate.impl.SessionImpl.internalLoad(SessionImpl.java:846)
  | 
  | 	at org.hibernate.type.EntityType.resolveIdentifier(EntityType.java:557)
  | 
  | 	at org.hibernate.type.EntityType.resolve(EntityType.java:379)
  | 
  | 	at org.hibernate.engine.TwoPhaseLoad.initializeEntity(TwoPhaseLoad.java:116)
  | 
  | 	at org.hibernate.loader.Loader.initializeEntitiesAndCollections(Loader.java:854)
  | 
  | 	at org.hibernate.loader.Loader.doQuery(Loader.java:729)
  | 
  | 	at
org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:236)
  | 
  | 	at org.hibernate.loader.Loader.doList(Loader.java:2220)
  | 
  | 	at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2104)
  | 
  | 	at org.hibernate.loader.Loader.list(Loader.java:2099)
  | 
  | 	at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:378)
  | 
  | 	at org.hibernate.hql.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:338)
  | 
  | 	at org.hibernate.engine.query.HQLQueryPlan.performList(HQLQueryPlan.java:172)
  | 
  | 	at org.hibernate.impl.SessionImpl.list(SessionImpl.java:1121)
  | 
  | 	at org.hibernate.impl.QueryImpl.list(QueryImpl.java:79)
  | 
  | 	at org.hibernate.ejb.QueryImpl.getSingleResult(QueryImpl.java:81)
  | 
  | 	at
com.chaucerdigital.capitalspreads.security.SecurityManagerBean.loadUserByUsernameUserTypeBrokerCode(SecurityManagerBean.java:70)
  | 
  | 	at sun.reflect.GeneratedMethodAccessor414.invoke(Unknown Source)
  | 
  | 	at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
  | 
  | 	at java.lang.reflect.Method.invoke(Method.java:585)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeTarget(MethodInvocation.java:121)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:110)
  | 
  | 	at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
  | 
  | 	at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at org.jboss.aspects.tx.TxPolicy.invokeInCallerTx(TxPolicy.java:126)
  | 
  | 	at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:197)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:76)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:64)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.aspects.remoting.ReplicantsManagerInterceptor.invoke(ReplicantsManagerInterceptor.java:51)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.security.RunAsSecurityInterceptorv2.invoke(RunAsSecurityInterceptorv2.java:118)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.security.RoleBasedAuthorizationInterceptorv2.invoke(RoleBasedAuthorizationInterceptorv2.java:190)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptorv2.invoke(Ejb3AuthenticationInterceptorv2.java:166)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.stateless.StatelessContainer.localInvoke(StatelessContainer.java:249)
  | 
  | 	at
org.jboss.ejb3.stateless.StatelessContainer.localInvoke(StatelessContainer.java:214)
  | 
  | 	at org.jboss.ejb3.stateless.StatelessLocalProxy.invoke(StatelessLocalProxy.java:86)
  | 
  | 	at $Proxy246.loadUserByUsernameUserTypeBrokerCode(Unknown Source)
  | 
  | 	at
com.chaucerdigital.capitalspreads.webservice.PublicPagesWebService.authenticateUser(PublicPagesWebService.java:227)
  | 
  | 	at sun.reflect.GeneratedMethodAccessor413.invoke(Unknown Source)
  | 
  | 	at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
  | 
  | 	at java.lang.reflect.Method.invoke(Method.java:585)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeTarget(MethodInvocation.java:121)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:110)
  | 
  | 	at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
  | 
  | 	at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
  | 
  | 	at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:193)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:76)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:64)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.aspects.remoting.ReplicantsManagerInterceptor.invoke(ReplicantsManagerInterceptor.java:51)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at org.jboss.ejb3.tx.NullInterceptor.invoke(NullInterceptor.java:42)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptorv2.invoke(Ejb3AuthenticationInterceptorv2.java:166)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.wsf.container.jboss50.invocation.InvocationHandlerEJB3.invoke(InvocationHandlerEJB3.java:104)
  | 
  | 	at
org.jboss.ws.core.server.ServiceEndpointInvoker.invoke(ServiceEndpointInvoker.java:221)
  | 
  | 	at
org.jboss.wsf.stack.jbws.RequestHandlerImpl.processRequest(RequestHandlerImpl.java:466)
  | 
  | 	at
org.jboss.wsf.stack.jbws.RequestHandlerImpl.handleRequest(RequestHandlerImpl.java:284)
  | 
  | 	at org.jboss.wsf.stack.jbws.RequestHandlerImpl.doPost(RequestHandlerImpl.java:201)
  | 
  | 	at
org.jboss.wsf.stack.jbws.RequestHandlerImpl.handleHttpRequest(RequestHandlerImpl.java:134)
  | 
  | 	at org.jboss.wsf.stack.jbws.EndpointServlet.service(EndpointServlet.java:84)
  | 
  | 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:803)
  | 
  | 	at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
  | 
  | 	at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
  | 
  | 	at
org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:96)
  | 
  | 	at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
  | 
  | 	at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
  | 
  | 	at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
  | 
  | 	at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:175)
  | 
  | 	at
org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:189)
  | 
  | 	at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:90)
  | 
  | 	at
org.jboss.web.tomcat.security.SecurityContextEstablishmentValve.invoke(SecurityContextEstablishmentValve.java:96)
  | 
  | 	at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
  | 
  | 	at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
  | 
  | 	at
org.jboss.web.tomcat.service.jca.CachedConnectionValve.invoke(CachedConnectionValve.java:157)
  | 
  | 	at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
  | 
  | 	at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:309)
  | 
  | 	at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:844)
  | 
  | 	at
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:601)
  | 
  | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447)
  | 
  | 	at java.lang.Thread.run(Thread.java:595)
  | 
  | 2008-11-07 11:03:38,984 ERROR [org.jboss.aspects.tx.TxPolicy]
javax.ejb.EJBTransactionRolledbackException: org.hibernate.cache.CacheException:
org.jboss.cache.lock.TimeoutException read lock for
/zcapitalspreads_ear,services_jar,capital_spreads/com/chaucerdigital/capitalspreads/user/User/com.chaucerdigital.capitalspreads.user.User#200003
could not be acquired by GlobalTransaction:<10.0.0.24:4021>:17766 after 15000 ms.
Locks: Read lock owners: []
  | Write lock owner: GlobalTransaction:<10.0.0.24:4021>:17762
  | , lock info: write owner=GlobalTransaction:<10.0.0.24:4021>:17762
(activeReaders=0, activeWriter=Thread[http-0.0.0.0-8080-2,5,jboss], waitingReaders=0,
waitingWriters=0, waitingUpgrader=0)
  | 
  | 2008-11-07 11:03:38,984 ERROR [org.jboss.ws.core.jaxws.SOAPFaultHelperJAXWS] SOAP
request exception
  | 
  | javax.ejb.EJBTransactionRolledbackException: org.hibernate.cache.CacheException:
org.jboss.cache.lock.TimeoutException read lock for
/zcapitalspreads_ear,services_jar,capital_spreads/com/chaucerdigital/capitalspreads/user/User/com.chaucerdigital.capitalspreads.user.User#200003
could not be acquired by GlobalTransaction:<10.0.0.24:4021>:17766 after 15000 ms.
Locks: Read lock owners: []
  | Write lock owner: GlobalTransaction:<10.0.0.24:4021>:17762
  | , lock info: write owner=GlobalTransaction:<10.0.0.24:4021>:17762
(activeReaders=0, activeWriter=Thread[http-0.0.0.0-8080-2,5,jboss], waitingReaders=0,
waitingWriters=0, waitingUpgrader=0)
  | 
  | 	at org.jboss.ejb3.tx.Ejb3TxPolicy.handleInCallerTx(Ejb3TxPolicy.java:91)
  | 
  | 	at org.jboss.aspects.tx.TxPolicy.invokeInCallerTx(TxPolicy.java:130)
  | 
  | 	at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:197)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:76)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:64)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.aspects.remoting.ReplicantsManagerInterceptor.invoke(ReplicantsManagerInterceptor.java:51)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.security.RunAsSecurityInterceptorv2.invoke(RunAsSecurityInterceptorv2.java:118)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.security.RoleBasedAuthorizationInterceptorv2.invoke(RoleBasedAuthorizationInterceptorv2.java:190)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptorv2.invoke(Ejb3AuthenticationInterceptorv2.java:166)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.stateless.StatelessContainer.localInvoke(StatelessContainer.java:249)
  | 
  | 	at
org.jboss.ejb3.stateless.StatelessContainer.localInvoke(StatelessContainer.java:214)
  | 
  | 	at org.jboss.ejb3.stateless.StatelessLocalProxy.invoke(StatelessLocalProxy.java:86)
  | 
  | 	at $Proxy246.loadUserByUsernameUserTypeBrokerCode(Unknown Source)
  | 
  | 	at
com.chaucerdigital.capitalspreads.webservice.PublicPagesWebService.authenticateUser(PublicPagesWebService.java:227)
  | 
  | 	at sun.reflect.GeneratedMethodAccessor413.invoke(Unknown Source)
  | 
  | 	at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
  | 
  | 	at java.lang.reflect.Method.invoke(Method.java:585)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeTarget(MethodInvocation.java:121)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:110)
  | 
  | 	at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
  | 
  | 	at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at org.jboss.aspects.tx.TxPolicy.invokeInOurTx(TxPolicy.java:79)
  | 
  | 	at org.jboss.aspects.tx.TxInterceptor$Required.invoke(TxInterceptor.java:193)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.aspects.tx.TxPropagationInterceptor.invoke(TxPropagationInterceptor.java:76)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.stateless.StatelessInstanceInterceptor.invoke(StatelessInstanceInterceptor.java:64)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.aspects.remoting.ReplicantsManagerInterceptor.invoke(ReplicantsManagerInterceptor.java:51)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at org.jboss.ejb3.tx.NullInterceptor.invoke(NullInterceptor.java:42)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.security.Ejb3AuthenticationInterceptorv2.invoke(Ejb3AuthenticationInterceptorv2.java:166)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.ENCPropagationInterceptor.invoke(ENCPropagationInterceptor.java:46)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.asynchronous.AsynchronousInterceptor.invoke(AsynchronousInterceptor.java:106)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.wsf.container.jboss50.invocation.InvocationHandlerEJB3.invoke(InvocationHandlerEJB3.java:104)
  | 
  | 	at
org.jboss.ws.core.server.ServiceEndpointInvoker.invoke(ServiceEndpointInvoker.java:221)
  | 
  | 	at
org.jboss.wsf.stack.jbws.RequestHandlerImpl.processRequest(RequestHandlerImpl.java:466)
  | 
  | 	at
org.jboss.wsf.stack.jbws.RequestHandlerImpl.handleRequest(RequestHandlerImpl.java:284)
  | 
  | 	at org.jboss.wsf.stack.jbws.RequestHandlerImpl.doPost(RequestHandlerImpl.java:201)
  | 
  | 	at
org.jboss.wsf.stack.jbws.RequestHandlerImpl.handleHttpRequest(RequestHandlerImpl.java:134)
  | 
  | 	at org.jboss.wsf.stack.jbws.EndpointServlet.service(EndpointServlet.java:84)
  | 
  | 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:803)
  | 
  | 	at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
  | 
  | 	at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
  | 
  | 	at
org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:96)
  | 
  | 	at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
  | 
  | 	at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
  | 
  | 	at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
  | 
  | 	at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:175)
  | 
  | 	at
org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:189)
  | 
  | 	at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:90)
  | 
  | 	at
org.jboss.web.tomcat.security.SecurityContextEstablishmentValve.invoke(SecurityContextEstablishmentValve.java:96)
  | 
  | 	at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
  | 
  | 	at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
  | 
  | 	at
org.jboss.web.tomcat.service.jca.CachedConnectionValve.invoke(CachedConnectionValve.java:157)
  | 
  | 	at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
  | 
  | 	at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:309)
  | 
  | 	at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:844)
  | 
  | 	at
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:601)
  | 
  | 	at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447)
  | 
  | 	at java.lang.Thread.run(Thread.java:595)
  | 
  | Caused by: javax.persistence.PersistenceException: org.hibernate.cache.CacheException:
org.jboss.cache.lock.TimeoutException read lock for
/zcapitalspreads_ear,services_jar,capital_spreads/com/chaucerdigital/capitalspreads/user/User/com.chaucerdigital.capitalspreads.user.User#200003
could not be acquired by GlobalTransaction:<10.0.0.24:4021>:17766 after 15000 ms.
Locks: Read lock owners: []
  | Write lock owner: GlobalTransaction:<10.0.0.24:4021>:17762
  | , lock info: write owner=GlobalTransaction:<10.0.0.24:4021>:17762
(activeReaders=0, activeWriter=Thread[http-0.0.0.0-8080-2,5,jboss], waitingReaders=0,
waitingWriters=0, waitingUpgrader=0)
  | 
  | 	at
org.hibernate.ejb.AbstractEntityManagerImpl.throwPersistenceException(AbstractEntityManagerImpl.java:630)
  | 
  | 	at org.hibernate.ejb.QueryImpl.getSingleResult(QueryImpl.java:107)
  | 
  | 	at
com.chaucerdigital.capitalspreads.security.SecurityManagerBean.loadUserByUsernameUserTypeBrokerCode(SecurityManagerBean.java:70)
  | 
  | 	at sun.reflect.GeneratedMethodAccessor414.invoke(Unknown Source)
  | 
  | 	at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
  | 
  | 	at java.lang.reflect.Method.invoke(Method.java:585)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeTarget(MethodInvocation.java:121)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:110)
  | 
  | 	at
org.jboss.ejb3.interceptor.InvocationContextImpl.proceed(InvocationContextImpl.java:166)
  | 
  | 	at
org.jboss.ejb3.interceptor.EJB3InterceptorsInterceptor.invoke(EJB3InterceptorsInterceptor.java:63)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.entity.TransactionScopedEntityManagerInterceptor.invoke(TransactionScopedEntityManagerInterceptor.java:54)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at
org.jboss.ejb3.AllowedOperationsInterceptor.invoke(AllowedOperationsInterceptor.java:47)
  | 
  | 	at org.jboss.aop.joinpoint.MethodInvocation.invokeNext(MethodInvocation.java:101)
  | 
  | 	at org.jboss.aspects.tx.TxPolicy.invokeInCallerTx(TxPolicy.java:126)
  | 
  | 	... 79 more
  | 
  | Caused by: org.hibernate.cache.CacheException: org.jboss.cache.lock.TimeoutException
read lock for
/zcapitalspreads_ear,services_jar,capital_spreads/com/chaucerdigital/capitalspreads/user/User/com.chaucerdigital.capitalspreads.user.User#200003
could not be acquired by GlobalTransaction:<10.0.0.24:4021>:17766 after 15000 ms.
Locks: Read lock owners: []
  | Write lock owner: GlobalTransaction:<10.0.0.24:4021>:17762
  | , lock info: write owner=GlobalTransaction:<10.0.0.24:4021>:17762
(activeReaders=0, activeWriter=Thread[http-0.0.0.0-8080-2,5,jboss], waitingReaders=0,
waitingWriters=0, waitingUpgrader=0)
  | 
  | 	at org.jboss.cache.lock.IdentityLock.acquireReadLock0(IdentityLock.java:323)
  | 
  | 	at org.jboss.cache.lock.IdentityLock.acquireReadLock(IdentityLock.java:267)
  | 
  | 	at org.jboss.cache.lock.IdentityLock.acquire(IdentityLock.java:493)
  | 
  | 	at
org.jboss.cache.interceptors.PessimisticLockInterceptor.acquireNodeLock(PessimisticLockInterceptor.java:526)
  | 
  | 	at
org.jboss.cache.interceptors.PessimisticLockInterceptor.lock(PessimisticLockInterceptor.java:420)
  | 
  | 	at
org.jboss.cache.interceptors.PessimisticLockInterceptor.acquireLocksWithTimeout(PessimisticLockInterceptor.java:348)
  | 
  | 	at
org.jboss.cache.interceptors.PessimisticLockInterceptor.handleGetKeyValueMethod(PessimisticLockInterceptor.java:295)
  | 
  | 	at
org.jboss.cache.interceptors.MethodDispacherInterceptor.invoke(MethodDispacherInterceptor.java:87)
  | 
  | 	at
org.jboss.cache.interceptors.PessimisticLockInterceptor.invoke(PessimisticLockInterceptor.java:83)
  | 
  | 	at org.jboss.cache.interceptors.Interceptor.nextInterceptor(Interceptor.java:111)
  | 
  | 	at
org.jboss.cache.interceptors.MethodDispacherInterceptor.invoke(MethodDispacherInterceptor.java:62)
  | 
  | 	at org.jboss.cache.interceptors.Interceptor.nextInterceptor(Interceptor.java:111)
  | 
  | 	at
org.jboss.cache.interceptors.MethodDispacherInterceptor.invoke(MethodDispacherInterceptor.java:62)
  | 
  | 	at org.jboss.cache.interceptors.Interceptor.nextInterceptor(Interceptor.java:111)
  | 
  | 	at
org.jboss.cache.interceptors.TxInterceptor.handleNonTxMethod(TxInterceptor.java:452)
  | 
  | 	at
org.jboss.cache.interceptors.TxInterceptor.handleGetKeyValueMethod(TxInterceptor.java:250)
  | 
  | 	at
org.jboss.cache.interceptors.MethodDispacherInterceptor.invoke(MethodDispacherInterceptor.java:87)
  | 
  | 	at org.jboss.cache.interceptors.Interceptor.nextInterceptor(Interceptor.java:111)
  | 
  | 	at
org.jboss.cache.interceptors.CacheMgmtInterceptor.handleGetKeyValueMethod(CacheMgmtInterceptor.java:81)
  | 
  | 	at
org.jboss.cache.interceptors.MethodDispacherInterceptor.invoke(MethodDispacherInterceptor.java:87)
  | 
  | 	at org.jboss.cache.interceptors.Interceptor.nextInterceptor(Interceptor.java:111)
  | 
  | 	at
org.jboss.cache.interceptors.InvocationContextInterceptor.invoke(InvocationContextInterceptor.java:73)
  | 
  | 	at
org.jboss.cache.invocation.AbstractInvocationDelegate.invoke(AbstractInvocationDelegate.java:123)
  | 
  | 	at
org.jboss.cache.invocation.AbstractInvocationDelegate.invoke(AbstractInvocationDelegate.java:64)
  | 
  | 	at
org.jboss.cache.invocation.CacheInvocationDelegate.get(CacheInvocationDelegate.java:403)
  | 
  | 	at org.jboss.ejb3.entity.JBCCache.read(JBCCache.java:111)
  | 
  | 	at org.hibernate.cache.TransactionalCache.get(TransactionalCache.java:31)
  | 
  | 	at
org.hibernate.event.def.DefaultLoadEventListener.loadFromSecondLevelCache(DefaultLoadEventListener.java:486)
  | 
  | 	at
org.hibernate.event.def.DefaultLoadEventListener.doLoad(DefaultLoadEventListener.java:357)
  | 
  | 	at
org.hibernate.event.def.DefaultLoadEventListener.load(DefaultLoadEventListener.java:139)
  | 
  | 	at
org.hibernate.event.def.DefaultLoadEventListener.proxyOrLoad(DefaultLoadEventListener.java:195)
  | 
  | 	at
org.hibernate.event.def.DefaultLoadEventListener.onLoad(DefaultLoadEventListener.java:103)
  | 
  | 	at org.hibernate.impl.SessionImpl.fireLoad(SessionImpl.java:878)
  | 
  | 	at org.hibernate.impl.SessionImpl.internalLoad(SessionImpl.java:846)
  | 
  | 	at org.hibernate.type.EntityType.resolveIdentifier(EntityType.java:557)
  | 
  | 	at org.hibernate.type.EntityType.resolve(EntityType.java:379)
  | 
  | 	at org.hibernate.engine.TwoPhaseLoad.initializeEntity(TwoPhaseLoad.java:116)
  | 
  | 	at org.hibernate.loader.Loader.initializeEntitiesAndCollections(Loader.java:854)
  | 
  | 	at org.hibernate.loader.Loader.doQuery(Loader.java:729)
  | 
  | 	at
org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:236)
  | 
  | 	at org.hibernate.loader.Loader.doList(Loader.java:2220)
  | 
  | 	at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2104)
  | 
  | 	at org.hibernate.loader.Loader.list(Loader.java:2099)
  | 
  | 	at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:378)
  | 
  | 	at org.hibernate.hql.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:338)
  | 
  | 	at org.hibernate.engine.query.HQLQueryPlan.performList(HQLQueryPlan.java:172)
  | 
  | 	at org.hibernate.impl.SessionImpl.list(SessionImpl.java:1121)
  | 
  | 	at org.hibernate.impl.QueryImpl.list(QueryImpl.java:79)
  | 
  | 	at org.hibernate.ejb.QueryImpl.getSingleResult(QueryImpl.java:81)
  | 
  | 	... 93 more
  | 
  | 2008-11-07 11:03:39,531 WARN  [org.hibernate.engine.loading.LoadContexts] fail-safe
cleanup (collections) :
org.hibernate.engine.loading.CollectionLoadContext@176df19&lt;rs=net.sourceforge.jtds.jdbc.JtdsResultSet(a)15f9832&gt;
  | 
  | 

View the original post :
http://www.jboss.com/index.html?module=bb&op=viewtopic&p=4188133#...

Reply to the post :
http://www.jboss.com/index.html?module=bb&op=posting&mode=reply&a...

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

[jboss-user] [Clustering/JBoss] - Re: Cache locking issue after one node of the cluster is res