[jboss-user] Recovery from deadlocks on JBoss 5.1.0

Hello, everyone. We recently switched from JBoss 4 to JBoss 5, and consequently started migrating our EJB2.1 beans to EJB3. Now the deployment EAR is a mix of both, and recovery from deadlocks has been found to be broken. What happens is that first we have a regular deadlock, where transaction fails as it should. All is well here (on JBoss and MySQL side, that is). Example of a deadlock: 23.05 10:27:31,008 ERROR [org.jboss.ejb.plugins.cmp.jdbc.keygen.JDBC30GeneratedKeysCreateCommand.TripEvent] (NioProcessor-2:VTD_65/FORM) Could not create entity com.mysql.jdbc.exceptions.jdbc4.MySQLTransactionRollbackException: Deadlock found when trying to get lock; try restarting transaction at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:513) at com.mysql.jdbc.Util.handleNewInstance(Util.java:407) at com.mysql.jdbc.Util.getInstance(Util.java:382) at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1064) at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3603) at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3535) at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1989) at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2150) at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2626) at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2119) at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2415) at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2333) at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2318) at com.mysql.jdbc.jdbc2.optional.PreparedStatementWrapper.executeUpdate(PreparedStatementWrapper.java:875) at org.jboss.resource.adapter.jdbc.WrappedPreparedStatement.executeUpdate(WrappedPreparedStatement.java:365) at org.jboss.ejb.plugins.cmp.jdbc.keygen.JDBC30GeneratedKeysCreateCommand.executeInsert(JDBC30GeneratedKeysCreateCommand.java:87) at org.jboss.ejb.plugins.cmp.jdbc.JDBCAbstractCreateCommand.performInsert(JDBCAbstractCreateCommand.java:322) at org.jboss.ejb.plugins.cmp.jdbc.JDBCAbstractCreateCommand.execute(JDBCAbstractCreateCommand.java:151) at org.jboss.ejb.plugins.cmp.jdbc.JDBCStoreManager.createEntity(JDBCStoreManager.java:587) at org.jboss.ejb.plugins.CMPPersistenceManager.createEntity(CMPPersistenceManager.java:237) at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.createEntity(CachedConnectionInterceptor.java:223) at org.jboss.ejb.EntityContainer.createLocalHome(EntityContainer.java:638) at sun.reflect.GeneratedMethodAccessor400.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.jboss.invocation.Invocation.performCall(Invocation.java:386) at org.jboss.ejb.EntityContainer$ContainerInterceptor.invokeHome(EntityContainer.java:1139) at org.jboss.ejb.plugins.AbstractInterceptor.invokeHome(AbstractInterceptor.java:106) at org.jboss.ejb.plugins.EntitySynchronizationInterceptor.invokeHome(EntitySynchronizationInterceptor.java:203) at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.invokeHome(CachedConnectionInterceptor.java:187) at org.jboss.ejb.plugins.AbstractInterceptor.invokeHome(AbstractInterceptor.java:106) at org.jboss.ejb.plugins.EntityInstanceInterceptor.invokeHome(EntityInstanceInterceptor.java:137) at org.jboss.ejb.plugins.EntityLockInterceptor.invokeHome(EntityLockInterceptor.java:76) at org.jboss.ejb.plugins.EntityCreationInterceptor.invokeHome(EntityCreationInterceptor.java:45) at org.jboss.ejb.plugins.CallValidationInterceptor.invokeHome(CallValidationInterceptor.java:56) at org.jboss.ejb.plugins.AbstractTxInterceptor.invokeNext(AbstractTxInterceptor.java:125) at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxInterceptorCMT.java:350) at org.jboss.ejb.plugins.TxInterceptorCMT.invokeHome(TxInterceptorCMT.java:161) at org.jboss.ejb.plugins.SecurityInterceptor.process(SecurityInterceptor.java:230) at org.jboss.ejb.plugins.SecurityInterceptor.invokeHome(SecurityInterceptor.java:205) at org.jboss.ejb.plugins.security.PreSecurityInterceptor.process(PreSecurityInterceptor.java:99) at org.jboss.ejb.plugins.security.PreSecurityInterceptor.invokeHome(PreSecurityInterceptor.java:88) at org.jboss.ejb.plugins.LogInterceptor.invokeHome(LogInterceptor.java:132) at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invokeHome(ProxyFactoryFinderInterceptor.java:107) at org.jboss.ejb.EntityContainer.internalInvokeHome(EntityContainer.java:527) at org.jboss.ejb.Container.invoke(Container.java:1046) at org.jboss.ejb.plugins.local.BaseLocalProxyFactory.invokeHome(BaseLocalProxyFactory.java:362) at org.jboss.ejb.plugins.local.LocalHomeProxy.invoke(LocalHomeProxy.java:133) at $Proxy637.create(Unknown Source) However, after the deadlock random other transactions start to fail like this: 42521[state=NORMAL mc=org.jboss.resource.adapter.jdbc.xa.XAManagedConnection@7fd1ae77 handles=1 lastUse=1306160850834 permit=true trackByTx=true mcp=org.jboss.resource.connectionmanager.JBossManagedConnectionPool$OnePool@3427 6ff3 context=org.jboss.resource.connectionmanager.InternalManagedConnectionPool@926d545 xaResource=org.jboss.resource.adapter.jdbc.xa.XAManagedConnection@7fd1ae77 txSync=null] com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure The last packet successfully received from the server was 485 milliseconds ago. The last packet sent successfully to the server was 447 milliseconds ago. at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:513) at com.mysql.jdbc.Util.handleNewInstance(Util.java:407) at com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1116) at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:3092) at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:2978) at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3526) at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1989) at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2150) at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2626) at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2119) at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2415) at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2333) at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2318) at com.mysql.jdbc.jdbc2.optional.PreparedStatementWrapper.executeUpdate(PreparedStatementWrapper.java:875) at org.jboss.resource.adapter.jdbc.WrappedPreparedStatement.executeUpdate(WrappedPreparedStatement.java:365) at org.jboss.ejb.plugins.cmp.jdbc.JDBCStoreEntityCommand.execute(JDBCStoreEntityCommand.java:150) at org.jboss.ejb.plugins.cmp.jdbc.JDBCStoreManager.storeEntity(JDBCStoreManager.java:666) at org.jboss.ejb.plugins.CMPPersistenceManager.storeEntity(CMPPersistenceManager.java:428) at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.storeEntity(CachedConnectionInterceptor.java:271) at org.jboss.ejb.EntityContainer.storeEntity(EntityContainer.java:769) at org.jboss.ejb.GlobalTxEntityMap$2.synchronize(GlobalTxEntityMap.java:158) at org.jboss.ejb.GlobalTxEntityMap$GlobalTxSynchronization.synchronize(GlobalTxEntityMap.java:328) at org.jboss.ejb.GlobalTxEntityMap.synchronizeEntities(GlobalTxEntityMap.java:241) at org.jboss.ejb.EntityContainer.synchronizeEntitiesWithinTransaction(EntityContainer.java:138) at org.jboss.ejb.EntityContainer.findLocal(EntityContainer.java:671) at sun.reflect.GeneratedMethodAccessor381.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.jboss.invocation.Invocation.performCall(Invocation.java:386) at org.jboss.ejb.EntityContainer$ContainerInterceptor.invokeHome(EntityContainer.java:1139) at org.jboss.ejb.plugins.AbstractInterceptor.invokeHome(AbstractInterceptor.java:106) at org.jboss.ejb.plugins.EntitySynchronizationInterceptor.invokeHome(EntitySynchronizationInterceptor.java:203) at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.invokeHome(CachedConnectionInterceptor.java:187) at org.jboss.ejb.plugins.AbstractInterceptor.invokeHome(AbstractInterceptor.java:106) at org.jboss.ejb.plugins.EntityInstanceInterceptor.invokeHome(EntityInstanceInterceptor.java:137) at org.jboss.ejb.plugins.EntityLockInterceptor.invokeHome(EntityLockInterceptor.java:76) at org.jboss.ejb.plugins.EntityCreationInterceptor.invokeHome(EntityCreationInterceptor.java:45) at org.jboss.ejb.plugins.CallValidationInterceptor.invokeHome(CallValidationInterceptor.java:56) at org.jboss.ejb.plugins.AbstractTxInterceptor.invokeNext(AbstractTxInterceptor.java:125) at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxInterceptorCMT.java:350) at org.jboss.ejb.plugins.TxInterceptorCMT.invokeHome(TxInterceptorCMT.java:161) at org.jboss.ejb.plugins.SecurityInterceptor.process(SecurityInterceptor.java:230) at org.jboss.ejb.plugins.SecurityInterceptor.invokeHome(SecurityInterceptor.java:205) at org.jboss.ejb.plugins.security.PreSecurityInterceptor.process(PreSecurityInterceptor.java:99) at org.jboss.ejb.plugins.security.PreSecurityInterceptor.invokeHome(PreSecurityInterceptor.java:88) at org.jboss.ejb.plugins.LogInterceptor.invokeHome(LogInterceptor.java:132) at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invokeHome(ProxyFactoryFinderInterceptor.java:107) at org.jboss.ejb.EntityContainer.internalInvokeHome(EntityContainer.java:527) at org.jboss.ejb.Container.invoke(Container.java:1046) at org.jboss.ejb.plugins.local.BaseLocalProxyFactory.invokeHome(BaseLocalProxyFactory.java:362) at org.jboss.ejb.plugins.local.LocalHomeProxy.invoke(LocalHomeProxy.java:133) at $Proxy649.findAlert(Unknown Source) at com.ecolane.mpk.alert.beans.AlertBackendBean.resolveAlerts(AlertBackendBean.java:696) --- Caused by: java.io.EOFException: Can not read response from server. Expected to read 4 bytes, read 0 bytes before connection was unexpectedly lost. at com.mysql.jdbc.MysqlIO.readFully(MysqlIO.java:2539) at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:2989) ... 232 more And: The last packet successfully received from the server was 257 milliseconds ago. The last packet sent successfully to the server was 257 milliseconds ago. 23.05 10:27:31,507 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at com.mysql.jdbc.jdbc2.optional.MysqlXAConnection.mapXAExceptionFromSQLException(MysqlXAConnection.java:605) 23.05 10:27:31,507 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at com.mysql.jdbc.jdbc2.optional.MysqlXAConnection.dispatchCommand(MysqlXAConnection.java:584) 23.05 10:27:31,507 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at com.mysql.jdbc.jdbc2.optional.MysqlXAConnection.start(MysqlXAConnection.java:524) 23.05 10:27:31,507 ERROR [org.jboss.ejb.plugins.cmp.jdbc.JDBCUtil] (NioProcessor-2:VTD_65/FORM) SQL error java.lang.NullPointerException at com.mysql.jdbc.jdbc2.optional.JDBC4MysqlXAConnection.fireStatementEvent(JDBC4MysqlXAConnection.java:94) at com.mysql.jdbc.jdbc2.optional.JDBC4PreparedStatementWrapper.close(JDBC4PreparedStatementWrapper.java:84) at org.jboss.resource.adapter.jdbc.WrappedStatement.internalClose(WrappedStatement.java:881) at org.jboss.resource.adapter.jdbc.WrappedStatement.close(WrappedStatement.java:79) at org.jboss.ejb.plugins.cmp.jdbc.JDBCUtil.safeClose(JDBCUtil.java:107) at org.jboss.ejb.plugins.cmp.jdbc.JDBCStoreEntityCommand.execute(JDBCStoreEntityCommand.java:162) at org.jboss.ejb.plugins.cmp.jdbc.JDBCStoreManager.storeEntity(JDBCStoreManager.java:666) at org.jboss.ejb.plugins.CMPPersistenceManager.storeEntity(CMPPersistenceManager.java:428) at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.storeEntity(CachedConnectionInterceptor.java:271) at org.jboss.ejb.EntityContainer.storeEntity(EntityContainer.java:769) at org.jboss.ejb.GlobalTxEntityMap$2.synchronize(GlobalTxEntityMap.java:158) at org.jboss.ejb.GlobalTxEntityMap$GlobalTxSynchronization.synchronize(GlobalTxEntityMap.java:328) at org.jboss.ejb.GlobalTxEntityMap.synchronizeEntities(GlobalTxEntityMap.java:241) at org.jboss.ejb.EntityContainer.synchronizeEntitiesWithinTransaction(EntityContainer.java:138) at org.jboss.ejb.EntityContainer.findLocal(EntityContainer.java:671) at sun.reflect.GeneratedMethodAccessor381.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.jboss.invocation.Invocation.performCall(Invocation.java:386) at org.jboss.ejb.EntityContainer$ContainerInterceptor.invokeHome(EntityContainer.java:1139) at org.jboss.ejb.plugins.AbstractInterceptor.invokeHome(AbstractInterceptor.java:106) at org.jboss.ejb.plugins.EntitySynchronizationInterceptor.invokeHome(EntitySynchronizationInterceptor.java:203) at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.invokeHome(CachedConnectionInterceptor.java:187) at org.jboss.ejb.plugins.AbstractInterceptor.invokeHome(AbstractInterceptor.java:106) at org.jboss.ejb.plugins.EntityInstanceInterceptor.invokeHome(EntityInstanceInterceptor.java:137) at org.jboss.ejb.plugins.EntityLockInterceptor.invokeHome(EntityLockInterceptor.java:76) at org.jboss.ejb.plugins.EntityCreationInterceptor.invokeHome(EntityCreationInterceptor.java:45) at org.jboss.ejb.plugins.CallValidationInterceptor.invokeHome(CallValidationInterceptor.java:56) at org.jboss.ejb.plugins.AbstractTxInterceptor.invokeNext(AbstractTxInterceptor.java:125) at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxInterceptorCMT.java:350) at org.jboss.ejb.plugins.TxInterceptorCMT.invokeHome(TxInterceptorCMT.java:161) at org.jboss.ejb.plugins.SecurityInterceptor.process(SecurityInterceptor.java:230) at org.jboss.ejb.plugins.SecurityInterceptor.invokeHome(SecurityInterceptor.java:205) at org.jboss.ejb.plugins.security.PreSecurityInterceptor.process(PreSecurityInterceptor.java:99) at org.jboss.ejb.plugins.security.PreSecurityInterceptor.invokeHome(PreSecurityInterceptor.java:88) at org.jboss.ejb.plugins.LogInterceptor.invokeHome(LogInterceptor.java:132) at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invokeHome(ProxyFactoryFinderInterceptor.java:107) at org.jboss.ejb.EntityContainer.internalInvokeHome(EntityContainer.java:527) at org.jboss.ejb.Container.invoke(Container.java:1046) at org.jboss.ejb.plugins.local.BaseLocalProxyFactory.invokeHome(BaseLocalProxyFactory.java:362) at org.jboss.ejb.plugins.local.LocalHomeProxy.invoke(LocalHomeProxy.java:133) at $Proxy649.findAlert(Unknown Source) And: 23.05 10:27:31,507 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.resource.adapter.jdbc.xa.XAManagedConnection.start(XAManagedConnection.java:213) 23.05 10:27:31,509 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.enlistResource(TransactionImple.java:799) 23.05 10:27:31,509 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.enlistResource(TransactionImple.java:510) 23.05 10:27:31,509 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.resource.connectionmanager.TxConnectionManager$TxConnectionEventListener$TransactionSynchronization.enlist(TxConnectionManager.java:908) 23.05 10:27:31,509 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.resource.connectionmanager.TxConnectionManager$TxConnectionEventListener.enlist(TxConnectionManager.java:662) 23.05 10:27:31,509 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.resource.connectionmanager.TxConnectionManager.managedConnectionReconnected(TxConnectionManager.java:403) 23.05 10:27:31,509 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.resource.connectionmanager.BaseConnectionManager2.reconnectManagedConnection(BaseConnectionManager2.java:625) 23.05 10:27:31,509 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.resource.connectionmanager.BaseConnectionManager2.allocateConnection(BaseConnectionManager2.java:499) 23.05 10:27:31,509 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.resource.connectionmanager.BaseConnectionManager2$ConnectionManagerProxy.allocateConnection(BaseConnectionManager2.java:941) 23.05 10:27:31,509 ERROR [org.jboss.ejb.plugins.LogInterceptor] (NioProcessor-2:VTD_65/FORM) TransactionRolledbackLocalException in method: public abstract java.util.Collection com.ecolane.mpk.db.interfaces.AlertLocalHome.findAlert(java.lang.Integer,java.lang.Integer) throws javax.ejb.FinderException, causedBy: org.jboss.util.NestedSQLException: Error at org.jboss.resource.adapter.jdbc.WrappedConnection.checkException(WrappedConnection.java:873) at org.jboss.resource.adapter.jdbc.WrappedStatement.checkException(WrappedStatement.java:852) at org.jboss.resource.adapter.jdbc.WrappedPreparedStatement.executeUpdate(WrappedPreparedStatement.java:369) at org.jboss.ejb.plugins.cmp.jdbc.JDBCStoreEntityCommand.execute(JDBCStoreEntityCommand.java:150) at org.jboss.ejb.plugins.cmp.jdbc.JDBCStoreManager.storeEntity(JDBCStoreManager.java:666) at org.jboss.ejb.plugins.CMPPersistenceManager.storeEntity(CMPPersistenceManager.java:428) at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.storeEntity(CachedConnectionInterceptor.java:271) at org.jboss.ejb.EntityContainer.storeEntity(EntityContainer.java:769) at org.jboss.ejb.GlobalTxEntityMap$2.synchronize(GlobalTxEntityMap.java:158) at org.jboss.ejb.GlobalTxEntityMap$GlobalTxSynchronization.synchronize(GlobalTxEntityMap.java:328) at org.jboss.ejb.GlobalTxEntityMap.synchronizeEntities(GlobalTxEntityMap.java:241) at org.jboss.ejb.EntityContainer.synchronizeEntitiesWithinTransaction(EntityContainer.java:138) at org.jboss.ejb.EntityContainer.findLocal(EntityContainer.java:671) at sun.reflect.GeneratedMethodAccessor381.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.jboss.invocation.Invocation.performCall(Invocation.java:386) at org.jboss.ejb.EntityContainer$ContainerInterceptor.invokeHome(EntityContainer.java:1139) at org.jboss.ejb.plugins.AbstractInterceptor.invokeHome(AbstractInterceptor.java:106) at org.jboss.ejb.plugins.EntitySynchronizationInterceptor.invokeHome(EntitySynchronizationInterceptor.java:203) at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.invokeHome(CachedConnectionInterceptor.java:187) at org.jboss.ejb.plugins.AbstractInterceptor.invokeHome(AbstractInterceptor.java:106) at org.jboss.ejb.plugins.EntityInstanceInterceptor.invokeHome(EntityInstanceInterceptor.java:137) at org.jboss.ejb.plugins.EntityLockInterceptor.invokeHome(EntityLockInterceptor.java:76) at org.jboss.ejb.plugins.EntityCreationInterceptor.invokeHome(EntityCreationInterceptor.java:45) at org.jboss.ejb.plugins.CallValidationInterceptor.invokeHome(CallValidationInterceptor.java:56) at org.jboss.ejb.plugins.AbstractTxInterceptor.invokeNext(AbstractTxInterceptor.java:125) at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxInterceptorCMT.java:350) at org.jboss.ejb.plugins.TxInterceptorCMT.invokeHome(TxInterceptorCMT.java:161) at org.jboss.ejb.plugins.SecurityInterceptor.process(SecurityInterceptor.java:230) at org.jboss.ejb.plugins.SecurityInterceptor.invokeHome(SecurityInterceptor.java:205) at org.jboss.ejb.plugins.security.PreSecurityInterceptor.process(PreSecurityInterceptor.java:99) at org.jboss.ejb.plugins.security.PreSecurityInterceptor.invokeHome(PreSecurityInterceptor.java:88) at org.jboss.ejb.plugins.LogInterceptor.invokeHome(LogInterceptor.java:132) at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invokeHome(ProxyFactoryFinderInterceptor.java:107) at org.jboss.ejb.EntityContainer.internalInvokeHome(EntityContainer.java:527) at org.jboss.ejb.Container.invoke(Container.java:1046) at org.jboss.ejb.plugins.local.BaseLocalProxyFactory.invokeHome(BaseLocalProxyFactory.java:362) at org.jboss.ejb.plugins.local.LocalHomeProxy.invoke(LocalHomeProxy.java:133) at $Proxy649.findAlert(Unknown Source) And: 23.05 10:27:31,509 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.resource.adapter.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:89) 23.05 10:27:31,510 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.ejb.plugins.cmp.jdbc.JDBCLoadEntityCommand.execute(JDBCLoadEntityCommand.java:160) 23.05 10:27:31,510 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.ejb.plugins.cmp.jdbc.JDBCLoadEntityCommand.execute(JDBCLoadEntityCommand.java:88) 23.05 10:27:31,510 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.ejb.plugins.cmp.jdbc.JDBCStoreManager.loadEntity(JDBCStoreManager.java:646) 23.05 10:27:31,510 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.ejb.plugins.cmp.jdbc.JDBCStoreManager.loadEntity(JDBCStoreManager.java:628) 23.05 10:27:31,510 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.ejb.plugins.CMPPersistenceManager.loadEntity(CMPPersistenceManager.java:406) 23.05 10:27:31,510 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.loadEntity(CachedConnectionInterceptor.java:250) 23.05 10:27:31,510 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.ejb.plugins.EntitySynchronizationInterceptor.invoke(EntitySynchronizationInterceptor.java:243) 23.05 10:27:31,510 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.resource.connectionmanager.CachedConnectionInterceptor.invoke(CachedConnectionInterceptor.java:156) 23.05 10:27:31,510 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.ejb.plugins.EntityReentranceInterceptor.invoke(EntityReentranceInterceptor.java:126) 23.05 10:27:31,510 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.ejb.plugins.EntityInstanceInterceptor.invoke(EntityInstanceInterceptor.java:279) 23.05 10:27:31,510 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.ejb.plugins.EntityLockInterceptor.invoke(EntityLockInterceptor.java:104) 23.05 10:27:31,510 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.ejb.plugins.EntityCreationInterceptor.invoke(EntityCreationInterceptor.java:76) 23.05 10:27:31,510 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.ejb.plugins.CallValidationInterceptor.invoke(CallValidationInterceptor.java:63) 23.05 10:27:31,511 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.ejb.plugins.AbstractTxInterceptor.invokeNext(AbstractTxInterceptor.java:121) 23.05 10:27:31,511 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(TxInterceptorCMT.java:350) 23.05 10:27:31,511 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.ejb.plugins.TxInterceptorCMT.invoke(TxInterceptorCMT.java:181) 23.05 10:27:31,511 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.ejb.plugins.SecurityInterceptor.process(SecurityInterceptor.java:228) 23.05 10:27:31,511 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.ejb.plugins.SecurityInterceptor.invoke(SecurityInterceptor.java:211) 23.05 10:27:31,511 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.ejb.plugins.security.PreSecurityInterceptor.process(PreSecurityInterceptor.java:97) 23.05 10:27:31,511 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.ejb.plugins.security.PreSecurityInterceptor.invoke(PreSecurityInterceptor.java:81) 23.05 10:27:31,511 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.ejb.plugins.LogInterceptor.invoke(LogInterceptor.java:205) 23.05 10:27:31,511 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invoke(ProxyFactoryFinderInterceptor.java:138) 23.05 10:27:31,511 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.ejb.EntityContainer.internalInvoke(EntityContainer.java:533) 23.05 10:27:31,511 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.ejb.Container.invoke(Container.java:1029) 23.05 10:27:31,511 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.ejb.plugins.local.BaseLocalProxyFactory.invoke(BaseLocalProxyFactory.java:436) 23.05 10:27:31,511 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at org.jboss.ejb.plugins.local.EntityProxy.invoke(EntityProxy.java:65) 23.05 10:27:31,511 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at $Proxy686.getControllingSystem(Unknown Source) 23.05 10:27:31,511 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at com.ecolane.mpk.routing.data.CandidateRouteFormer.runAvailable(CandidateRouteFormer.java:2756) 23.05 10:27:31,511 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at com.ecolane.mpk.routing.data.CandidateRouteFormer.formCombiningCandidates(CandidateRouteFormer.java:354) 23.05 10:27:31,511 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at com.ecolane.mpk.routing.data.CandidateRouteFormer.access$200(CandidateRouteFormer.java:82) 23.05 10:27:31,511 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at com.ecolane.mpk.routing.data.CandidateRouteFormer$ConcurrentCombiningCandidateFormer.process(CandidateRouteFormer.java:6258) 23.05 10:27:31,511 ERROR [STDERR] (k3-ProcessingThread-crf-1:Tcrf-1 11832 23513) at com.ecolane.mpk.routing.data.ProcessingThread.run(ProcessingThread.java:95) So, after the deadlock DB connections go all bonkers, and the server does not do much else than throw various kinds of exceptions at very high rate. My question is: What can I do to fix the situation? What happened before (with JBoss 5 and all EJB2.1 beans) was that on deadlock the transaction leading to it was rolled back, and the server continued to work normally after it. Now the server is as good as dead after the first deadlock. How do I get into similar situation with JBoss 5 and mixed bag of EJB2.1 and EJB3 beans? -Jari