[jboss-user] [JBossCache] - Re: Cache lockup in JBoss 4.0.4.GA + EJB3 RC9 under heavy lo

[kgrjb]

im using JBossCache 1.4.1.GA with Hibernate 3.2.2.GA and i get a huge number of similar read locks and write locks warns + errors, especially during eviction stage.  Then the cache and therefore application fail completely.

2007-01-30 12:50:33,443 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#46618 timed out. Will retry later.
2007-01-30 12:50:38,447 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#47990 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 643b5e09)
2007-01-30 12:50:38,448 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#47990 timed out. Will retry later.
2007-01-30 12:50:43,452 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#47989 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 759ad447)
2007-01-30 12:50:43,452 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#47989 timed out. Will retry later.
2007-01-30 12:50:48,456 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#47985 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 7e6bda3)
2007-01-30 12:50:48,456 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#47985 timed out. Will retry later.
2007-01-30 12:50:53,679 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#6603 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 14a5ca64)
2007-01-30 12:50:53,680 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#6603 timed out. Will retry later.
2007-01-30 12:50:58,685 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#47957 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 3dac1c62)
2007-01-30 12:50:58,685 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#47957 timed out. Will retry later.
2007-01-30 12:51:03,689 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#47994 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 6f7da7f3)
2007-01-30 12:51:03,689 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#47994 timed out. Will retry later.
2007-01-30 12:51:08,693 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#48005 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 229d7bb4)
2007-01-30 12:51:08,694 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#48005 timed out. Will retry later.
2007-01-30 12:51:13,698 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#47937 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 1124782d)
2007-01-30 12:51:13,698 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#47937 timed out. Will retry later.
2007-01-30 12:51:18,702 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#47921 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 714ddb25)
2007-01-30 12:51:18,702 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#47921 timed out. Will retry later.
2007-01-30 12:51:23,707 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#47998 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 7abcd35b)
2007-01-30 12:51:23,707 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#47998 timed out. Will retry later.
2007-01-30 12:51:28,711 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#46804 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 2e6e9440)
2007-01-30 12:51:28,711 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#46804 timed out. Will retry later.
2007-01-30 12:51:33,715 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#47841 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 6fad6625)
2007-01-30 12:51:33,715 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#47841 timed out. Will retry later.
2007-01-30 12:51:38,720 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#47473 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 216d45f)
2007-01-30 12:51:38,720 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#47473 timed out. Will retry later.
2007-01-30 12:51:43,724 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#6655 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 5dc70d90)
2007-01-30 12:51:43,724 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#6655 timed out. Will retry later.
2007-01-30 12:51:48,728 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#48001 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 33a31a74)
2007-01-30 12:51:48,728 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#48001 timed out. Will retry later.
2007-01-30 12:51:53,733 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#47953 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 191dd028)
2007-01-30 12:51:53,733 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#47953 timed out. Will retry later.
2007-01-30 12:51:58,737 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#47896 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 744cfef9)
2007-01-30 12:51:58,737 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#47896 timed out. Will retry later.
2007-01-30 12:52:03,741 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#6869 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 5ffd6c67)
2007-01-30 12:52:03,742 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#6869 timed out. Will retry later.
2007-01-30 12:52:08,746 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#47760 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 76d80f6c)
2007-01-30 12:52:08,746 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#47760 timed out. Will retry later.
2007-01-30 12:52:13,750 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#47965 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 62dcb868)
2007-01-30 12:52:13,750 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#47965 timed out. Will retry later.
2007-01-30 12:52:18,754 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#6856 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 32bb9ea8)
2007-01-30 12:52:18,755 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#6856 timed out. Will retry later.
2007-01-30 12:52:23,759 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#6868 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 8cee68d)
2007-01-30 12:52:23,759 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#6868 timed out. Will retry later.
2007-01-30 12:52:28,763 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#6723 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 4782377f)
2007-01-30 12:52:28,763 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#6723 timed out. Will retry later.
2007-01-30 12:52:33,767 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#6703 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 36099786)
2007-01-30 12:52:33,768 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#6703 timed out. Will retry later.
2007-01-30 12:52:38,772 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#47905 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 1c7ba502)
2007-01-30 12:52:38,772 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#47905 timed out. Will retry later.
2007-01-30 12:52:43,776 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#45812 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 798e34e9)
2007-01-30 12:52:43,776 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#45812 timed out. Will retry later.
2007-01-30 12:52:48,781 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#6595 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 6733eb57)
2007-01-30 12:52:48,781 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#6595 timed out. Will retry later.
2007-01-30 12:52:53,785 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#6627 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 19fd1b0)
2007-01-30 12:52:53,785 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#6627 timed out. Will retry later.
2007-01-30 12:52:58,789 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#47630 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 18d35c85)
2007-01-30 12:52:58,790 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#47630 timed out. Will retry later.
2007-01-30 12:53:03,794 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#46618 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 64cf8d8)
2007-01-30 12:53:03,794 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#46618 timed out. Will retry later.
2007-01-30 12:53:08,798 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#47990 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 643b5e09)
2007-01-30 12:53:08,798 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#47990 timed out. Will retry later.
2007-01-30 12:53:13,802 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#47989 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 759ad447)
2007-01-30 12:53:13,803 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#47989 timed out. Will retry later.
2007-01-30 12:53:18,807 ERROR [IdentityLock] read lock for zzz/domain/model/Offer/zzz.domain.model.Offer#47985 could not be acquired by Thread[Timer-7,5,jboss] after 0 ms. Locks: Read lock owners: []
Write lock owner: GlobalTransaction:<122.100.2.40:33397>:14383
, lock info: write owner=GlobalTransaction:<122.100.2.40:33397>:14383 (org.jboss.cache.lock.LockStrategyReadCommitted at 7e6bda3)
2007-01-30 12:53:18,807 WARN  [BaseEvictionAlgorithm] eviction of zzz/domain/model/Offer/zzz.domain.model.Offer#47985 timed out. Will retry later.


View the original post : http://www.jboss.com/index.html?module=bb&op=viewtopic&p=4008107#4008107

Reply to the post : http://www.jboss.com/index.html?module=bb&op=posting&mode=reply&p=4008107