[JBoss JIRA] (TEIID-3079) Security domain associated with data source is not getting deleted while deleting the data source, post server restart.
by Ramesh Reddy (JIRA)
[ https://issues.jboss.org/browse/TEIID-3079?page=com.atlassian.jira.plugin... ]
Ramesh Reddy resolved TEIID-3079.
---------------------------------
Labels: Beta1 (was: Alpha2)
Resolution: Done
Removed the security-domain service dependency completely from transport. Now session service based on the secuirity-domain's name, it will look up the service dynamically and authenticate. If the service not found the authentication will end up in failure.
> Security domain associated with data source is not getting deleted while deleting the data source,post server restart.
> -----------------------------------------------------------------------------------------------------------------------
>
> Key: TEIID-3079
> URL: https://issues.jboss.org/browse/TEIID-3079
> Project: Teiid
> Issue Type: Bug
> Security Level: Public(Everyone can see)
> Affects Versions: 8.7
> Reporter: Haifen Bi
> Assignee: Ramesh Reddy
> Labels: Beta1
> Fix For: 8.7.1, 8.9
>
>
> We are migrating from Teiid 8.4 final to teiid 8.7 final.
> We have custom security domain for our data sources.
> We use JBoss DMR api to delete the datasource and the security domain while deleting a data source.
> With Teiid 8.4 this was working fine and both the datasource and the custom security domain used to get deleted , but with teiid 8.7 it gives following exception:
>
> {"JBAS014653: Composite operation failed and was rolled back. Steps that failed:" => {"Operation step-2" => "JBAS014762: Removing services has lead to unsatisfied dependencies: Service jboss.security.security-domain.edmsqlSecurityDomain was depended upon by service jboss.teiid.transport.embedded, service jboss.teiid.transport.jdbc, service jboss.teiid.transport.odbc"}}
--
This message was sent by Atlassian JIRA
(v6.3.1#6329)
9 years, 9 months
[JBoss JIRA] (TEIID-3106) BufferManager Cleaner consuming 90% of total CPU time
by Devesh Mishra (JIRA)
[ https://issues.jboss.org/browse/TEIID-3106?page=com.atlassian.jira.plugin... ]
Devesh Mishra commented on TEIID-3106:
--------------------------------------
Sure Steven, I will do that. just got another high CPU and the queue had 750 items only.
> BufferManager Cleaner consuming 90% of total CPU time
> -----------------------------------------------------
>
> Key: TEIID-3106
> URL: https://issues.jboss.org/browse/TEIID-3106
> Project: Teiid
> Issue Type: Bug
> Security Level: Public(Everyone can see)
> Components: Query Engine
> Affects Versions: 8.7
> Environment: zOS
> Reporter: Devesh Mishra
> Assignee: Steven Hawkins
> Labels: teiid-engine
> Attachments: BufferManagerImpl.java, CacheKey_Loog.patch, cpu monitoring.docx, in_local.docx, non_high_cpu.docx
>
>
> BufferManager Cleaner thread is consuming almost all of the CPU utilized by the jboss process. Thread dump shows following information.
> 3XMTHREADINFO "BufferManager Cleaner" J9VMThread:0x0000004C41CFEB00, j9thread_t:0x0000004C52B85AE0, java/lang/Thread:0x000000481C036E20, state:CW, prio=5
> 3XMJAVALTHREAD (java/lang/Thread getId:0x76, isDaemon:true)
> 3XMTHREADINFO1 (native thread ID:0x3AEC2600, native priority:0x5, native policy:UNKNOWN)
> 3XMHEAPALLOC Heap bytes allocated since last GC cycle=2609184 (0x27D020)
> 3XMTHREADINFO3 Java callstack:
> 4XESTACKTRACE at java/util/concurrent/ConcurrentSkipListMap.doRemove(ConcurrentSkipListMap.java:1070(Compiled Code))
> 4XESTACKTRACE at java/util/concurrent/ConcurrentSkipListMap.remove(ConcurrentSkipListMap.java:1659(Compiled Code))
> 4XESTACKTRACE at org/teiid/common/buffer/impl/LrfuEvictionQueue.remove(LrfuEvictionQueue.java:60(Compiled Code))
> 4XESTACKTRACE at org/teiid/common/buffer/impl/BufferManagerImpl.doEvictions(BufferManagerImpl.java:854(Compiled Code))
> 5XESTACKTRACE (entered lock: org/teiid/common/buffer/CacheEntry@0x00000048393C2598, entry count: 1)
> 4XESTACKTRACE at org/teiid/common/buffer/impl/BufferManagerImpl$Cleaner.run(BufferManagerImpl.java:108)
> 4XESTACKTRACE at java/util/TimerThread.mainLoop(Timer.java:555)
> 4XESTACKTRACE at java/util/TimerThread.run(Timer.java:505)
> When we added log statements around the BufferManagerImpl.doEvictions() it loops through the remove and firstEntry loop.
> Forum discussion link : https://community.jboss.org/message/901792
--
This message was sent by Atlassian JIRA
(v6.3.1#6329)
9 years, 9 months
[JBoss JIRA] (TEIID-3106) BufferManager Cleaner consuming 90% of total CPU time
by Steven Hawkins (JIRA)
[ https://issues.jboss.org/browse/TEIID-3106?page=com.atlassian.jira.plugin... ]
Steven Hawkins commented on TEIID-3106:
---------------------------------------
Devesh,
To expand upon your post, since the queue is relatively small if we could dump the state of the queue at that point we should be able to determine why there is an inconsistency.
> BufferManager Cleaner consuming 90% of total CPU time
> -----------------------------------------------------
>
> Key: TEIID-3106
> URL: https://issues.jboss.org/browse/TEIID-3106
> Project: Teiid
> Issue Type: Bug
> Security Level: Public(Everyone can see)
> Components: Query Engine
> Affects Versions: 8.7
> Environment: zOS
> Reporter: Devesh Mishra
> Assignee: Steven Hawkins
> Labels: teiid-engine
> Attachments: BufferManagerImpl.java, CacheKey_Loog.patch, cpu monitoring.docx, in_local.docx, non_high_cpu.docx
>
>
> BufferManager Cleaner thread is consuming almost all of the CPU utilized by the jboss process. Thread dump shows following information.
> 3XMTHREADINFO "BufferManager Cleaner" J9VMThread:0x0000004C41CFEB00, j9thread_t:0x0000004C52B85AE0, java/lang/Thread:0x000000481C036E20, state:CW, prio=5
> 3XMJAVALTHREAD (java/lang/Thread getId:0x76, isDaemon:true)
> 3XMTHREADINFO1 (native thread ID:0x3AEC2600, native priority:0x5, native policy:UNKNOWN)
> 3XMHEAPALLOC Heap bytes allocated since last GC cycle=2609184 (0x27D020)
> 3XMTHREADINFO3 Java callstack:
> 4XESTACKTRACE at java/util/concurrent/ConcurrentSkipListMap.doRemove(ConcurrentSkipListMap.java:1070(Compiled Code))
> 4XESTACKTRACE at java/util/concurrent/ConcurrentSkipListMap.remove(ConcurrentSkipListMap.java:1659(Compiled Code))
> 4XESTACKTRACE at org/teiid/common/buffer/impl/LrfuEvictionQueue.remove(LrfuEvictionQueue.java:60(Compiled Code))
> 4XESTACKTRACE at org/teiid/common/buffer/impl/BufferManagerImpl.doEvictions(BufferManagerImpl.java:854(Compiled Code))
> 5XESTACKTRACE (entered lock: org/teiid/common/buffer/CacheEntry@0x00000048393C2598, entry count: 1)
> 4XESTACKTRACE at org/teiid/common/buffer/impl/BufferManagerImpl$Cleaner.run(BufferManagerImpl.java:108)
> 4XESTACKTRACE at java/util/TimerThread.mainLoop(Timer.java:555)
> 4XESTACKTRACE at java/util/TimerThread.run(Timer.java:505)
> When we added log statements around the BufferManagerImpl.doEvictions() it loops through the remove and firstEntry loop.
> Forum discussion link : https://community.jboss.org/message/901792
--
This message was sent by Atlassian JIRA
(v6.3.1#6329)
9 years, 9 months
[JBoss JIRA] (TEIID-3106) BufferManager Cleaner consuming 90% of total CPU time
by Steven Hawkins (JIRA)
[ https://issues.jboss.org/browse/TEIID-3106?page=com.atlassian.jira.plugin... ]
Steven Hawkins commented on TEIID-3106:
---------------------------------------
> The failure of my theory is that I can't find where ConcurrentSkipListMap uses equals() when comparing keys.
It shouldn't, unless there is something different about the implementation in your vm. As it stands hashcode/equals are consistent, which is a requirement. compareTo however isn't required to be consistent with equals, only that when !a.equals(b) && a.compareTo(b) == 0 will there likely be issues. In this case we can have a.equals(b) && a.compareTo(b) != 0
I'd have to double check, but we should just directly use the id when holding the cache entries in maps otherwise, so you should be able to locally just change the implementation of equals if you want to test that out.
> BufferManager Cleaner consuming 90% of total CPU time
> -----------------------------------------------------
>
> Key: TEIID-3106
> URL: https://issues.jboss.org/browse/TEIID-3106
> Project: Teiid
> Issue Type: Bug
> Security Level: Public(Everyone can see)
> Components: Query Engine
> Affects Versions: 8.7
> Environment: zOS
> Reporter: Devesh Mishra
> Assignee: Steven Hawkins
> Labels: teiid-engine
> Attachments: BufferManagerImpl.java, CacheKey_Loog.patch, cpu monitoring.docx, in_local.docx, non_high_cpu.docx
>
>
> BufferManager Cleaner thread is consuming almost all of the CPU utilized by the jboss process. Thread dump shows following information.
> 3XMTHREADINFO "BufferManager Cleaner" J9VMThread:0x0000004C41CFEB00, j9thread_t:0x0000004C52B85AE0, java/lang/Thread:0x000000481C036E20, state:CW, prio=5
> 3XMJAVALTHREAD (java/lang/Thread getId:0x76, isDaemon:true)
> 3XMTHREADINFO1 (native thread ID:0x3AEC2600, native priority:0x5, native policy:UNKNOWN)
> 3XMHEAPALLOC Heap bytes allocated since last GC cycle=2609184 (0x27D020)
> 3XMTHREADINFO3 Java callstack:
> 4XESTACKTRACE at java/util/concurrent/ConcurrentSkipListMap.doRemove(ConcurrentSkipListMap.java:1070(Compiled Code))
> 4XESTACKTRACE at java/util/concurrent/ConcurrentSkipListMap.remove(ConcurrentSkipListMap.java:1659(Compiled Code))
> 4XESTACKTRACE at org/teiid/common/buffer/impl/LrfuEvictionQueue.remove(LrfuEvictionQueue.java:60(Compiled Code))
> 4XESTACKTRACE at org/teiid/common/buffer/impl/BufferManagerImpl.doEvictions(BufferManagerImpl.java:854(Compiled Code))
> 5XESTACKTRACE (entered lock: org/teiid/common/buffer/CacheEntry@0x00000048393C2598, entry count: 1)
> 4XESTACKTRACE at org/teiid/common/buffer/impl/BufferManagerImpl$Cleaner.run(BufferManagerImpl.java:108)
> 4XESTACKTRACE at java/util/TimerThread.mainLoop(Timer.java:555)
> 4XESTACKTRACE at java/util/TimerThread.run(Timer.java:505)
> When we added log statements around the BufferManagerImpl.doEvictions() it loops through the remove and firstEntry loop.
> Forum discussion link : https://community.jboss.org/message/901792
--
This message was sent by Atlassian JIRA
(v6.3.1#6329)
9 years, 9 months
[JBoss JIRA] (TEIID-3106) BufferManager Cleaner consuming 90% of total CPU time
by Devesh Mishra (JIRA)
[ https://issues.jboss.org/browse/TEIID-3106?page=com.atlassian.jira.plugin... ]
Devesh Mishra edited comment on TEIID-3106 at 9/3/14 10:55 AM:
---------------------------------------------------------------
This is the log statement. This proves that the remove is not working.code at the end.
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
LogManager.logInfo(LogConstants.CTX_BUFFER_MGR, " preparing to evict first entry, maxtofree. Queue size " + queue.getSize());
CacheEntry ce = queue.firstEntry(checkActiveBatch);
if (ce == null) {
break;
}
synchronized (ce) {
if (!memoryEntries.containsKey(ce.getId())) {
if (!checkActiveBatch) {
boolean removed1 = queue.remove(ce);
LogManager.logInfo(LogConstants.CTX_BUFFER_MGR, "removed from queue=" + ce.getId() + " + removed= + " + removed1 + " size " + queue.getSize());
}
continue; //not currently a valid eviction
}
was (Author: deveshmishra):
This is the log statement.
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
> BufferManager Cleaner consuming 90% of total CPU time
> -----------------------------------------------------
>
> Key: TEIID-3106
> URL: https://issues.jboss.org/browse/TEIID-3106
> Project: Teiid
> Issue Type: Bug
> Security Level: Public(Everyone can see)
> Components: Query Engine
> Affects Versions: 8.7
> Environment: zOS
> Reporter: Devesh Mishra
> Assignee: Steven Hawkins
> Labels: teiid-engine
> Attachments: BufferManagerImpl.java, CacheKey_Loog.patch, cpu monitoring.docx, in_local.docx, non_high_cpu.docx
>
>
> BufferManager Cleaner thread is consuming almost all of the CPU utilized by the jboss process. Thread dump shows following information.
> 3XMTHREADINFO "BufferManager Cleaner" J9VMThread:0x0000004C41CFEB00, j9thread_t:0x0000004C52B85AE0, java/lang/Thread:0x000000481C036E20, state:CW, prio=5
> 3XMJAVALTHREAD (java/lang/Thread getId:0x76, isDaemon:true)
> 3XMTHREADINFO1 (native thread ID:0x3AEC2600, native priority:0x5, native policy:UNKNOWN)
> 3XMHEAPALLOC Heap bytes allocated since last GC cycle=2609184 (0x27D020)
> 3XMTHREADINFO3 Java callstack:
> 4XESTACKTRACE at java/util/concurrent/ConcurrentSkipListMap.doRemove(ConcurrentSkipListMap.java:1070(Compiled Code))
> 4XESTACKTRACE at java/util/concurrent/ConcurrentSkipListMap.remove(ConcurrentSkipListMap.java:1659(Compiled Code))
> 4XESTACKTRACE at org/teiid/common/buffer/impl/LrfuEvictionQueue.remove(LrfuEvictionQueue.java:60(Compiled Code))
> 4XESTACKTRACE at org/teiid/common/buffer/impl/BufferManagerImpl.doEvictions(BufferManagerImpl.java:854(Compiled Code))
> 5XESTACKTRACE (entered lock: org/teiid/common/buffer/CacheEntry@0x00000048393C2598, entry count: 1)
> 4XESTACKTRACE at org/teiid/common/buffer/impl/BufferManagerImpl$Cleaner.run(BufferManagerImpl.java:108)
> 4XESTACKTRACE at java/util/TimerThread.mainLoop(Timer.java:555)
> 4XESTACKTRACE at java/util/TimerThread.run(Timer.java:505)
> When we added log statements around the BufferManagerImpl.doEvictions() it loops through the remove and firstEntry loop.
> Forum discussion link : https://community.jboss.org/message/901792
--
This message was sent by Atlassian JIRA
(v6.3.1#6329)
9 years, 9 months
[JBoss JIRA] (TEIID-3106) BufferManager Cleaner consuming 90% of total CPU time
by Devesh Mishra (JIRA)
[ https://issues.jboss.org/browse/TEIID-3106?page=com.atlassian.jira.plugin... ]
Devesh Mishra commented on TEIID-3106:
--------------------------------------
This is the log statement.
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
(BufferManager Cleaner) preparing to evict first entry, maxtofree. Queue size 761
(BufferManager Cleaner) removed from queue=75004 + removed= + false size 761
> BufferManager Cleaner consuming 90% of total CPU time
> -----------------------------------------------------
>
> Key: TEIID-3106
> URL: https://issues.jboss.org/browse/TEIID-3106
> Project: Teiid
> Issue Type: Bug
> Security Level: Public(Everyone can see)
> Components: Query Engine
> Affects Versions: 8.7
> Environment: zOS
> Reporter: Devesh Mishra
> Assignee: Steven Hawkins
> Labels: teiid-engine
> Attachments: BufferManagerImpl.java, CacheKey_Loog.patch, cpu monitoring.docx, in_local.docx, non_high_cpu.docx
>
>
> BufferManager Cleaner thread is consuming almost all of the CPU utilized by the jboss process. Thread dump shows following information.
> 3XMTHREADINFO "BufferManager Cleaner" J9VMThread:0x0000004C41CFEB00, j9thread_t:0x0000004C52B85AE0, java/lang/Thread:0x000000481C036E20, state:CW, prio=5
> 3XMJAVALTHREAD (java/lang/Thread getId:0x76, isDaemon:true)
> 3XMTHREADINFO1 (native thread ID:0x3AEC2600, native priority:0x5, native policy:UNKNOWN)
> 3XMHEAPALLOC Heap bytes allocated since last GC cycle=2609184 (0x27D020)
> 3XMTHREADINFO3 Java callstack:
> 4XESTACKTRACE at java/util/concurrent/ConcurrentSkipListMap.doRemove(ConcurrentSkipListMap.java:1070(Compiled Code))
> 4XESTACKTRACE at java/util/concurrent/ConcurrentSkipListMap.remove(ConcurrentSkipListMap.java:1659(Compiled Code))
> 4XESTACKTRACE at org/teiid/common/buffer/impl/LrfuEvictionQueue.remove(LrfuEvictionQueue.java:60(Compiled Code))
> 4XESTACKTRACE at org/teiid/common/buffer/impl/BufferManagerImpl.doEvictions(BufferManagerImpl.java:854(Compiled Code))
> 5XESTACKTRACE (entered lock: org/teiid/common/buffer/CacheEntry@0x00000048393C2598, entry count: 1)
> 4XESTACKTRACE at org/teiid/common/buffer/impl/BufferManagerImpl$Cleaner.run(BufferManagerImpl.java:108)
> 4XESTACKTRACE at java/util/TimerThread.mainLoop(Timer.java:555)
> 4XESTACKTRACE at java/util/TimerThread.run(Timer.java:505)
> When we added log statements around the BufferManagerImpl.doEvictions() it loops through the remove and firstEntry loop.
> Forum discussion link : https://community.jboss.org/message/901792
--
This message was sent by Atlassian JIRA
(v6.3.1#6329)
9 years, 9 months
[JBoss JIRA] (TEIID-3079) Security domain associated with data source is not getting deleted while deleting the data source, post server restart.
by Ramesh Reddy (JIRA)
[ https://issues.jboss.org/browse/TEIID-3079?page=com.atlassian.jira.plugin... ]
Ramesh Reddy reopened TEIID-3079:
---------------------------------
See the follow on issue https://developer.jboss.org/thread/248493
> Security domain associated with data source is not getting deleted while deleting the data source,post server restart.
> -----------------------------------------------------------------------------------------------------------------------
>
> Key: TEIID-3079
> URL: https://issues.jboss.org/browse/TEIID-3079
> Project: Teiid
> Issue Type: Bug
> Security Level: Public(Everyone can see)
> Affects Versions: 8.7
> Reporter: Haifen Bi
> Assignee: Ramesh Reddy
> Labels: Alpha2
> Fix For: 8.7.1, 8.9
>
>
> We are migrating from Teiid 8.4 final to teiid 8.7 final.
> We have custom security domain for our data sources.
> We use JBoss DMR api to delete the datasource and the security domain while deleting a data source.
> With Teiid 8.4 this was working fine and both the datasource and the custom security domain used to get deleted , but with teiid 8.7 it gives following exception:
>
> {"JBAS014653: Composite operation failed and was rolled back. Steps that failed:" => {"Operation step-2" => "JBAS014762: Removing services has lead to unsatisfied dependencies: Service jboss.security.security-domain.edmsqlSecurityDomain was depended upon by service jboss.teiid.transport.embedded, service jboss.teiid.transport.jdbc, service jboss.teiid.transport.odbc"}}
--
This message was sent by Atlassian JIRA
(v6.3.1#6329)
9 years, 9 months
[JBoss JIRA] (TEIID-3106) BufferManager Cleaner consuming 90% of total CPU time
by Devesh Mishra (JIRA)
[ https://issues.jboss.org/browse/TEIID-3106?page=com.atlassian.jira.plugin... ]
Devesh Mishra commented on TEIID-3106:
--------------------------------------
>What jvm are you on? we are on java 7. so that should not be a problem I guess
> BufferManager Cleaner consuming 90% of total CPU time
> -----------------------------------------------------
>
> Key: TEIID-3106
> URL: https://issues.jboss.org/browse/TEIID-3106
> Project: Teiid
> Issue Type: Bug
> Security Level: Public(Everyone can see)
> Components: Query Engine
> Affects Versions: 8.7
> Environment: zOS
> Reporter: Devesh Mishra
> Assignee: Steven Hawkins
> Labels: teiid-engine
> Attachments: BufferManagerImpl.java, CacheKey_Loog.patch, cpu monitoring.docx, in_local.docx, non_high_cpu.docx
>
>
> BufferManager Cleaner thread is consuming almost all of the CPU utilized by the jboss process. Thread dump shows following information.
> 3XMTHREADINFO "BufferManager Cleaner" J9VMThread:0x0000004C41CFEB00, j9thread_t:0x0000004C52B85AE0, java/lang/Thread:0x000000481C036E20, state:CW, prio=5
> 3XMJAVALTHREAD (java/lang/Thread getId:0x76, isDaemon:true)
> 3XMTHREADINFO1 (native thread ID:0x3AEC2600, native priority:0x5, native policy:UNKNOWN)
> 3XMHEAPALLOC Heap bytes allocated since last GC cycle=2609184 (0x27D020)
> 3XMTHREADINFO3 Java callstack:
> 4XESTACKTRACE at java/util/concurrent/ConcurrentSkipListMap.doRemove(ConcurrentSkipListMap.java:1070(Compiled Code))
> 4XESTACKTRACE at java/util/concurrent/ConcurrentSkipListMap.remove(ConcurrentSkipListMap.java:1659(Compiled Code))
> 4XESTACKTRACE at org/teiid/common/buffer/impl/LrfuEvictionQueue.remove(LrfuEvictionQueue.java:60(Compiled Code))
> 4XESTACKTRACE at org/teiid/common/buffer/impl/BufferManagerImpl.doEvictions(BufferManagerImpl.java:854(Compiled Code))
> 5XESTACKTRACE (entered lock: org/teiid/common/buffer/CacheEntry@0x00000048393C2598, entry count: 1)
> 4XESTACKTRACE at org/teiid/common/buffer/impl/BufferManagerImpl$Cleaner.run(BufferManagerImpl.java:108)
> 4XESTACKTRACE at java/util/TimerThread.mainLoop(Timer.java:555)
> 4XESTACKTRACE at java/util/TimerThread.run(Timer.java:505)
> When we added log statements around the BufferManagerImpl.doEvictions() it loops through the remove and firstEntry loop.
> Forum discussion link : https://community.jboss.org/message/901792
--
This message was sent by Atlassian JIRA
(v6.3.1#6329)
9 years, 9 months
[JBoss JIRA] (TEIID-3106) BufferManager Cleaner consuming 90% of total CPU time
by Mark Addleman (JIRA)
[ https://issues.jboss.org/browse/TEIID-3106?page=com.atlassian.jira.plugin... ]
Mark Addleman commented on TEIID-3106:
--------------------------------------
To answer your JVM question: We're running the z/OS Java 7. I'm checking to see there are any outstanding bug fixes available but my understanding is the bugs in the ConcurrentSkipList stuff have been resolved since around 1.6
> BufferManager Cleaner consuming 90% of total CPU time
> -----------------------------------------------------
>
> Key: TEIID-3106
> URL: https://issues.jboss.org/browse/TEIID-3106
> Project: Teiid
> Issue Type: Bug
> Security Level: Public(Everyone can see)
> Components: Query Engine
> Affects Versions: 8.7
> Environment: zOS
> Reporter: Devesh Mishra
> Assignee: Steven Hawkins
> Labels: teiid-engine
> Attachments: BufferManagerImpl.java, CacheKey_Loog.patch, cpu monitoring.docx, in_local.docx, non_high_cpu.docx
>
>
> BufferManager Cleaner thread is consuming almost all of the CPU utilized by the jboss process. Thread dump shows following information.
> 3XMTHREADINFO "BufferManager Cleaner" J9VMThread:0x0000004C41CFEB00, j9thread_t:0x0000004C52B85AE0, java/lang/Thread:0x000000481C036E20, state:CW, prio=5
> 3XMJAVALTHREAD (java/lang/Thread getId:0x76, isDaemon:true)
> 3XMTHREADINFO1 (native thread ID:0x3AEC2600, native priority:0x5, native policy:UNKNOWN)
> 3XMHEAPALLOC Heap bytes allocated since last GC cycle=2609184 (0x27D020)
> 3XMTHREADINFO3 Java callstack:
> 4XESTACKTRACE at java/util/concurrent/ConcurrentSkipListMap.doRemove(ConcurrentSkipListMap.java:1070(Compiled Code))
> 4XESTACKTRACE at java/util/concurrent/ConcurrentSkipListMap.remove(ConcurrentSkipListMap.java:1659(Compiled Code))
> 4XESTACKTRACE at org/teiid/common/buffer/impl/LrfuEvictionQueue.remove(LrfuEvictionQueue.java:60(Compiled Code))
> 4XESTACKTRACE at org/teiid/common/buffer/impl/BufferManagerImpl.doEvictions(BufferManagerImpl.java:854(Compiled Code))
> 5XESTACKTRACE (entered lock: org/teiid/common/buffer/CacheEntry@0x00000048393C2598, entry count: 1)
> 4XESTACKTRACE at org/teiid/common/buffer/impl/BufferManagerImpl$Cleaner.run(BufferManagerImpl.java:108)
> 4XESTACKTRACE at java/util/TimerThread.mainLoop(Timer.java:555)
> 4XESTACKTRACE at java/util/TimerThread.run(Timer.java:505)
> When we added log statements around the BufferManagerImpl.doEvictions() it loops through the remove and firstEntry loop.
> Forum discussion link : https://community.jboss.org/message/901792
--
This message was sent by Atlassian JIRA
(v6.3.1#6329)
9 years, 9 months
[JBoss JIRA] (TEIID-3106) BufferManager Cleaner consuming 90% of total CPU time
by Mark Addleman (JIRA)
[ https://issues.jboss.org/browse/TEIID-3106?page=com.atlassian.jira.plugin... ]
Mark Addleman commented on TEIID-3106:
--------------------------------------
I'll take a wild stab at the problem: I don't believe that the compareTo() definition is consistent with equals(). It appears that under some conditions equals() can return true where compareTo() does not return 0. I can't create a complete story out of this yet, but I believe this inconsistency ends up driving ConcurrentSkipListMap.doRemove() mad as it tries to find the key to remove. The failure of my theory is that I can't find where ConcurrentSkipListMap uses equals() when comparing keys.
I'm only mentioning it now because it seems to fit the profiling results that Devesh provided and on the off chance it gives you some insight into what's going on.
> BufferManager Cleaner consuming 90% of total CPU time
> -----------------------------------------------------
>
> Key: TEIID-3106
> URL: https://issues.jboss.org/browse/TEIID-3106
> Project: Teiid
> Issue Type: Bug
> Security Level: Public(Everyone can see)
> Components: Query Engine
> Affects Versions: 8.7
> Environment: zOS
> Reporter: Devesh Mishra
> Assignee: Steven Hawkins
> Labels: teiid-engine
> Attachments: BufferManagerImpl.java, CacheKey_Loog.patch, cpu monitoring.docx, in_local.docx, non_high_cpu.docx
>
>
> BufferManager Cleaner thread is consuming almost all of the CPU utilized by the jboss process. Thread dump shows following information.
> 3XMTHREADINFO "BufferManager Cleaner" J9VMThread:0x0000004C41CFEB00, j9thread_t:0x0000004C52B85AE0, java/lang/Thread:0x000000481C036E20, state:CW, prio=5
> 3XMJAVALTHREAD (java/lang/Thread getId:0x76, isDaemon:true)
> 3XMTHREADINFO1 (native thread ID:0x3AEC2600, native priority:0x5, native policy:UNKNOWN)
> 3XMHEAPALLOC Heap bytes allocated since last GC cycle=2609184 (0x27D020)
> 3XMTHREADINFO3 Java callstack:
> 4XESTACKTRACE at java/util/concurrent/ConcurrentSkipListMap.doRemove(ConcurrentSkipListMap.java:1070(Compiled Code))
> 4XESTACKTRACE at java/util/concurrent/ConcurrentSkipListMap.remove(ConcurrentSkipListMap.java:1659(Compiled Code))
> 4XESTACKTRACE at org/teiid/common/buffer/impl/LrfuEvictionQueue.remove(LrfuEvictionQueue.java:60(Compiled Code))
> 4XESTACKTRACE at org/teiid/common/buffer/impl/BufferManagerImpl.doEvictions(BufferManagerImpl.java:854(Compiled Code))
> 5XESTACKTRACE (entered lock: org/teiid/common/buffer/CacheEntry@0x00000048393C2598, entry count: 1)
> 4XESTACKTRACE at org/teiid/common/buffer/impl/BufferManagerImpl$Cleaner.run(BufferManagerImpl.java:108)
> 4XESTACKTRACE at java/util/TimerThread.mainLoop(Timer.java:555)
> 4XESTACKTRACE at java/util/TimerThread.run(Timer.java:505)
> When we added log statements around the BufferManagerImpl.doEvictions() it loops through the remove and firstEntry loop.
> Forum discussion link : https://community.jboss.org/message/901792
--
This message was sent by Atlassian JIRA
(v6.3.1#6329)
9 years, 9 months