April 2015 - teiid-issues - Jboss List Archives

[JBoss JIRA] (TEIID-3404) Teiid DatabaseAppender JPA perisist Command log consume high CPU

by RH Bugzilla Integration (JIRA)

[ https://issues.jboss.org/browse/TEIID-3404?page=com.atlassian.jira.plugin... ] RH Bugzilla Integration commented on TEIID-3404: ------------------------------------------------ Van Halbert <vhalbert(a)redhat.com> changed the Status of [bug 1206143|https://bugzilla.redhat.com/show_bug.cgi?id=1206143] from NEW to MODIFIED > Teiid DatabaseAppender JPA perisist Command log consume high CPU > ---------------------------------------------------------------- > > Key: TEIID-3404 > URL: https://issues.jboss.org/browse/TEIID-3404 > Project: Teiid > Issue Type: Bug > Components: Tools > Affects Versions: 8.7.1 > Environment: * DV 6.1 > * dynamicvdb-datafederation quickstart > Reporter: Kylin Soong > Assignee: Kylin Soong > Fix For: 8.7.2 > > > I have 4 - 5 concurrent client query to Portfolio VDB, this cause log DatabaseAppender JPA perisist Command log thread consume high CPU. In my test, one log threads always swallow high CPU, if the concurrent client query more than 10, it swallow 100% cpu. > [1] have detailed reproduce steps, including thread dumps. > [1] https://github.com/kylinsoong/teiid-samples/tree/master/command-logging-h... -- This message was sent by Atlassian JIRA (v6.3.11#6341)

9 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-3422) Setting more than 513MB for buffer-service-max-storage-object-size, OOME occurs at org.teiid.common.buffer.impl.BufferFrontedFileStoreCache.initialize()

by RH Bugzilla Integration (JIRA)

[ https://issues.jboss.org/browse/TEIID-3422?page=com.atlassian.jira.plugin... ] RH Bugzilla Integration commented on TEIID-3422: ------------------------------------------------ Van Halbert <vhalbert(a)redhat.com> changed the Status of [bug 1210714|https://bugzilla.redhat.com/show_bug.cgi?id=1210714] from NEW to MODIFIED > Setting more than 513MB for buffer-service-max-storage-object-size, OOME occurs at org.teiid.common.buffer.impl.BufferFrontedFileStoreCache.initialize() > -------------------------------------------------------------------------------------------------------------------------------------------------------- > > Key: TEIID-3422 > URL: https://issues.jboss.org/browse/TEIID-3422 > Project: Teiid > Issue Type: Bug > Components: Query Engine > Affects Versions: 8.7 > Environment: JBoss DV 6.0, 6.1 > Reporter: hisao furuichi > Assignee: Steven Hawkins > Fix For: 6.2-8.7.2, 8.11 > > > Setting more than 513MB for buffer-service-max-storage-object-size, OOME occurs at org.teiid.common.buffer.impl.BufferFrontedFileStoreCache.initialize(). > One of our user needs to set more than 512MB for buffer-service-max-storage-object-size to avoid TEIID30001[1], this limitation becomes a critical issue for them. > Additional Information: > By taking look at the source code[2], if the value of maxStorageObjectSize is more than equals with 536870912, the loop becomes infinit, and will cause OOME. > [1] > TEIID30001 Max block number exceeded by 233,144 21,422,155. Increase the maxStorageObjectSize to support larger storage objects. Alternatively you could make the processor batch size smaller. > [2]teiid/engine/src/main/java/org/teiid/common/buffer/impl/BufferFrontedFileStoreCache.java > === > public static final long MAX_ADDRESSABLE_MEMORY = 1l<<(ADDRESS_BITS+LOG_BLOCK_SIZE); > ~~ > static final int BLOCK_SIZE = 1 << LOG_BLOCK_SIZE; > ~~ > public void initialize() throws TeiidComponentException { > ~~ > List<BlockStore> stores = new ArrayList<BlockStore>(); > int size = BLOCK_SIZE; > int files = 32; //this allows us to have 64 terabytes of smaller block sizes > do { > stores.add(new BlockStore(this.storageManager, size, 30, files)); > size <<=1; > if (files > 1) { > files >>= 1; > } > } while ((size>>1) < maxStorageObjectSize); > ~~ > === -- This message was sent by Atlassian JIRA (v6.3.11#6341)

9 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-3425) Pass-through kerberos authentication on IBM JDK - principal is not passed to MSSQL driver

by RH Bugzilla Integration (JIRA)

[ https://issues.jboss.org/browse/TEIID-3425?page=com.atlassian.jira.plugin... ] RH Bugzilla Integration commented on TEIID-3425: ------------------------------------------------ Van Halbert <vhalbert(a)redhat.com> changed the Status of [bug 1211539|https://bugzilla.redhat.com/show_bug.cgi?id=1211539] from NEW to ASSIGNED > Pass-through kerberos authentication on IBM JDK - principal is not passed to MSSQL driver > ----------------------------------------------------------------------------------------- > > Key: TEIID-3425 > URL: https://issues.jboss.org/browse/TEIID-3425 > Project: Teiid > Issue Type: Bug > Affects Versions: 8.7.1 > Environment: OS: Fedora 20 > java: IBM JDK 1.7 > arch: x86_64 > Reporter: Juraj Duráni > Assignee: Ramesh Reddy > Fix For: 8.12 > > Attachments: set-up-mssql-ibm.cli, sql2012krb-static-vdb.xml, sql2012krb-vdb.xml > > > I have configured a datasource for MSSQL database. The datasource uses PassthroughIdentityLoginModule. I have also created a VDB which requires kerberos authentication. I am trying to pass credentials used for authentication CLIENT <=> TEIID to datasource so they can be used for authentication TEIID <=> MSSQL. > Method getConnection(..) (record in server log) is called with correct credentials, but SQLServerDriver throws an exception: > initAuthInit failed privileged exception:-java.security.PrivilegedActionException: org.ietf.jgss.GSSException, major code: 13, minor code: 0 > major string: Invalid credentials > minor string: Cannot get credential from JAAS Subject for principal: default principal > Some ideas, but I am only guessing: > 1. I have seen same exception (on client side) if system property "javax.security.auth.useSubjectCredsOnly" is set to false on client side. As this property is set to true in the server config (<property name="javax.security.auth.useSubjectCredsOnly" value="true"/>), it is probably not passed to the driver (or is being ignored). > 2. SQLServerDriver sets two system properties by default (if no kerberos configuration file is specified) useDefaultCcache = true moduleBanner = false - see https://msdn.microsoft.com/en-us/library/gg558122%28v=sql.110%29.aspx - ibm kerberos login module will try to get TGT from ticket cache > I have tried static kerberos configuration for same DS and there was no problem with it. -- This message was sent by Atlassian JIRA (v6.3.11#6341)

9 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-3438) Null value returned from BlobImpl getBytes

by Kylin Soong (JIRA)

[ https://issues.jboss.org/browse/TEIID-3438?page=com.atlassian.jira.plugin... ] Kylin Soong edited comment on TEIID-3438 at 4/19/15 11:59 PM: -------------------------------------------------------------- Reproduce Procedures ================== * Download zip file and unzip * **mvn clean install exec:java** will execute failed with NPE as description. NOTE: 1. if mvn build download dependency failed, use -s point to teiid's settings.xml(mvn clean install -s <path to teiid setting.xml> exec:java) 2. change pom.xml teiid.version to 8.11.0.Alpha3-SNAPSHOT or later version, mvn command will execute success was (Author: kylin): Reproduce Procedures ================== * Download zip file and unzip * 'mvn clean install exec:java' will execute failed with NPE as description. NOTE: 1. if mvn build download dependency failed, use -s point to teiid's settings.xml(mvn clean install -s <path to teiid setting.xml> exec:java) 2. change pom.xml teiid.version to 8.11.0.Alpha3-SNAPSHOT or later version, mvn command will execute success > Null value returned from BlobImpl getBytes > ------------------------------------------ > > Key: TEIID-3438 > URL: https://issues.jboss.org/browse/TEIID-3438 > Project: Teiid > Issue Type: Bug > Components: Query Engine > Affects Versions: 7.7 > Reporter: Kylin Soong > Assignee: Steven Hawkins > Fix For: 6.2-8.7.2, 8.10.1, 8.11 > > Attachments: TEIID-3438.zip > > > If translator retrieveValue return a empty Blob, the engine will throw NPE as below > Caused by: java.lang.NullPointerException > at javax.sql.rowset.serial.SerialBlob.<init>(SerialBlob.java:100) > at org.teiid.common.buffer.LobManager.persistLob(LobManager.java:226) > at org.teiid.common.buffer.LobManager.updateReferences(LobManager.java:141) > at org.teiid.common.buffer.TupleBuffer.addTupleBatch(TupleBuffer.java:203) > at org.teiid.query.processor.BatchCollector.flushBatchDirect(BatchCollector.java:229) > at org.teiid.dqp.internal.process.RequestWorkItem$1.flushBatchDirect(RequestWorkItem.java:653) -- This message was sent by Atlassian JIRA (v6.3.11#6341)

9 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-3438) Null value returned from BlobImpl getBytes

by Kylin Soong (JIRA)

[ https://issues.jboss.org/browse/TEIID-3438?page=com.atlassian.jira.plugin... ] Kylin Soong edited comment on TEIID-3438 at 4/19/15 11:58 PM: -------------------------------------------------------------- Reproduce Procedures ================== * Download zip file and unzip * 'mvn clean install exec:java' will execute failed with NPE as description. NOTE: 1. if mvn build download dependency failed, use -s point to teiid's settings.xml(mvn clean install -s <path to teiid setting.xml> exec:java) 2. change pom.xml teiid.version to 8.11.0.Alpha3-SNAPSHOT or later version, mvn command will execute success was (Author: kylin): Reproduce Procedures ================== * Download zip file and unzip * 'mvn clean install exec:java' will execute failed with NPE as description. NOTE: 1. if mvn command download failed, use -s point to teiid's settings.xml(mvn clean install -s <path to setting.xml> exec:java) 2. change pom.xml teiid.version to 8.11.0.Alpha3-SNAPSHOT or later version, mvn command will execute success > Null value returned from BlobImpl getBytes > ------------------------------------------ > > Key: TEIID-3438 > URL: https://issues.jboss.org/browse/TEIID-3438 > Project: Teiid > Issue Type: Bug > Components: Query Engine > Affects Versions: 7.7 > Reporter: Kylin Soong > Assignee: Steven Hawkins > Fix For: 6.2-8.7.2, 8.10.1, 8.11 > > Attachments: TEIID-3438.zip > > > If translator retrieveValue return a empty Blob, the engine will throw NPE as below > Caused by: java.lang.NullPointerException > at javax.sql.rowset.serial.SerialBlob.<init>(SerialBlob.java:100) > at org.teiid.common.buffer.LobManager.persistLob(LobManager.java:226) > at org.teiid.common.buffer.LobManager.updateReferences(LobManager.java:141) > at org.teiid.common.buffer.TupleBuffer.addTupleBatch(TupleBuffer.java:203) > at org.teiid.query.processor.BatchCollector.flushBatchDirect(BatchCollector.java:229) > at org.teiid.dqp.internal.process.RequestWorkItem$1.flushBatchDirect(RequestWorkItem.java:653) -- This message was sent by Atlassian JIRA (v6.3.11#6341)

9 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-3438) Null value returned from BlobImpl getBytes

by Kylin Soong (JIRA)

[ https://issues.jboss.org/browse/TEIID-3438?page=com.atlassian.jira.plugin... ] Kylin Soong updated TEIID-3438: ------------------------------- Attachment: TEIID-3438.zip Reproduce Procedures ================== * Download zip file and unzip * 'mvn clean install exec:java' will execute failed with NPE as description. NOTE: 1. if mvn command download failed, use -s point to teiid's settings.xml(mvn clean install -s <path to setting.xml> exec:java) 2. change pom.xml teiid.version to 8.11.0.Alpha3-SNAPSHOT or later version, mvn command will execute success > Null value returned from BlobImpl getBytes > ------------------------------------------ > > Key: TEIID-3438 > URL: https://issues.jboss.org/browse/TEIID-3438 > Project: Teiid > Issue Type: Bug > Components: Query Engine > Affects Versions: 7.7 > Reporter: Kylin Soong > Assignee: Steven Hawkins > Fix For: 6.2-8.7.2, 8.10.1, 8.11 > > Attachments: TEIID-3438.zip > > > If translator retrieveValue return a empty Blob, the engine will throw NPE as below > Caused by: java.lang.NullPointerException > at javax.sql.rowset.serial.SerialBlob.<init>(SerialBlob.java:100) > at org.teiid.common.buffer.LobManager.persistLob(LobManager.java:226) > at org.teiid.common.buffer.LobManager.updateReferences(LobManager.java:141) > at org.teiid.common.buffer.TupleBuffer.addTupleBatch(TupleBuffer.java:203) > at org.teiid.query.processor.BatchCollector.flushBatchDirect(BatchCollector.java:229) > at org.teiid.dqp.internal.process.RequestWorkItem$1.flushBatchDirect(RequestWorkItem.java:653) -- This message was sent by Atlassian JIRA (v6.3.11#6341)

9 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-3434) Ability to enable/disable caching by table and/or source

by Steven Hawkins (JIRA)

[ https://issues.jboss.org/browse/TEIID-3434?page=com.atlassian.jira.plugin... ] Work on TEIID-3434 started by Steven Hawkins. --------------------------------------------- > Ability to enable/disable caching by table and/or source > -------------------------------------------------------- > > Key: TEIID-3434 > URL: https://issues.jboss.org/browse/TEIID-3434 > Project: Teiid > Issue Type: Feature Request > Reporter: Burak Serdar > Assignee: Steven Hawkins > Fix For: 8.11 > > > We need to be able to enable/disable caching by table and/or source. Some of our tables have real-time data, and we do not want to cache those, and some other tables can use cached data. It is not sufficient to use SQL options to turn caching on or off, because we're using 3rd party tools, and we don't have control over the SQL they generate. -- This message was sent by Atlassian JIRA (v6.3.11#6341)

9 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-3434) Ability to enable/disable caching by table and/or source

by Steven Hawkins (JIRA)

[ https://issues.jboss.org/browse/TEIID-3434?page=com.atlassian.jira.plugin... ] Steven Hawkins updated TEIID-3434: ---------------------------------- Fix Version/s: 8.11 > Ability to enable/disable caching by table and/or source > -------------------------------------------------------- > > Key: TEIID-3434 > URL: https://issues.jboss.org/browse/TEIID-3434 > Project: Teiid > Issue Type: Feature Request > Reporter: Burak Serdar > Assignee: Steven Hawkins > Fix For: 8.11 > > > We need to be able to enable/disable caching by table and/or source. Some of our tables have real-time data, and we do not want to cache those, and some other tables can use cached data. It is not sufficient to use SQL options to turn caching on or off, because we're using 3rd party tools, and we don't have control over the SQL they generate. -- This message was sent by Atlassian JIRA (v6.3.11#6341)

9 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-3422) Setting more than 513MB for buffer-service-max-storage-object-size, OOME occurs at org.teiid.common.buffer.impl.BufferFrontedFileStoreCache.initialize()

by RH Bugzilla Integration (JIRA)

[ https://issues.jboss.org/browse/TEIID-3422?page=com.atlassian.jira.plugin... ] RH Bugzilla Integration commented on TEIID-3422: ------------------------------------------------ Van Halbert <vhalbert(a)redhat.com> changed the Status of [bug 1210577|https://bugzilla.redhat.com/show_bug.cgi?id=1210577] from NEW to MODIFIED > Setting more than 513MB for buffer-service-max-storage-object-size, OOME occurs at org.teiid.common.buffer.impl.BufferFrontedFileStoreCache.initialize() > -------------------------------------------------------------------------------------------------------------------------------------------------------- > > Key: TEIID-3422 > URL: https://issues.jboss.org/browse/TEIID-3422 > Project: Teiid > Issue Type: Bug > Components: Query Engine > Affects Versions: 8.7 > Environment: JBoss DV 6.0, 6.1 > Reporter: hisao furuichi > Assignee: Steven Hawkins > Fix For: 6.2-8.7.2, 8.11 > > > Setting more than 513MB for buffer-service-max-storage-object-size, OOME occurs at org.teiid.common.buffer.impl.BufferFrontedFileStoreCache.initialize(). > One of our user needs to set more than 512MB for buffer-service-max-storage-object-size to avoid TEIID30001[1], this limitation becomes a critical issue for them. > Additional Information: > By taking look at the source code[2], if the value of maxStorageObjectSize is more than equals with 536870912, the loop becomes infinit, and will cause OOME. > [1] > TEIID30001 Max block number exceeded by 233,144 21,422,155. Increase the maxStorageObjectSize to support larger storage objects. Alternatively you could make the processor batch size smaller. > [2]teiid/engine/src/main/java/org/teiid/common/buffer/impl/BufferFrontedFileStoreCache.java > === > public static final long MAX_ADDRESSABLE_MEMORY = 1l<<(ADDRESS_BITS+LOG_BLOCK_SIZE); > ~~ > static final int BLOCK_SIZE = 1 << LOG_BLOCK_SIZE; > ~~ > public void initialize() throws TeiidComponentException { > ~~ > List<BlockStore> stores = new ArrayList<BlockStore>(); > int size = BLOCK_SIZE; > int files = 32; //this allows us to have 64 terabytes of smaller block sizes > do { > stores.add(new BlockStore(this.storageManager, size, 30, files)); > size <<=1; > if (files > 1) { > files >>= 1; > } > } while ((size>>1) < maxStorageObjectSize); > ~~ > === -- This message was sent by Atlassian JIRA (v6.3.11#6341)

9 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-3443) wrong estimation of BufferFrontedFileStoreCache.maxMemoryBlocks

by RH Bugzilla Integration (JIRA)

[ https://issues.jboss.org/browse/TEIID-3443?page=com.atlassian.jira.plugin... ] RH Bugzilla Integration commented on TEIID-3443: ------------------------------------------------ Van Halbert <vhalbert(a)redhat.com> changed the Status of [bug 1212731|https://bugzilla.redhat.com/show_bug.cgi?id=1212731] from NEW to MODIFIED > wrong estimation of BufferFrontedFileStoreCache.maxMemoryBlocks > --------------------------------------------------------------- > > Key: TEIID-3443 > URL: https://issues.jboss.org/browse/TEIID-3443 > Project: Teiid > Issue Type: Bug > Components: Query Engine > Affects Versions: 8.4, 8.10 > Environment: JDV 6.0.x, 6.1.0 > Reporter: Hisanobu Okuda > Assignee: Steven Hawkins > Fix For: 6.2-8.7.2, 8.11 > > > BufferFrontedFileStoreCache.maxMemoryBlocks is under-estimated. For example, when max-storage-object-size=8000000, maxMemoryBlocks > is 488 at the line #575 in org.teiid.common.buffer.impl.BufferFrontedFileStoreCache.initialize() (after that, it is decrimented some times, but it does not matter). > {code} > main[1] run > > > Breakpoint hit: "thread=MSC service thread 1-3", org.teiid.common.buffer.impl.BufferFrontedFileStoreCache.initialize(), line=573 bci=163 > 573 maxMemoryBlocks = Math.min(maxMemoryBlocks, maxStorageObjectSize>>LOG_BLOCK_SIZE + ((maxStorageObjectSize&BufferFrontedFileStoreCache.BLOCK_MASK)>0?1:0)); > MSC service thread 1-3[1] next > > > Step completed: "thread=MSC service thread 1-3", org.teiid.common.buffer.impl.BufferFrontedFileStoreCache.initialize(), line=575 bci=198 > 575 cleaningThreshold = Math.min(maxMemoryBlocks<<4, blocks>>1); > MSC service thread 1-3[1] dump this > this = { > ...snip... > maxStorageObjectSize: 8000000 > ...snip... > maxMemoryBlocks: 488 > {code} > An actual cache object size for maxMemoryBlocks: 488 is roughly:- > {code} > 8192 * 488 = 3997696 > {code} > It is less than half of maxStorageObjectSize. It sometimes causes TEIID30001. -- This message was sent by Atlassian JIRA (v6.3.11#6341)

9 years, 8 months

1
0
0 / 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

teiid-issues April 2015