January 2020 - teiid-issues - Jboss List Archives

[JBoss JIRA] (TEIIDSB-51) Define expectations for runtime metadata

by Ramesh Reddy (Jira)

[ https://issues.redhat.com/browse/TEIIDSB-51?page=com.atlassian.jira.plugi... ] Ramesh Reddy commented on TEIIDSB-51: ------------------------------------- Documentation task, need to document limitations. It is is SB issue > Define expectations for runtime metadata > ---------------------------------------- > > Key: TEIIDSB-51 > URL: https://issues.redhat.com/browse/TEIIDSB-51 > Project: Teiid Spring Boot > Issue Type: Feature Request > Components: documentation > Reporter: Steven Hawkins > Priority: Major > Fix For: 1.3.1 > > > At a high level there are potentially three modes for our ddl: > 1. Interactive - there was some work toward this, but it needed to only be a "developer mode" as it would reload the vdb on each metadata change. There is a lot about the transactionality of DDL updates that our current simplistic metadata model does not support, which makes this hard to fully implement. We haven't talked about this much in relation to Teiid Spring Boot, but ideally there should be a way for developers to test incremental changes without full rebuilds. > 2. Dynamic - the term is a bit dated, but this refers to any vdb that performs import from a metadata repository that has runtime dependencies. By design this allows for a simple vdb definition and options for caching or re-importing on reload. In a container environment metadata caching no longer makes sense unless we use a volume. Depending upon your viewpoint allowing for runtime import of metadata is potentially a point of mutability that is also not needed in a container environment. > 3. Static - much like our old .index designer vdbs there are benefits to having the full metadata already available to the vdb/image. There is a lot of work that we do lazily at runtime that can be moved to an earlier phase - primarily generating the rest and odata layers, but it would also include the pg system table materializations. For Teiid Spring Boot or usage in containers in general what this would look like is a build phase for the vdb such that it could obtain appropriate metadata and initialize as much as possible statically (eventually for quarkus vm snapshotting). The only metadata that would not be fresh potentially would be the costing metadata - however that is problematic as is and will eventually need a progressive optimization strategy employing a persistent store. > As of now we are currently focused just on #2. As we look toward operators, we should start thinking about #3. > #1 would come into play if/when we start looking at local development options using vs code. > We can treat this issue as an epic and a place to centralize discussion. -- This message was sent by Atlassian Jira (v7.13.8#713008)

6 years, 2 months

1
0
0 / 0

[JBoss JIRA] (TEIID-5861) Salesforce translator should support nested joins

by Steven Hawkins (Jira)

[ https://issues.redhat.com/browse/TEIID-5861?page=com.atlassian.jira.plugi... ] Steven Hawkins commented on TEIID-5861: --------------------------------------- The intent is to get to this in the current cycle. However I can't say that is guaranteed. > Salesforce translator should support nested joins > ------------------------------------------------- > > Key: TEIID-5861 > URL: https://issues.redhat.com/browse/TEIID-5861 > Project: Teiid > Issue Type: Enhancement > Components: Salesforce Connector > Reporter: Renat Eskenin > Assignee: Steven Hawkins > Priority: Major > Fix For: 13.1 > > Original Estimate: 2 days > Remaining Estimate: 2 days > > For this SQL we have wrong generated SOQL > {code} > select > price.Id, > price.IsActive__c, > price.name, > price.PriceBook__c, > book.DefaultCurrency__c, > price.Price__c, > price.ProductCode__c, > price.ProductName__c, > price.Product__c, > product.Id, > product.Name, > product.Description > from > MSRP__c as price > left outer join /*+ MAKEDEP */ Product2 as product on > price.Product__c = product.id > left outer join /*+ MAKEDEP */ Pricebook2 as book on > price.PriceBook__c = book.id > where > price.PriceBook__c =:priceBookId > and ProductCode__c in( > :productCodes > ) > and IsActive__c = true" > {code} > {code} > START DATA SRC COMMAND: startTime=2019-12-02 12:43:54.368 requestID=9MPiB/GOwB5f.0 sourceCommandID=3 executionID=2 txID=null modelName=sf translatorName=salesforce sessionID=9MPiB/GOwB5f principal=anonymous sql=SELECT sf.Pricebook2.DefaultCurrency__c FROM sf.Pricebook2 WHERE sf.Pricebook2.Id = 'xxxxx' > [2019-12-02 12:43:54,368 MSK] DEBUG [salesforce-failover-facade,,,] org.teiid.COMMAND_LOG.SOURCE [Worker0_QueryProcessorQueue1]: SOURCE SRC COMMAND: endTime=2019-12-02 12:43:54.368 requestID=9MPiB/GOwB5f.0 sourceCommandID=2 executionID=1 txID=null modelName=sf translatorName=salesforce sessionID=9MPiB/GOwB5f principal=anonymous sourceCommand=[SELECT MSRP__c.Id, MSRP__c.IsActive__c, MSRP__c.Name, MSRP__c.PriceBook__c, MSRP__c.Price__c, MSRP__c.ProductCode__c, MSRP__c.ProductName__c, MSRP__c.Product__c, Product__r.Id, Product__r.Name, Product__r.Description FROM MSRP__c WHERE (MSRP__c.PriceBook__c = 'xxxx') AND ((MSRP__c.ProductCode__c IN(xxxxx)) AND (MSRP__c.IsActive__c = true))] > [2019-12-02 12:43:54,368 MSK] DEBUG [salesforce-failover-facade,,,] org.teiid.CONNECTOR [Worker1_QueryProcessorQueue2]: salesforce.9MPiB/GOwB5f.9MPiB/GOwB5f.0.3: Incoming Query: SELECT Pricebook2.DefaultCurrency__c FROM Pricebook2 WHERE Pricebook2.Id = 'xxxx' > [2019-12-02 12:43:54,368 MSK] DEBUG [salesforce-failover-facade,,,] org.teiid.COMMAND_LOG.SOURCE [Worker1_QueryProcessorQueue2]: SOURCE SRC COMMAND: endTime=2019-12-02 12:43:54.368 requestID=9MPiB/GOwB5f.0 sourceCommandID=3 executionID=2 txID=null modelName=sf translatorName=salesforce sessionID=9MPiB/GOwB5f principal=anonymous sourceCommand=[Using retrieve: Pricebook2.DefaultCurrency__c Pricebook2 [xxxx]] > {code} > But need to generate one. Because we have two relations in MSRP__c -- This message was sent by Atlassian Jira (v7.13.8#713008)

6 years, 2 months

1
0
0 / 0

[JBoss JIRA] (TEIID-5877) OverlappingFileLockException with excel translator

by Steven Hawkins (Jira)

Steven Hawkins created TEIID-5877: ------------------------------------- Summary: OverlappingFileLockException with excel translator Key: TEIID-5877 URL: https://issues.redhat.com/browse/TEIID-5877 Project: Teiid Issue Type: Bug Components: Misc. Connectors Reporter: Steven Hawkins Assignee: Steven Hawkins Fix For: 13.1, 13.0.2 Concurrent access with file locking produces an exception rather than exclusion. This needs to be more gracefully handled. -- This message was sent by Atlassian Jira (v7.13.8#713008)

6 years, 2 months

1
0
0 / 0

[JBoss JIRA] (TEIIDSB-144) Calling setTransactionIsolation on pg driver causes the connection to be closed

by Ramesh Reddy (Jira)

[ https://issues.redhat.com/browse/TEIIDSB-144?page=com.atlassian.jira.plug... ] Ramesh Reddy commented on TEIIDSB-144: -------------------------------------- I vote to do our own that patch, proxy seems much to me. > Calling setTransactionIsolation on pg driver causes the connection to be closed > ------------------------------------------------------------------------------- > > Key: TEIIDSB-144 > URL: https://issues.redhat.com/browse/TEIIDSB-144 > Project: Teiid Spring Boot > Issue Type: Bug > Components: datasource > Reporter: Steven Hawkins > Assignee: Steven Hawkins > Priority: Critical > Fix For: 1.3.1 > > Original Estimate: 4 hours > Time Spent: 2 hours > Remaining Estimate: 2 hours > > An attempt to set the isolation level on pg 42.2.8 resulted in an exception SQLSTATE 0a000 - unsupported - which causes the connection pool to mark the connection as broken: > {code} > 2019-11-25 23:07:50.125 WARN 43993 --- [ProcessorQueue6] com.zaxxer.hikari.pool.ProxyConnection : HikariPool-1 - Connection org.postgresql.jdbc.PgConnection@2ffebc7e marked as broken because of SQLSTATE(0A000), ErrorCode(0) > org.postgresql.util.PSQLException: > at org.postgresql.jdbc.PgConnection.setTransactionIsolation(PgConnection.java:851) ~[postgresql-42.2.8.jar:42.2.8] > at com.zaxxer.hikari.pool.ProxyConnection.setTransactionIsolation(ProxyConnection.java:407) ~[HikariCP-3.2.0.jar:na] > at com.zaxxer.hikari.pool.HikariProxyConnection.setTransactionIsolation(HikariProxyConnection.java) ~[HikariCP-3.2.0.jar:na] > at org.teiid.translator.jdbc.JDBCBaseExecution.<init>(JDBCBaseExecution.java:72) ~[translator-jdbc-12.3.0.jar:12.3.0] > {code} -- This message was sent by Atlassian Jira (v7.13.8#713008)

6 years, 2 months

1
0
0 / 0

[JBoss JIRA] (TEIID-5872) Excel translator should support reading file from Amazon S3

by Steven Hawkins (Jira)

[ https://issues.redhat.com/browse/TEIID-5872?page=com.atlassian.jira.plugi... ] Steven Hawkins commented on TEIID-5872: --------------------------------------- > I believe Excel translator was tightly integrated with File connector It is not. It uses a virtual file abstraction. > Excel translator should support reading file from Amazon S3 > ----------------------------------------------------------- > > Key: TEIID-5872 > URL: https://issues.redhat.com/browse/TEIID-5872 > Project: Teiid > Issue Type: Enhancement > Components: Misc. Connectors > Reporter: Ramesh Reddy > Assignee: Ramesh Reddy > Priority: Major > Fix For: 13.1 > > > Excel translator should support reading data from Amazon S3 -- This message was sent by Atlassian Jira (v7.13.8#713008)

6 years, 2 months

1
0
0 / 0

[JBoss JIRA] (TEIID-5872) Excel translator should support reading file from Amazon S3

by Ramesh Reddy (Jira)

[ https://issues.redhat.com/browse/TEIID-5872?page=com.atlassian.jira.plugi... ] Ramesh Reddy commented on TEIID-5872: ------------------------------------- I believe Excel translator was tightly integrated with File connector, my thinking was to remove that need, then let any abstractions at the File or S3 level connections take over? > Excel translator should support reading file from Amazon S3 > ----------------------------------------------------------- > > Key: TEIID-5872 > URL: https://issues.redhat.com/browse/TEIID-5872 > Project: Teiid > Issue Type: Enhancement > Components: Misc. Connectors > Reporter: Ramesh Reddy > Assignee: Ramesh Reddy > Priority: Major > Fix For: 13.1 > > > Excel translator should support reading data from Amazon S3 -- This message was sent by Atlassian Jira (v7.13.8#713008)

6 years, 2 months

1
0
0 / 0

[JBoss JIRA] (TEIID-5868) Support the NioZipFileSystem class to support based on File.Path based resource

by Steven Hawkins (Jira)

[ https://issues.redhat.com/browse/TEIID-5868?focusedWorklogId=12449801&pag... ] Steven Hawkins logged work on TEIID-5868: ----------------------------------------- Author: Steven Hawkins Created on: 13/Jan/20 11:22 AM Start Date: 13/Jan/20 11:22 AM Worklog Time Spent: 1 hour Issue Time Tracking ------------------- Remaining Estimate: 30 minutes (was: 1 hour, 30 minutes) Time Spent: 1 hour Worklog Id: (was: 12449801) > Support the NioZipFileSystem class to support based on File.Path based resource > ------------------------------------------------------------------------------- > > Key: TEIID-5868 > URL: https://issues.redhat.com/browse/TEIID-5868 > Project: Teiid > Issue Type: Task > Components: Query Engine > Reporter: Ramesh Reddy > Assignee: Steven Hawkins > Priority: Major > Fix For: 13.1 > > Original Estimate: 1 hour, 30 minutes > Time Spent: 1 hour > Remaining Estimate: 30 minutes > > NioZipFileSystem currently only supports URL based resources, it should be extended to support File.Path based sources. -- This message was sent by Atlassian Jira (v7.13.8#713008)

6 years, 2 months

1
0
0 / 0

[JBoss JIRA] (TEIID-5868) Support the NioZipFileSystem class to support based on File.Path based resource

by Steven Hawkins (Jira)

[ https://issues.redhat.com/browse/TEIID-5868?page=com.atlassian.jira.plugi... ] Steven Hawkins updated TEIID-5868: ---------------------------------- Original Estimate: 1 hour, 30 minutes Remaining Estimate: 1 hour, 30 minutes > Support the NioZipFileSystem class to support based on File.Path based resource > ------------------------------------------------------------------------------- > > Key: TEIID-5868 > URL: https://issues.redhat.com/browse/TEIID-5868 > Project: Teiid > Issue Type: Task > Components: Query Engine > Reporter: Ramesh Reddy > Assignee: Steven Hawkins > Priority: Major > Fix For: 13.1 > > Original Estimate: 1 hour, 30 minutes > Remaining Estimate: 1 hour, 30 minutes > > NioZipFileSystem currently only supports URL based resources, it should be extended to support File.Path based sources. -- This message was sent by Atlassian Jira (v7.13.8#713008)

6 years, 2 months

1
0
0 / 0

[JBoss JIRA] (TEIID-5868) Support the NioZipFileSystem class to support based on File.Path based resource

by Steven Hawkins (Jira)

[ https://issues.redhat.com/browse/TEIID-5868?page=com.atlassian.jira.plugi... ] Steven Hawkins resolved TEIID-5868. ----------------------------------- Resolution: Done Adding a method to take the uri directly as that is common between the teiid and spring logic. > Support the NioZipFileSystem class to support based on File.Path based resource > ------------------------------------------------------------------------------- > > Key: TEIID-5868 > URL: https://issues.redhat.com/browse/TEIID-5868 > Project: Teiid > Issue Type: Task > Components: Query Engine > Reporter: Ramesh Reddy > Assignee: Steven Hawkins > Priority: Major > Fix For: 13.1 > > > NioZipFileSystem currently only supports URL based resources, it should be extended to support File.Path based sources. -- This message was sent by Atlassian Jira (v7.13.8#713008)

6 years, 2 months

1
0
0 / 0

[JBoss JIRA] (TEIID-5798) Mixed PERMISSION GRANTS

by Steven Hawkins (Jira)

[ https://issues.redhat.com/browse/TEIID-5798?page=com.atlassian.jira.plugi... ] Work on TEIID-5798 started by Steven Hawkins. --------------------------------------------- > Mixed PERMISSION GRANTS > ----------------------- > > Key: TEIID-5798 > URL: https://issues.redhat.com/browse/TEIID-5798 > Project: Teiid > Issue Type: Enhancement > Components: Query Engine > Reporter: Christoph John > Assignee: Steven Hawkins > Priority: Major > Fix For: 13.1 > > Original Estimate: 6 hours > Time Spent: 4 hours > Remaining Estimate: 1 day, 6 hours > > Hello, > I am currently trying to set a set of permissions on a table/view. Hence a condition on INSERT,UPDATE,DELETE and an unconditioned SELECT. > However, it seems that conditioned and unconditioned GRANT statements do not work together. > {code} > GRANT INSERT,UPDATE,DELETE ON TABLE "my_nutri_diary.UserDefinedProducts_SRC" CONDITION 'UserDefinedProducts_SRC.fkProfile in (SELECT Account.idProfile FROM Account WHERE Account.uuidUser = LEFT(user(), 36) )' TO odata; > GRANT SELECT ON TABLE "my_nutri_diary.UserDefinedProducts_SRC" TO odata; > REVOKE ALTER,EXECUTE ON TABLE "my_nutri_diary.UserDefinedProducts_SRC" FROM odata; > {code} -- This message was sent by Atlassian Jira (v7.13.8#713008)

6 years, 2 months

1
0
0 / 0

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

teiid-issues January 2020