[JBoss JIRA] (TEIIDSB-210) Add more javadocs and make configuration consistent
by Steven Hawkins (Jira)
Steven Hawkins created TEIIDSB-210:
--------------------------------------
Summary: Add more javadocs and make configuration consistent
Key: TEIIDSB-210
URL: https://issues.redhat.com/browse/TEIIDSB-210
Project: Teiid Spring Boot
Issue Type: Bug
Components: datasource
Reporter: Steven Hawkins
Fix For: 1.6.0
Most of the base configuration classes don't have any javadocs. We should add anything that is meaningful and make sure that property names are consistent.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
5 years, 9 months
[JBoss JIRA] (TEIID-5970) infinispan resource adapter fails to load
by Steven Hawkins (Jira)
Steven Hawkins created TEIID-5970:
-------------------------------------
Summary: infinispan resource adapter fails to load
Key: TEIID-5970
URL: https://issues.redhat.com/browse/TEIID-5970
Project: Teiid
Issue Type: Bug
Components: Misc. Connectors
Reporter: Steven Hawkins
Assignee: Steven Hawkins
Fix For: 15.0
A jboss logging dependency is missing from the infinispan resource adapter. I'm not sure when this started, so I'll check against 13/14 as well.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
5 years, 9 months
[JBoss JIRA] (TEIID-5969) The "already removed" exception in case of copyLobs=true translator property for MSSQL
by Steven Hawkins (Jira)
[ https://issues.redhat.com/browse/TEIID-5969?page=com.atlassian.jira.plugi... ]
Work on TEIID-5969 started by Steven Hawkins.
---------------------------------------------
> The "already removed" exception in case of copyLobs=true translator property for MSSQL
> --------------------------------------------------------------------------------------
>
> Key: TEIID-5969
> URL: https://issues.redhat.com/browse/TEIID-5969
> Project: Teiid
> Issue Type: Quality Risk
> Components: Query Engine
> Affects Versions: 13.1
> Reporter: Dmitrii Pogorelov
> Assignee: Steven Hawkins
> Priority: Major
> Fix For: 15.0
>
>
> We're getting the following exception:
> {code:java}
> 2020-06-10 16:01:45,326 WARN [org.teiid.PROCESSOR] (Worker21_QueryProcessorQueue272) 1bxj3NJqJLpO TEIID30020 Processing exception for request 1bxj3NJqJLpO.10 'TEIID30328 Unable to evaluate convert(ms_dwh.v1.expr1, string): TEIID30384 Error while evaluating function convert'. Originally ExpressionEvaluationException 'already removed' FileStore.java:156. Enable more detailed logging to see the entire stacktrace. {code}
> in the case of MSSQL connector and copyLobs=true in its translator property.
> After debugging I discovered that the error occurred actually because of not enough value in
> MAX_LOB_MEMORY_BYTES which is used in LobManager. The variable depends on
> org.teiid.maxStringLength which is set usually to 4000 by default. But if someone put a data with text field type in MSSQL having more than, say, 20000 symbols then the field won't be read by Teiid at all, Teiid will just throw out the exception mentioned above. Will it be possible to improve LobManager so that it can read Text data dynamically increasing needed memory for the process? Otherwise even setting the org.teiid.maxStringLength to 20000 Teiid can raise the exception because of a Text data with length more than 20000 symbols.
>
> Steps to reproduce:
> # create the v1 table in MSSQL:
> {code:java}
> CREATE TABLE [dbo].[v1](CREATE TABLE [dbo].[v1]( [expr1] [text] NULL, [b] [int] NULL) ON [PRIMARY] TEXTIMAGE_ON [PRIMARY] {code}
> 2. insert in the table the following data (I did it via standard MSSQL Server Management Studio):
> {code:java}
> insert into test_dwh.dbo.v1 values (replicate(convert(varchar(max),'a'), 20000), 1) ; {code}
> 3. add MSSQL as a source to Teiid:
> {code:java}
> <datasource jndi-name="java:/mssql-test-dwh" pool-name="mssql-test-dwh" enabled="true" use-java-context="true">
> <connection-url>jdbc:sqlserver://localhost:1433;databaseName=test_dwh</connection-url>
> <driver-class&gt;com.microsoft.sqlserver.jdbc.SQLServerDriver</driver-class&gt;
> <driver>com.microsoft.sqlserver</driver>
> <new-connection-sql>SET ANSI_WARNINGS OFF</new-connection-sql>
> <pool>
> <min-pool-size>2</min-pool-size>
> <max-pool-size>70</max-pool-size>
> </pool>
> <security>
> <user-name>*****</user-name>
> <password>*****</password>
> </security>
> <validation>
> <check-valid-connection-sql>select 1</check-valid-connection-sql>
> </validation>
> <timeout>
> <blocking-timeout-millis>120000</blocking-timeout-millis>
> <idle-timeout-minutes>5</idle-timeout-minutes>
> </timeout>
> </datasource>{code}
> 4. add ms model:
> {code:java}
> <model name="ms_dwh">
> <property name="importer.useFullSchemaName" value="false"/>
> <property name="importer.tableTypes" value="TABLE,VIEW"/>
> <property name="importer.importKeys" value="false"/>
> <property name="importer.schemaPattern" value="dbo"/>
> <source name="dwh_ms" translator-name="mySqlserver" connection-jndi-name="java:/mssql-test-dwh"/>
> </model>{code}
> 5. add mySqlserver translator:
> {code:java}
> <translator name="mySqlserver" type="sqlserver">
> <property name="SupportsNativeQueries" value="true"/>
> <property name="copyLobs" value="true"/>
> </translator> {code}
> 6. try to run the following query:
> {code:java}
> select cast(expr1 as string) from ms_dwh.v1 ;; {code}
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
5 years, 9 months
[JBoss JIRA] (TEIIDSB-206) Create native connector to interact with HDFS as a datasource
by Ramesh Reddy (Jira)
[ https://issues.redhat.com/browse/TEIIDSB-206?page=com.atlassian.jira.plug... ]
Ramesh Reddy updated TEIIDSB-206:
---------------------------------
Sprint: DV Sprint 64, DV Sprint 65 (was: DV Sprint 64)
> Create native connector to interact with HDFS as a datasource
> -------------------------------------------------------------
>
> Key: TEIIDSB-206
> URL: https://issues.redhat.com/browse/TEIIDSB-206
> Project: Teiid Spring Boot
> Issue Type: Feature Request
> Components: datasource
> Reporter: Van Halbert
> Assignee: Aditya Manglam Sharma
> Priority: Major
> Fix For: 1.6.0
>
> Original Estimate: 2 days, 4 hours
> Time Spent: 2 hours, 30 minutes
> Remaining Estimate: 2 days, 1 hour, 30 minutes
>
> Would like to have native connector
> To interact with HDFS as a datasource from a DV perspective there are at least two options:
> 1 - HttpFS
> 2 - WebHDFS
> Both options seems to be in practise very slow. I heard 2x slower.
> It would be nice if we can create a native HDFS connector.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
5 years, 9 months
[JBoss JIRA] (TEIID-5937) Union All followed by except returns wrong results
by Dmitrii Pogorelov (Jira)
[ https://issues.redhat.com/browse/TEIID-5937?page=com.atlassian.jira.plugi... ]
Dmitrii Pogorelov commented on TEIID-5937:
------------------------------------------
[~shawkins] thx a lot again, just merged all changes and it works now.
> I've simplified this
I noticed you removed a big piece of code implemented in the scope of the issue before.
> Union All followed by except returns wrong results
> --------------------------------------------------
>
> Key: TEIID-5937
> URL: https://issues.redhat.com/browse/TEIID-5937
> Project: Teiid
> Issue Type: Bug
> Components: Query Engine
> Affects Versions: 13.1
> Reporter: Dmitrii Pogorelov
> Assignee: Steven Hawkins
> Priority: Blocker
> Fix For: 15.0, 13.1.2, 14.0.1
>
> Original Estimate: 4 hours
> Time Spent: 5 hours, 30 minutes
> Remaining Estimate: 0 minutes
>
> The following queries return wrong results:
> {code:sql}
> -- <null> though should return 1
> select * from views.test2 except select * from views.test1
> UNION ALL
> select * from views.test1 except select * from views.test2 ;;
>
> -- <null> though should return 1
> (select * from views.test2 except select * from views.test1
> UNION ALL
> select * from views.test1) except select * from views.test2 ;;
> {code}
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
5 years, 10 months
[JBoss JIRA] (TEIIDSB-208) Use the same google spreadsheet logic as teiid
by Steven Hawkins (Jira)
[ https://issues.redhat.com/browse/TEIIDSB-208?page=com.atlassian.jira.plug... ]
Steven Hawkins resolved TEIIDSB-208.
------------------------------------
Resolution: Done
based upon an update to the example, it works fine to use map style configuration with the spreadsheets property:
spring.teiid.data.google.sheets.spreadsheets.prefix1=id1
spring.teiid.data.google.sheets.spreadsheets.prefix2=id2
so that will work fine as long as we continue to allow any number of datasource properties or account for structured types.
> Use the same google spreadsheet logic as teiid
> ----------------------------------------------
>
> Key: TEIIDSB-208
> URL: https://issues.redhat.com/browse/TEIIDSB-208
> Project: Teiid Spring Boot
> Issue Type: Quality Risk
> Components: datasource
> Reporter: Steven Hawkins
> Priority: Major
> Fix For: 1.6.0
>
> Original Estimate: 5 hours
> Remaining Estimate: 5 hours
>
> With a refinement to support multiple spreadsheets we should pull this logic forward by sharing the implementation.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
5 years, 10 months
[JBoss JIRA] (TEIIDSB-208) Use the same google spreadsheet logic as teiid
by Steven Hawkins (Jira)
[ https://issues.redhat.com/browse/TEIIDSB-208?focusedWorklogId=12451403&pa... ]
Steven Hawkins logged work on TEIIDSB-208:
------------------------------------------
Author: Steven Hawkins
Created on: 10/Jun/20 10:42 PM
Start Date: 10/Jun/20 10:42 PM
Worklog Time Spent: 1 hour
Issue Time Tracking
-------------------
Remaining Estimate: 4 hours (was: 5 hours)
Time Spent: 1 hour
Worklog Id: (was: 12451403)
> Use the same google spreadsheet logic as teiid
> ----------------------------------------------
>
> Key: TEIIDSB-208
> URL: https://issues.redhat.com/browse/TEIIDSB-208
> Project: Teiid Spring Boot
> Issue Type: Quality Risk
> Components: datasource
> Reporter: Steven Hawkins
> Assignee: Steven Hawkins
> Priority: Major
> Fix For: 1.6.0
>
> Original Estimate: 5 hours
> Time Spent: 1 hour
> Remaining Estimate: 4 hours
>
> With a refinement to support multiple spreadsheets we should pull this logic forward by sharing the implementation.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
5 years, 10 months