[JBoss JIRA] (TEIID-5950) Create an athena translator
by Steven Hawkins (Jira)
[ https://issues.redhat.com/browse/TEIID-5950?page=com.atlassian.jira.plugi... ]
Work on TEIID-5950 started by Steven Hawkins.
---------------------------------------------
> Create an athena translator
> ---------------------------
>
> Key: TEIID-5950
> URL: https://issues.redhat.com/browse/TEIID-5950
> Project: Teiid
> Issue Type: Enhancement
> Components: JDBC Connector
> Reporter: Steven Hawkins
> Assignee: Steven Hawkins
> Priority: Major
> Fix For: 15.0
>
> Original Estimate: 4 hours
> Remaining Estimate: 4 hours
>
> There have been several issues seen with athena using the jdbc ansi translator - subquery support and bind variables specifically. There should be a specific translator so that we can account for those better.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
4 years, 6 months
[JBoss JIRA] (TEIIDSB-206) Create native connector to interact with HDFS as a datasource
by Steven Hawkins (Jira)
[ https://issues.redhat.com/browse/TEIIDSB-206?focusedWorklogId=12451577&pa... ]
Steven Hawkins logged work on TEIIDSB-206:
------------------------------------------
Author: Steven Hawkins
Created on: 24/Jun/20 11:52 AM
Start Date: 24/Jun/20 11:52 AM
Worklog Time Spent: 1 hour, 30 minutes
Work Description: Brought the teiid changes over and logged additional issues.
Issue Time Tracking
-------------------
Remaining Estimate: 1 day, 7 hours (was: 2 days, 30 minutes)
Time Spent: 5 hours (was: 3 hours, 30 minutes)
Worklog Id: (was: 12451577)
> Create native connector to interact with HDFS as a datasource
> -------------------------------------------------------------
>
> Key: TEIIDSB-206
> URL: https://issues.redhat.com/browse/TEIIDSB-206
> Project: Teiid Spring Boot
> Issue Type: Feature Request
> Components: datasource
> Reporter: Van Halbert
> Assignee: Aditya Manglam Sharma
> Priority: Major
> Fix For: 1.6.0
>
> Original Estimate: 2 days, 4 hours
> Time Spent: 5 hours
> Remaining Estimate: 1 day, 7 hours
>
> Would like to have native connector
> To interact with HDFS as a datasource from a DV perspective there are at least two options:
> 1 - HttpFS
> 2 - WebHDFS
> Both options seems to be in practise very slow. I heard 2x slower.
> It would be nice if we can create a native HDFS connector.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
4 years, 6 months
[JBoss JIRA] (TEIIDSB-206) Create native connector to interact with HDFS as a datasource
by Steven Hawkins (Jira)
[ https://issues.redhat.com/browse/TEIIDSB-206?page=com.atlassian.jira.plug... ]
Steven Hawkins commented on TEIIDSB-206:
----------------------------------------
The remaining tasks here are to add the hdfs mustache file, an hdfs sample, and a crd. [~adityamanglam] will handle the first two.
> Create native connector to interact with HDFS as a datasource
> -------------------------------------------------------------
>
> Key: TEIIDSB-206
> URL: https://issues.redhat.com/browse/TEIIDSB-206
> Project: Teiid Spring Boot
> Issue Type: Feature Request
> Components: datasource
> Reporter: Van Halbert
> Assignee: Aditya Manglam Sharma
> Priority: Major
> Fix For: 1.6.0
>
> Original Estimate: 2 days, 4 hours
> Time Spent: 3 hours, 30 minutes
> Remaining Estimate: 2 days, 30 minutes
>
> Would like to have native connector
> To interact with HDFS as a datasource from a DV perspective there are at least two options:
> 1 - HttpFS
> 2 - WebHDFS
> Both options seems to be in practise very slow. I heard 2x slower.
> It would be nice if we can create a native HDFS connector.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
4 years, 6 months
[JBoss JIRA] (TEIIDSB-206) Create native connector to interact with HDFS as a datasource
by Steven Hawkins (Jira)
[ https://issues.redhat.com/browse/TEIIDSB-206?page=com.atlassian.jira.plug... ]
Steven Hawkins commented on TEIIDSB-206:
----------------------------------------
> This can be well covered in the Operator as in Operator we have
Since this problem really only affects the operator path, it should be fine to resolve it using datasources rather than requiring a ddl change. We can of course ensure that create server type matches with what is specified in datasources, or just reserve it for future use like we did for fdw handler.
I'll put in an issue for that and one to correct the existing ftp and hdfs translator names.
> Create native connector to interact with HDFS as a datasource
> -------------------------------------------------------------
>
> Key: TEIIDSB-206
> URL: https://issues.redhat.com/browse/TEIIDSB-206
> Project: Teiid Spring Boot
> Issue Type: Feature Request
> Components: datasource
> Reporter: Van Halbert
> Assignee: Aditya Manglam Sharma
> Priority: Major
> Fix For: 1.6.0
>
> Original Estimate: 2 days, 4 hours
> Time Spent: 3 hours, 30 minutes
> Remaining Estimate: 2 days, 30 minutes
>
> Would like to have native connector
> To interact with HDFS as a datasource from a DV perspective there are at least two options:
> 1 - HttpFS
> 2 - WebHDFS
> Both options seems to be in practise very slow. I heard 2x slower.
> It would be nice if we can create a native HDFS connector.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
4 years, 6 months
[JBoss JIRA] (TEIIDSB-209) NPE using salesforce connection
by Steven Hawkins (Jira)
[ https://issues.redhat.com/browse/TEIIDSB-209?page=com.atlassian.jira.plug... ]
Steven Hawkins resolved TEIIDSB-209.
------------------------------------
Resolution: Done
Properly fixed this upstream with additional changes to better encapsulate the state creation. For the product branch the one line fix was added.
> NPE using salesforce connection
> -------------------------------
>
> Key: TEIIDSB-209
> URL: https://issues.redhat.com/browse/TEIIDSB-209
> Project: Teiid Spring Boot
> Issue Type: Bug
> Components: datasource
> Reporter: Steven Hawkins
> Assignee: Steven Hawkins
> Priority: Major
> Fix For: 1.6.0
>
> Original Estimate: 30 minutes
> Time Spent: 30 minutes
> Remaining Estimate: 0 minutes
>
> The config is not being set appropriately and results in an npe. This is due to TEIIDSB-184
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
4 years, 6 months
[JBoss JIRA] (TEIIDSB-209) NPE using salesforce connection
by Steven Hawkins (Jira)
[ https://issues.redhat.com/browse/TEIIDSB-209?focusedWorklogId=12451570&pa... ]
Steven Hawkins logged work on TEIIDSB-209:
------------------------------------------
Author: Steven Hawkins
Created on: 23/Jun/20 1:49 PM
Start Date: 23/Jun/20 1:49 PM
Worklog Time Spent: 1 hour
Issue Time Tracking
-------------------
Time Spent: 1 hour, 30 minutes (was: 30 minutes)
Worklog Id: (was: 12451570)
> NPE using salesforce connection
> -------------------------------
>
> Key: TEIIDSB-209
> URL: https://issues.redhat.com/browse/TEIIDSB-209
> Project: Teiid Spring Boot
> Issue Type: Bug
> Components: datasource
> Reporter: Steven Hawkins
> Assignee: Steven Hawkins
> Priority: Major
> Fix For: 1.6.0
>
> Original Estimate: 30 minutes
> Time Spent: 1 hour, 30 minutes
> Remaining Estimate: 0 minutes
>
> The config is not being set appropriately and results in an npe. This is due to TEIIDSB-184
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
4 years, 6 months
[JBoss JIRA] (TEIIDSB-206) Create native connector to interact with HDFS as a datasource
by Ramesh Reddy (Jira)
[ https://issues.redhat.com/browse/TEIIDSB-206?page=com.atlassian.jira.plug... ]
Ramesh Reddy commented on TEIIDSB-206:
--------------------------------------
I propose we use "Option 1", which is already mostly supported in our DDL already and seems the cleanest version of it. This can be well covered in the Operator as in Operator we have
{code:java}
datasources:
- name: foo
type: hdfs{code}
There need to be some tweaks we need to make on the Spring Boot side to figure out the translator from the alias name which could involve vdb introspection.
> Create native connector to interact with HDFS as a datasource
> -------------------------------------------------------------
>
> Key: TEIIDSB-206
> URL: https://issues.redhat.com/browse/TEIIDSB-206
> Project: Teiid Spring Boot
> Issue Type: Feature Request
> Components: datasource
> Reporter: Van Halbert
> Assignee: Aditya Manglam Sharma
> Priority: Major
> Fix For: 1.6.0
>
> Original Estimate: 2 days, 4 hours
> Time Spent: 3 hours, 30 minutes
> Remaining Estimate: 2 days, 30 minutes
>
> Would like to have native connector
> To interact with HDFS as a datasource from a DV perspective there are at least two options:
> 1 - HttpFS
> 2 - WebHDFS
> Both options seems to be in practise very slow. I heard 2x slower.
> It would be nice if we can create a native HDFS connector.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
4 years, 6 months