[teiid-issues] [JBoss JIRA] (TEIIDSB-206) Create native connector to interact with HDFS as a datasource

[Ramesh Reddy (Jira)]

    [ https://issues.redhat.com/browse/TEIIDSB-206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14173071#comment-14173071 ] 

Ramesh Reddy commented on TEIIDSB-206:
--------------------------------------

I propose we use "Option 1", which is already mostly supported in our DDL already and seems the cleanest version of it. This can be well covered in the Operator as in Operator we have
{code:java}
datasources:
  - name: foo
    type: hdfs{code}
There need to be some tweaks we need to make on the Spring Boot side to figure out the translator from the alias name which could involve vdb introspection.

 

> Create native connector to interact with HDFS as a datasource
> -------------------------------------------------------------
>
>                 Key: TEIIDSB-206
>                 URL: https://issues.redhat.com/browse/TEIIDSB-206
>             Project: Teiid Spring Boot
>          Issue Type: Feature Request
>          Components: datasource
>            Reporter: Van Halbert
>            Assignee: Aditya Manglam Sharma
>            Priority: Major
>             Fix For: 1.6.0
>
>   Original Estimate: 2 days, 4 hours
>          Time Spent: 3 hours, 30 minutes
>  Remaining Estimate: 2 days, 30 minutes
>
> Would like to have native connector 
> To interact with HDFS as a datasource from a DV perspective there are at least two options:
> 1 - HttpFS
> 2 - WebHDFS
> Both options seems to be in practise very slow. I heard 2x slower.
> It would be nice if we can create a native HDFS connector.



--
This message was sent by Atlassian Jira
(v7.13.8#713008)