[teiid-issues] [JBoss JIRA] (TEIIDSB-206) Create native connector to interact with HDFS as a datasource

[Steven Hawkins (Jira)]

    [ https://issues.redhat.com/browse/TEIIDSB-206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14171707#comment-14171707 ] 

Steven Hawkins commented on TEIIDSB-206:
----------------------------------------

The pr for aligning these changes with the updates from Teiid has been opened.

[~rareddy] how do you want to handle operator support for this?  Namely we have an excel and file sources that presume a file connection.  Do you want to also add a named excel-hdfs and file-hdfs (likewise we are currently missing the ftp variants) or should we look to make things a bit more flexible / abstract and look toward using a convention, ddl, or datasource properties to know the source type?  This will continue to fan out with more file sources, such as s3, and more file consumers, such as avro (that could mean creating avro-ftp, avro-hdfs, avro-file, avro-s3)

> Create native connector to interact with HDFS as a datasource
> -------------------------------------------------------------
>
>                 Key: TEIIDSB-206
>                 URL: https://issues.redhat.com/browse/TEIIDSB-206
>             Project: Teiid Spring Boot
>          Issue Type: Feature Request
>          Components: datasource
>            Reporter: Van Halbert
>            Assignee: Aditya Manglam Sharma
>            Priority: Major
>             Fix For: 1.6.0
>
>   Original Estimate: 2 days, 4 hours
>          Time Spent: 3 hours, 30 minutes
>  Remaining Estimate: 2 days, 30 minutes
>
> Would like to have native connector 
> To interact with HDFS as a datasource from a DV perspective there are at least two options:
> 1 - HttpFS
> 2 - WebHDFS
> Both options seems to be in practise very slow. I heard 2x slower.
> It would be nice if we can create a native HDFS connector.



--
This message was sent by Atlassian Jira
(v7.13.8#713008)