[teiid-issues] [JBoss JIRA] (TEIIDSB-206) Create native connector to interact with HDFS as a datasource

[Ramesh Reddy (Jira)]

    [ https://issues.redhat.com/browse/TEIIDSB-206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14172984#comment-14172984 ] 

Ramesh Reddy commented on TEIIDSB-206:
--------------------------------------

File and HDFS and S3 all becoming synonymous to me, I am a little confused to see `file-hdfs` kind of naming. I do not yet understand the file consumer side as you mention such as `avro` as to how we are going to provide that. I understand that for `excel` we did a translator and tied directly to `file` are we thinking similar lines with `avro`?

creating avro-ftp, avro-hdfs, avro-file, avro-s3 like Connection factories seem to be easiest, but verbose. I see that if you are going to design above `avro` as a language feature then we do not need this? If not we can see how we can abstract all these types under `file` type and figure out dynamically as you suggest.

> Create native connector to interact with HDFS as a datasource
> -------------------------------------------------------------
>
>                 Key: TEIIDSB-206
>                 URL: https://issues.redhat.com/browse/TEIIDSB-206
>             Project: Teiid Spring Boot
>          Issue Type: Feature Request
>          Components: datasource
>            Reporter: Van Halbert
>            Assignee: Aditya Manglam Sharma
>            Priority: Major
>             Fix For: 1.6.0
>
>   Original Estimate: 2 days, 4 hours
>          Time Spent: 3 hours, 30 minutes
>  Remaining Estimate: 2 days, 30 minutes
>
> Would like to have native connector 
> To interact with HDFS as a datasource from a DV perspective there are at least two options:
> 1 - HttpFS
> 2 - WebHDFS
> Both options seems to be in practise very slow. I heard 2x slower.
> It would be nice if we can create a native HDFS connector.



--
This message was sent by Atlassian Jira
(v7.13.8#713008)