[JBoss JIRA] (TEIIDSB-211) create an s3 file source
by Steven Hawkins (Jira)
[ https://issues.redhat.com/browse/TEIIDSB-211?focusedWorklogId=12451712&pa... ]
Steven Hawkins logged work on TEIIDSB-211:
------------------------------------------
Author: Steven Hawkins
Created on: 07/Jul/20 1:44 PM
Start Date: 07/Jul/20 1:43 PM
Worklog Time Spent: 3 hours
Work Description: Time spent reviewing / working with Aditya and bringing Teiid changes forward.
Issue Time Tracking
-------------------
Remaining Estimate: 5 hours (was: 1 day)
Time Spent: 3 hours
Worklog Id: (was: 12451712)
> create an s3 file source
> -------------------------
>
> Key: TEIIDSB-211
> URL: https://issues.redhat.com/browse/TEIIDSB-211
> Project: Teiid Spring Boot
> Issue Type: Feature Request
> Components: datasource
> Reporter: Steven Hawkins
> Assignee: Aditya Manglam Sharma
> Priority: Major
> Fix For: 1.6.0
>
> Original Estimate: 1 day
> Time Spent: 3 hours
> Remaining Estimate: 5 hours
>
> The existing s3 support is implemented as a translator / ws source combo. We instead need this to be just a source to allow for translators to utilize it (excel, parquet, avro).
> As an alternative to our existing support we should evaluate utilizing the sdk rather than providing our own processing logic. More than likely this will be a quicker path to things like s3 select support. However ceph seems to lag in s3 support (see TEIID-5935 and no s3 select support) so we'd have to compensate, make the metadata and/or the capabilities specific to the connection type.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
4 years, 6 months
[JBoss JIRA] (TEIIDSB-211) create an s3 file source
by Steven Hawkins (Jira)
[ https://issues.redhat.com/browse/TEIIDSB-211?page=com.atlassian.jira.plug... ]
Steven Hawkins updated TEIIDSB-211:
-----------------------------------
Original Estimate: 1 day
Remaining Estimate: 1 day
Sprint: DV Sprint 66
> create an s3 file source
> -------------------------
>
> Key: TEIIDSB-211
> URL: https://issues.redhat.com/browse/TEIIDSB-211
> Project: Teiid Spring Boot
> Issue Type: Feature Request
> Components: datasource
> Reporter: Steven Hawkins
> Assignee: Aditya Manglam Sharma
> Priority: Major
> Fix For: 1.6.0
>
> Original Estimate: 1 day
> Remaining Estimate: 1 day
>
> The existing s3 support is implemented as a translator / ws source combo. We instead need this to be just a source to allow for translators to utilize it (excel, parquet, avro).
> As an alternative to our existing support we should evaluate utilizing the sdk rather than providing our own processing logic. More than likely this will be a quicker path to things like s3 select support. However ceph seems to lag in s3 support (see TEIID-5935 and no s3 select support) so we'd have to compensate, make the metadata and/or the capabilities specific to the connection type.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
4 years, 6 months
[JBoss JIRA] (TEIID-5936) create an s3 file source
by Steven Hawkins (Jira)
[ https://issues.redhat.com/browse/TEIID-5936?page=com.atlassian.jira.plugi... ]
Steven Hawkins resolved TEIID-5936.
-----------------------------------
Resolution: Done
Added the s3 source based upon a refinement of the support added in TEIIDSB-211.
> create an s3 file source
> -------------------------
>
> Key: TEIID-5936
> URL: https://issues.redhat.com/browse/TEIID-5936
> Project: Teiid
> Issue Type: Feature Request
> Components: Misc. Connectors
> Reporter: Steven Hawkins
> Assignee: Steven Hawkins
> Priority: Major
> Fix For: 15.0
>
> Original Estimate: 1 day
> Time Spent: 1 day
> Remaining Estimate: 0 minutes
>
> The existing s3 support is implemented as a translator / ws source combo. We instead need this to be just a source to allow for translators to utilize it (excel, parquet, avro).
> As an alternative to our existing support we should evaluate utilizing the sdk rather than providing our own processing logic. More than likely this will be a quicker path to things like s3 select support. However ceph seems to lag in s3 support (see TEIID-5935 and no s3 select support) so we'd have to compensate, make the metadata and/or the capabilities specific to the connection type.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
4 years, 6 months
[JBoss JIRA] (TEIID-5936) create an s3 file source
by Steven Hawkins (Jira)
[ https://issues.redhat.com/browse/TEIID-5936?focusedWorklogId=12451711&pag... ]
Steven Hawkins logged work on TEIID-5936:
-----------------------------------------
Author: Steven Hawkins
Created on: 07/Jul/20 10:37 AM
Start Date: 07/Jul/20 10:36 AM
Worklog Time Spent: 30 minutes
Work Description: added docs and release note
Issue Time Tracking
-------------------
Remaining Estimate: 0 minutes (was: 30 minutes)
Time Spent: 1 day (was: 7 hours, 30 minutes)
Worklog Id: (was: 12451711)
> create an s3 file source
> -------------------------
>
> Key: TEIID-5936
> URL: https://issues.redhat.com/browse/TEIID-5936
> Project: Teiid
> Issue Type: Feature Request
> Components: Misc. Connectors
> Reporter: Steven Hawkins
> Assignee: Steven Hawkins
> Priority: Major
> Fix For: 15.0
>
> Original Estimate: 1 day
> Time Spent: 1 day
> Remaining Estimate: 0 minutes
>
> The existing s3 support is implemented as a translator / ws source combo. We instead need this to be just a source to allow for translators to utilize it (excel, parquet, avro).
> As an alternative to our existing support we should evaluate utilizing the sdk rather than providing our own processing logic. More than likely this will be a quicker path to things like s3 select support. However ceph seems to lag in s3 support (see TEIID-5935 and no s3 select support) so we'd have to compensate, make the metadata and/or the capabilities specific to the connection type.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
4 years, 6 months
[JBoss JIRA] (TEIID-5936) create an s3 file source
by Steven Hawkins (Jira)
[ https://issues.redhat.com/browse/TEIID-5936?focusedWorklogId=12451710&pag... ]
Steven Hawkins logged work on TEIID-5936:
-----------------------------------------
Author: Steven Hawkins
Created on: 07/Jul/20 10:26 AM
Start Date: 07/Jul/20 10:26 AM
Worklog Time Spent: 1 hour, 30 minutes
Work Description: cleaned up the infinispan, hdfs, and cassandra refactorings as well
Issue Time Tracking
-------------------
Remaining Estimate: 30 minutes (was: 2 hours)
Time Spent: 7 hours, 30 minutes (was: 6 hours)
Worklog Id: (was: 12451710)
> create an s3 file source
> -------------------------
>
> Key: TEIID-5936
> URL: https://issues.redhat.com/browse/TEIID-5936
> Project: Teiid
> Issue Type: Feature Request
> Components: Misc. Connectors
> Reporter: Steven Hawkins
> Assignee: Steven Hawkins
> Priority: Major
> Fix For: 15.0
>
> Original Estimate: 1 day
> Time Spent: 7 hours, 30 minutes
> Remaining Estimate: 30 minutes
>
> The existing s3 support is implemented as a translator / ws source combo. We instead need this to be just a source to allow for translators to utilize it (excel, parquet, avro).
> As an alternative to our existing support we should evaluate utilizing the sdk rather than providing our own processing logic. More than likely this will be a quicker path to things like s3 select support. However ceph seems to lag in s3 support (see TEIID-5935 and no s3 select support) so we'd have to compensate, make the metadata and/or the capabilities specific to the connection type.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
4 years, 6 months
[JBoss JIRA] (TEIID-5936) create an s3 file source
by Steven Hawkins (Jira)
[ https://issues.redhat.com/browse/TEIID-5936?focusedWorklogId=12451708&pag... ]
Steven Hawkins logged work on TEIID-5936:
-----------------------------------------
Author: Steven Hawkins
Created on: 06/Jul/20 3:49 PM
Start Date: 06/Jul/20 3:48 PM
Worklog Time Spent: 6 hours
Work Description: Time spent porting, updating the code, creating the module, and testing.
Issue Time Tracking
-------------------
Remaining Estimate: 2 hours (was: 1 day)
Time Spent: 6 hours
Worklog Id: (was: 12451708)
> create an s3 file source
> -------------------------
>
> Key: TEIID-5936
> URL: https://issues.redhat.com/browse/TEIID-5936
> Project: Teiid
> Issue Type: Feature Request
> Components: Misc. Connectors
> Reporter: Steven Hawkins
> Assignee: Steven Hawkins
> Priority: Major
> Fix For: 15.0
>
> Original Estimate: 1 day
> Time Spent: 6 hours
> Remaining Estimate: 2 hours
>
> The existing s3 support is implemented as a translator / ws source combo. We instead need this to be just a source to allow for translators to utilize it (excel, parquet, avro).
> As an alternative to our existing support we should evaluate utilizing the sdk rather than providing our own processing logic. More than likely this will be a quicker path to things like s3 select support. However ceph seems to lag in s3 support (see TEIID-5935 and no s3 select support) so we'd have to compensate, make the metadata and/or the capabilities specific to the connection type.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
4 years, 6 months
[JBoss JIRA] (TEIID-5936) create an s3 file source
by Steven Hawkins (Jira)
[ https://issues.redhat.com/browse/TEIID-5936?page=com.atlassian.jira.plugi... ]
Steven Hawkins updated TEIID-5936:
----------------------------------
Original Estimate: 1 day
Remaining Estimate: 1 day
Sprint: DV Sprint 66
> create an s3 file source
> -------------------------
>
> Key: TEIID-5936
> URL: https://issues.redhat.com/browse/TEIID-5936
> Project: Teiid
> Issue Type: Feature Request
> Components: Misc. Connectors
> Reporter: Steven Hawkins
> Assignee: Steven Hawkins
> Priority: Major
> Fix For: 15.0
>
> Original Estimate: 1 day
> Remaining Estimate: 1 day
>
> The existing s3 support is implemented as a translator / ws source combo. We instead need this to be just a source to allow for translators to utilize it (excel, parquet, avro).
> As an alternative to our existing support we should evaluate utilizing the sdk rather than providing our own processing logic. More than likely this will be a quicker path to things like s3 select support. However ceph seems to lag in s3 support (see TEIID-5935 and no s3 select support) so we'd have to compensate, make the metadata and/or the capabilities specific to the connection type.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
4 years, 6 months