[JBoss JIRA] (TEIID-4981) Support Amazon S3 Transaltor
by Ramesh Reddy (JIRA)
[ https://issues.jboss.org/browse/TEIID-4981?page=com.atlassian.jira.plugin... ]
Ramesh Reddy commented on TEIID-4981:
-------------------------------------
The S3 works with Web service resource adapter not file resource adapter. The s3 translator exposes similar named procedure as file translator but not same. So what I am saying is the way excel translator is designed it only works with file resource adapter not Web service one. So there needs to be enhancements done to excel handling.
> Support Amazon S3 Transaltor
> ----------------------------
>
> Key: TEIID-4981
> URL: https://issues.jboss.org/browse/TEIID-4981
> Project: Teiid
> Issue Type: Feature Request
> Components: Misc. Connectors
> Affects Versions: 8.12.x-6.4
> Reporter: Ramesh Reddy
> Assignee: Ramesh Reddy
> Labels: Alpha3
> Fix For: 10.0, 8.12.x-6.4
>
>
> Support Amazon S3 access from Teiid. Typically this is viewed as file-based access? however handling the security is key here.
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 7 months
[JBoss JIRA] (TEIID-5054) autoFailover with a multi-batch result timing issue
by Steven Hawkins (JIRA)
[ https://issues.jboss.org/browse/TEIID-5054?page=com.atlassian.jira.plugin... ]
Steven Hawkins resolved TEIID-5054.
-----------------------------------
Resolution: Done
Changed the code to separate message processing from the read.
> autoFailover with a multi-batch result timing issue
> ---------------------------------------------------
>
> Key: TEIID-5054
> URL: https://issues.jboss.org/browse/TEIID-5054
> Project: Teiid
> Issue Type: Bug
> Components: JDBC Driver
> Reporter: Steven Hawkins
> Assignee: Steven Hawkins
> Priority: Blocker
> Fix For: 10.0, 8.12.x-6.4, 9.2.6, 9.3.3
>
>
> With autoFailover=true there is a periodic ping before usage of the connection. This ping may be called during processing of multi-batch results such that the ping call effectively hangs. 4 minutes later (or whatever the synch timeout is) the client will attempt to failover.
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 7 months
[JBoss JIRA] (TEIID-5054) autoFailover with a multi-batch result timing issue
by Steven Hawkins (JIRA)
Steven Hawkins created TEIID-5054:
-------------------------------------
Summary: autoFailover with a multi-batch result timing issue
Key: TEIID-5054
URL: https://issues.jboss.org/browse/TEIID-5054
Project: Teiid
Issue Type: Bug
Components: JDBC Driver
Reporter: Steven Hawkins
Assignee: Steven Hawkins
Priority: Blocker
Fix For: 10.0, 9.2.6, 9.3.3
With autoFailover=true there is a periodic ping before usage of the connection. This ping may be called during processing of multi-batch results such that the ping call effectively hangs. 4 minutes later (or whatever the synch timeout is) the client will attempt to failover.
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 7 months
[JBoss JIRA] (TEIID-4981) Support Amazon S3 Transaltor
by Jan Stastny (JIRA)
[ https://issues.jboss.org/browse/TEIID-4981?page=com.atlassian.jira.plugin... ]
Jan Stastny commented on TEIID-4981:
------------------------------------
[~rareddy]
I don't follow.
My concern is, that if the authentication fields are exposed in amazon-s3 translator only, you can't use any file-type specific translator capabilities for processing the files in s3 - just because you can't connect to s3 (requires amazon-s3 translator) and use e.g. excel translator at the same time.
> Support Amazon S3 Transaltor
> ----------------------------
>
> Key: TEIID-4981
> URL: https://issues.jboss.org/browse/TEIID-4981
> Project: Teiid
> Issue Type: Feature Request
> Components: Misc. Connectors
> Affects Versions: 8.12.x-6.4
> Reporter: Ramesh Reddy
> Assignee: Ramesh Reddy
> Labels: Alpha3
> Fix For: 10.0, 8.12.x-6.4
>
>
> Support Amazon S3 access from Teiid. Typically this is viewed as file-based access? however handling the security is key here.
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 7 months
[JBoss JIRA] (TEIID-5032) Remove jdg client jar's from deployment
by Van Halbert (JIRA)
[ https://issues.jboss.org/browse/TEIID-5032?page=com.atlassian.jira.plugin... ]
Van Halbert resolved TEIID-5032.
--------------------------------
Resolution: Done
> Remove jdg client jar's from deployment
> ---------------------------------------
>
> Key: TEIID-5032
> URL: https://issues.jboss.org/browse/TEIID-5032
> Project: Teiid
> Issue Type: Task
> Components: Build/Kits, Infinispan, Quick Starts
> Affects Versions: 8.12.x-6.4
> Reporter: Van Halbert
> Assignee: Van Halbert
> Priority: Blocker
> Fix For: 8.12.x-6.4
>
>
> The jdg client jar's will not be used, instead the corresponding jdg eap module client kit will be required to be installed.
> This will require the modules to reference the 7.1 jdg slots. Will also need to remove the infinispan-hotrod translator and default infinispan-hotrod RA. There is already a cli script to install these.
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 7 months
[JBoss JIRA] (TEIID-5032) Remove jdg client jar's from deployment
by Van Halbert (JIRA)
[ https://issues.jboss.org/browse/TEIID-5032?page=com.atlassian.jira.plugin... ]
Van Halbert updated TEIID-5032:
-------------------------------
Fix Version/s: 8.12.x-6.4
> Remove jdg client jar's from deployment
> ---------------------------------------
>
> Key: TEIID-5032
> URL: https://issues.jboss.org/browse/TEIID-5032
> Project: Teiid
> Issue Type: Task
> Components: Build/Kits, Infinispan, Quick Starts
> Affects Versions: 8.12.x-6.4
> Reporter: Van Halbert
> Assignee: Van Halbert
> Priority: Blocker
> Fix For: 8.12.x-6.4
>
>
> The jdg client jar's will not be used, instead the corresponding jdg eap module client kit will be required to be installed.
> This will require the modules to reference the 7.1 jdg slots. Will also need to remove the infinispan-hotrod translator and default infinispan-hotrod RA. There is already a cli script to install these.
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 7 months
[JBoss JIRA] (TEIID-5038) Couchbase importer.sampleKeyspaces not resctricting document types imported
by RH Bugzilla Integration (JIRA)
[ https://issues.jboss.org/browse/TEIID-5038?page=com.atlassian.jira.plugin... ]
RH Bugzilla Integration commented on TEIID-5038:
------------------------------------------------
Van Halbert <vhalbert(a)redhat.com> changed the Status of [bug 1485901|https://bugzilla.redhat.com/show_bug.cgi?id=1485901] from NEW to MODIFIED
> Couchbase importer.sampleKeyspaces not resctricting document types imported
> ---------------------------------------------------------------------------
>
> Key: TEIID-5038
> URL: https://issues.jboss.org/browse/TEIID-5038
> Project: Teiid
> Issue Type: Bug
> Components: Misc. Connectors
> Affects Versions: 8.12.x-6.4
> Reporter: Jan Stastny
> Assignee: Steven Hawkins
> Priority: Critical
>
> A vdb with importer.sampleKeyspaces property doesn't restrict the keyspaces imported. From the docs:
> ??A comma-separate list of the keyspace names, used to fine-grained control which keyspaces should be mapped, by default map all keyspaces.??
> I have two keyspaces:
> * dvqe_small
> * dvqe_other
> The dvqe_small one contains ONLY types:
> * SmallA
> * SmallB
> But this vdb:
> {code:xml|title=vdb with sampleKeyspaces}
> <?xml version="1.0" encoding="UTF-8" standalone="yes"?>
> <vdb name="couchbase_crud" version="1">
> <model name="Source" type="PHYSICAL" visible="true">
> <property name="importer.typeNameList" value="`dvqe_small`:`type`,`dvqe_other`:`type`"/>
> <property name="importer.sampleKeyspaces" value="`dvqe_small`"/>
> <source name="Source" connection-jndi-name="java:/couchbase_crud" translator-name="couchbase"/>
> </model>
> </vdb>
> {code}
> is imported the same as this one:
> {code:xml|title=vdb without sampleKeyspaces}
> <?xml version="1.0" encoding="UTF-8" standalone="yes"?>
> <vdb name="couchbase_crud" version="1">
> <model name="Source" type="PHYSICAL" visible="true">
> <property name="importer.typeNameList" value="`dvqe_small`:`type`,`dvqe_other`:`type`"/>
> <source name="Source" connection-jndi-name="java:/couchbase_crud" translator-name="couchbase"/>
> </model>
> </vdb>
> {code}
> With resulting DDL containing OTHER types than those defined in dvqe_small keyspace:
> {code:sql|title=import result}
> SET NAMESPACE 'http://www.teiid.org/translator/couchbase/2017' AS teiid_couchbase;
> CREATE FOREIGN TABLE dvqe_crud (
> documentID string,
> CONSTRAINT PK0 PRIMARY KEY(documentID)
> ) OPTIONS (NAMEINSOURCE '`dvqe_crud`', UPDATABLE TRUE, "teiid_couchbase:ISARRAYTABLE" 'false');
> CREATE FOREIGN TABLE LargeA (
> documentID string,
> BigDecimalValue integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`BigDecimalValue`'),
> BigIntegerValue integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`BigIntegerValue`'),
> BooleanValue boolean OPTIONS (NAMEINSOURCE '`dvqe_other`.`BooleanValue`'),
> ByteNum integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`ByteNum`'),
> CharValue string OPTIONS (NAMEINSOURCE '`dvqe_other`.`CharValue`'),
> DateValue string OPTIONS (NAMEINSOURCE '`dvqe_other`.`DateValue`'),
> DoubleNum integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`DoubleNum`'),
> FloatNum integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`FloatNum`'),
> IntKey integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`IntKey`'),
> LongNum integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`LongNum`'),
> ObjectValue string OPTIONS (NAMEINSOURCE '`dvqe_other`.`ObjectValue`'),
> ShortValue integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`ShortValue`'),
> StringKey string OPTIONS (NAMEINSOURCE '`dvqe_other`.`StringKey`'),
> StringNum string OPTIONS (NAMEINSOURCE '`dvqe_other`.`StringNum`'),
> TimeValue string OPTIONS (NAMEINSOURCE '`dvqe_other`.`TimeValue`'),
> TimestampValue string OPTIONS (NAMEINSOURCE '`dvqe_other`.`TimestampValue`'),
> type string OPTIONS (NAMEINSOURCE '`dvqe_other`.`type`'),
> IntNum integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`IntNum`'),
> CONSTRAINT PK0 PRIMARY KEY(documentID)
> ) OPTIONS (NAMEINSOURCE '`dvqe_other`', UPDATABLE TRUE, "teiid_couchbase:ISARRAYTABLE" 'false', "teiid_couchbase:NAMEDTYPEPAIR" '`type`:''LargeA''');
> CREATE FOREIGN TABLE LargeB (
> documentID string,
> BigDecimalValue integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`BigDecimalValue`'),
> BigIntegerValue integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`BigIntegerValue`'),
> BooleanValue boolean OPTIONS (NAMEINSOURCE '`dvqe_other`.`BooleanValue`'),
> ByteNum integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`ByteNum`'),
> CharValue string OPTIONS (NAMEINSOURCE '`dvqe_other`.`CharValue`'),
> DateValue string OPTIONS (NAMEINSOURCE '`dvqe_other`.`DateValue`'),
> DoubleNum integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`DoubleNum`'),
> FloatNum integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`FloatNum`'),
> IntKey integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`IntKey`'),
> LongNum integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`LongNum`'),
> ObjectValue string OPTIONS (NAMEINSOURCE '`dvqe_other`.`ObjectValue`'),
> ShortValue integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`ShortValue`'),
> StringKey string OPTIONS (NAMEINSOURCE '`dvqe_other`.`StringKey`'),
> StringNum string OPTIONS (NAMEINSOURCE '`dvqe_other`.`StringNum`'),
> TimeValue string OPTIONS (NAMEINSOURCE '`dvqe_other`.`TimeValue`'),
> TimestampValue string OPTIONS (NAMEINSOURCE '`dvqe_other`.`TimestampValue`'),
> type string OPTIONS (NAMEINSOURCE '`dvqe_other`.`type`'),
> IntNum integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`IntNum`'),
> CONSTRAINT PK0 PRIMARY KEY(documentID)
> ) OPTIONS (NAMEINSOURCE '`dvqe_other`', UPDATABLE TRUE, "teiid_couchbase:ISARRAYTABLE" 'false', "teiid_couchbase:NAMEDTYPEPAIR" '`type`:''LargeB''');
> CREATE FOREIGN TABLE MediumA (
> documentID string,
> BigDecimalValue integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`BigDecimalValue`'),
> BigIntegerValue integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`BigIntegerValue`'),
> BooleanValue boolean OPTIONS (NAMEINSOURCE '`dvqe_other`.`BooleanValue`'),
> ByteNum integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`ByteNum`'),
> CharValue string OPTIONS (NAMEINSOURCE '`dvqe_other`.`CharValue`'),
> DateValue string OPTIONS (NAMEINSOURCE '`dvqe_other`.`DateValue`'),
> DoubleNum integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`DoubleNum`'),
> FloatNum integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`FloatNum`'),
> IntKey integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`IntKey`'),
> LongNum integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`LongNum`'),
> ObjectValue string OPTIONS (NAMEINSOURCE '`dvqe_other`.`ObjectValue`'),
> ShortValue integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`ShortValue`'),
> StringKey string OPTIONS (NAMEINSOURCE '`dvqe_other`.`StringKey`'),
> StringNum string OPTIONS (NAMEINSOURCE '`dvqe_other`.`StringNum`'),
> TimeValue string OPTIONS (NAMEINSOURCE '`dvqe_other`.`TimeValue`'),
> TimestampValue string OPTIONS (NAMEINSOURCE '`dvqe_other`.`TimestampValue`'),
> type string OPTIONS (NAMEINSOURCE '`dvqe_other`.`type`'),
> IntNum integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`IntNum`'),
> CONSTRAINT PK0 PRIMARY KEY(documentID)
> ) OPTIONS (NAMEINSOURCE '`dvqe_other`', UPDATABLE TRUE, "teiid_couchbase:ISARRAYTABLE" 'false', "teiid_couchbase:NAMEDTYPEPAIR" '`type`:''MediumA''');
> CREATE FOREIGN TABLE MediumB (
> documentID string,
> BigDecimalValue integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`BigDecimalValue`'),
> BigIntegerValue integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`BigIntegerValue`'),
> BooleanValue boolean OPTIONS (NAMEINSOURCE '`dvqe_other`.`BooleanValue`'),
> ByteNum integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`ByteNum`'),
> CharValue string OPTIONS (NAMEINSOURCE '`dvqe_other`.`CharValue`'),
> DateValue string OPTIONS (NAMEINSOURCE '`dvqe_other`.`DateValue`'),
> DoubleNum integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`DoubleNum`'),
> FloatNum integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`FloatNum`'),
> IntKey integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`IntKey`'),
> LongNum integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`LongNum`'),
> ObjectValue string OPTIONS (NAMEINSOURCE '`dvqe_other`.`ObjectValue`'),
> ShortValue integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`ShortValue`'),
> StringKey string OPTIONS (NAMEINSOURCE '`dvqe_other`.`StringKey`'),
> StringNum string OPTIONS (NAMEINSOURCE '`dvqe_other`.`StringNum`'),
> TimeValue string OPTIONS (NAMEINSOURCE '`dvqe_other`.`TimeValue`'),
> TimestampValue string OPTIONS (NAMEINSOURCE '`dvqe_other`.`TimestampValue`'),
> type string OPTIONS (NAMEINSOURCE '`dvqe_other`.`type`'),
> IntNum integer OPTIONS (NAMEINSOURCE '`dvqe_other`.`IntNum`'),
> CONSTRAINT PK0 PRIMARY KEY(documentID)
> ) OPTIONS (NAMEINSOURCE '`dvqe_other`', UPDATABLE TRUE, "teiid_couchbase:ISARRAYTABLE" 'false', "teiid_couchbase:NAMEDTYPEPAIR" '`type`:''MediumB''');
> CREATE FOREIGN TABLE SmallA (
> documentID string,
> BigDecimalValue integer OPTIONS (NAMEINSOURCE '`dvqe_small`.`BigDecimalValue`'),
> BigIntegerValue integer OPTIONS (NAMEINSOURCE '`dvqe_small`.`BigIntegerValue`'),
> BooleanValue boolean OPTIONS (NAMEINSOURCE '`dvqe_small`.`BooleanValue`'),
> ByteNum integer OPTIONS (NAMEINSOURCE '`dvqe_small`.`ByteNum`'),
> CharValue string OPTIONS (NAMEINSOURCE '`dvqe_small`.`CharValue`'),
> DateValue string OPTIONS (NAMEINSOURCE '`dvqe_small`.`DateValue`'),
> DoubleNum integer OPTIONS (NAMEINSOURCE '`dvqe_small`.`DoubleNum`'),
> FloatNum integer OPTIONS (NAMEINSOURCE '`dvqe_small`.`FloatNum`'),
> IntKey integer OPTIONS (NAMEINSOURCE '`dvqe_small`.`IntKey`'),
> LongNum integer OPTIONS (NAMEINSOURCE '`dvqe_small`.`LongNum`'),
> ObjectValue string OPTIONS (NAMEINSOURCE '`dvqe_small`.`ObjectValue`'),
> ShortValue integer OPTIONS (NAMEINSOURCE '`dvqe_small`.`ShortValue`'),
> StringKey string OPTIONS (NAMEINSOURCE '`dvqe_small`.`StringKey`'),
> StringNum string OPTIONS (NAMEINSOURCE '`dvqe_small`.`StringNum`'),
> TimeValue string OPTIONS (NAMEINSOURCE '`dvqe_small`.`TimeValue`'),
> TimestampValue string OPTIONS (NAMEINSOURCE '`dvqe_small`.`TimestampValue`'),
> type string OPTIONS (NAMEINSOURCE '`dvqe_small`.`type`'),
> IntNum integer OPTIONS (NAMEINSOURCE '`dvqe_small`.`IntNum`'),
> CONSTRAINT PK0 PRIMARY KEY(documentID)
> ) OPTIONS (NAMEINSOURCE '`dvqe_small`', UPDATABLE TRUE, "teiid_couchbase:ISARRAYTABLE" 'false', "teiid_couchbase:NAMEDTYPEPAIR" '`type`:''SmallA''');
> CREATE FOREIGN TABLE SmallB (
> documentID string,
> BigDecimalValue integer OPTIONS (NAMEINSOURCE '`dvqe_small`.`BigDecimalValue`'),
> BigIntegerValue integer OPTIONS (NAMEINSOURCE '`dvqe_small`.`BigIntegerValue`'),
> BooleanValue boolean OPTIONS (NAMEINSOURCE '`dvqe_small`.`BooleanValue`'),
> ByteNum integer OPTIONS (NAMEINSOURCE '`dvqe_small`.`ByteNum`'),
> CharValue string OPTIONS (NAMEINSOURCE '`dvqe_small`.`CharValue`'),
> DateValue string OPTIONS (NAMEINSOURCE '`dvqe_small`.`DateValue`'),
> DoubleNum integer OPTIONS (NAMEINSOURCE '`dvqe_small`.`DoubleNum`'),
> FloatNum integer OPTIONS (NAMEINSOURCE '`dvqe_small`.`FloatNum`'),
> IntKey integer OPTIONS (NAMEINSOURCE '`dvqe_small`.`IntKey`'),
> LongNum integer OPTIONS (NAMEINSOURCE '`dvqe_small`.`LongNum`'),
> ObjectValue string OPTIONS (NAMEINSOURCE '`dvqe_small`.`ObjectValue`'),
> ShortValue integer OPTIONS (NAMEINSOURCE '`dvqe_small`.`ShortValue`'),
> StringKey string OPTIONS (NAMEINSOURCE '`dvqe_small`.`StringKey`'),
> StringNum string OPTIONS (NAMEINSOURCE '`dvqe_small`.`StringNum`'),
> TimeValue string OPTIONS (NAMEINSOURCE '`dvqe_small`.`TimeValue`'),
> TimestampValue string OPTIONS (NAMEINSOURCE '`dvqe_small`.`TimestampValue`'),
> type string OPTIONS (NAMEINSOURCE '`dvqe_small`.`type`'),
> IntNum integer OPTIONS (NAMEINSOURCE '`dvqe_small`.`IntNum`'),
> CONSTRAINT PK0 PRIMARY KEY(documentID)
> ) OPTIONS (NAMEINSOURCE '`dvqe_small`', UPDATABLE TRUE, "teiid_couchbase:ISARRAYTABLE" 'false', "teiid_couchbase:NAMEDTYPEPAIR" '`type`:''SmallB''');
> CREATE FOREIGN PROCEDURE getDocument(IN id string NOT NULL OPTIONS (ANNOTATION 'The document id of what documents to return'), IN keyspace string NOT NULL OPTIONS (ANNOTATION 'The keyspace name used to retrieve the document')) RETURNS TABLE (result blob)
> OPTIONS (ANNOTATION 'Return a json document that match the given document id as BLOB')
> CREATE FOREIGN PROCEDURE getDocuments(IN id string NOT NULL OPTIONS (ANNOTATION 'The document id or SQL like pattern of what documents to return, for example, the ''%'' sign is used to define wildcards (missing letters) both before and after the pattern'), IN keyspace string NOT NULL OPTIONS (ANNOTATION 'The keyspace name used to retrieve the documents')) RETURNS TABLE (result blob)
> OPTIONS (ANNOTATION 'Returns json documents that match the given document id or id pattern as BLOBs')
> {code}
--
This message was sent by Atlassian JIRA
(v7.2.3#72005)
8 years, 7 months