[JBoss JIRA] (TEIIDSB-186) Fix to use only use alias name from ExternalSource
by Ramesh Reddy (Jira)
[ https://issues.redhat.com/browse/TEIIDSB-186?page=com.atlassian.jira.plug... ]
Ramesh Reddy commented on TEIIDSB-186:
--------------------------------------
I have yet to reply to the thread on ENTESB-11938
> Just to double check are you saying that for all teiid spring boot usage, implicit vdb or explicit vdb,
The big difference between implicit and explicit apart from metadata is data source class generation, so yes IMO this equally applies
> we'll use the external source alias …
[View More]name in place of translator names?
yes, for spring boot workloads. We will try to keep this as close as possible where possible with translator names.
> Fix to use only use alias name from ExternalSource
> --------------------------------------------------
>
> Key: TEIIDSB-186
> URL: https://issues.redhat.com/browse/TEIIDSB-186
> Project: Teiid Spring Boot
> Issue Type: Quality Risk
> Components: core
> Reporter: Ramesh Reddy
> Priority: Major
>
> As the code progressed the usage of translator name and alias name from ExternalSource class is interchangeably used. This is leading to confusion in terms of development and documents.
> Need to fix all the places where the translator name used to use alias name with Spring Boot engine.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
[View Less]
5 years
[JBoss JIRA] (TEIID-5927) S3 translator can not support minIO endpoint
by Steven Hawkins (Jira)
[ https://issues.redhat.com/browse/TEIID-5927?page=com.atlassian.jira.plugi... ]
Steven Hawkins updated TEIID-5927:
----------------------------------
Component/s: Misc. Connectors
Fix Version/s: 14.0
Priority: Major (was: Blocker)
> S3 translator can not support minIO endpoint
> --------------------------------------------
>
> Key: TEIID-5927
> URL: https://issues.redhat.com/browse/TEIID-5927
> Project: Teiid
…
[View More]> Issue Type: Feature Request
> Components: Misc. Connectors
> Reporter: Rui Wang
> Assignee: Steven Hawkins
> Priority: Major
> Fix For: 14.0
>
>
> When I try to config my on own minIO storage to teiied RA, get following error, seems it tied directly with amazon endpoints, could you pls takes an enhancement to make it generic so it can be used with minio stores. Thanks a lot.
> <resource-adapter id="webservice">
> <module slot="main" id="org.jboss.teiid.resource-adapter.webservice"/>
> <connection-definitions>
> <connection-definition class-name="org.teiid.resource.adapter.ws.WSManagedConnectionFactory" jndi-name="java:/wsDS" enabled="true" use-java-context="true" pool-name="wsDS">
> <config-property name="EndPoint">
> http://myMinioIp:9091/minio/bucket1/
> </config-property>
> </connection-definition>
> </connection-definitions>
> </resource-adapter>
>
>
> Exception in thread "main" org.teiid.jdbc.TeiidSQLException: TEIID30504 Remote org.teiid.core.TeiidProcessingException: TEIID30504 web-connector: Error reading the file https://s3.amazonaws.com/bucket1/price.csv; The response code returned 403. Details: <?xml version="1.0" encoding="UTF-8"?>
> <Error><Code>InvalidAccessKeyId</Code><Message>The AWS Access Key Id you provided does not exist in our records.</Message><AWSAccessKeyId>minioadmin</AWSAccessKeyId><RequestId>EB7421ECD8EF9B88</RequestId><HostId>m3fHokjXC5shrV+y+2vIHl7KNcr46RvoKRXuZ8TnU4fiZyi1XG6rT9DiTu6yRZfg328QGcr2w+A=</HostId></Error>
> at org.teiid.jdbc.TeiidSQLException.create(TeiidSQLException.java:131)
> at org.teiid.jdbc.TeiidSQLException.create(TeiidSQLException.java:67)
> at org.teiid.jdbc.StatementImpl.postReceiveResults(StatementImpl.java:783)
> at org.teiid.jdbc.StatementImpl.access$100(StatementImpl.java:62)
> at org.teiid.jdbc.StatementImpl$2.onCompletion(StatementImpl.java:581)
> at org.teiid.client.util.ResultsFuture.done(ResultsFuture.java:131)
> at org.teiid.client.util.ResultsFuture.access$200(ResultsFuture.java:36)
> at org.teiid.client.util.ResultsFuture$1.receiveResults(ResultsFuture.java:75)
> at org.teiid.net.socket.SocketServerInstanceImpl.receivedMessage(SocketServerInstanceImpl.java:281)
> at org.teiid.net.socket.SocketServerInstanceImpl.read(SocketServerInstanceImpl.java:333)
> at org.teiid.net.socket.SocketServerInstanceImpl$RemoteInvocationHandler$1.get(SocketServerInstanceImpl.java:423)
> at org.teiid.jdbc.StatementImpl.executeSql(StatementImpl.java:590)
> at org.teiid.jdbc.StatementImpl.executeSql(StatementImpl.java:420)
> at org.teiid.jdbc.StatementImpl.executeQuery(StatementImpl.java:351)
> at com.ibm.vdb.TeiidFile.showVdbInfo(TeiidFile.java:181)
> at com.ibm.vdb.TeiidFile.main(TeiidFile.java:205)
> Caused by: org.teiid.core.TeiidProcessingException: TEIID30504 Remote org.teiid.core.TeiidProcessingException: TEIID30504 web-connector: Error reading the file https://s3.amazonaws.com/bucket1/price.csv; The response code returned 403. Details: <?xml version="1.0" encoding="UTF-8"?>
> <Error><Code>InvalidAccessKeyId</Code><Message>The AWS Access Key Id you provided does not exist in our records.</Message><AWSAccessKeyId>minioadmin</AWSAccessKeyId><RequestId>EB7421ECD8EF9B88</RequestId><HostId>m3fHokjXC5shrV+y+2vIHl7KNcr46RvoKRXuZ8TnU4fiZyi1XG6rT9DiTu6yRZfg328QGcr2w+A=</HostId></Error>
> at org.teiid.dqp.internal.process.DataTierTupleSource.exceptionOccurred(DataTierTupleSource.java:397)
> at org.teiid.dqp.internal.process.DataTierTupleSource.nextTuple(DataTierTupleSource.java:157)
> at org.teiid.query.processor.relational.AccessNode.nextBatchDirect(AccessNode.java:401)
> at org.teiid.query.processor.relational.RelationalNode.nextBatch(RelationalNode.java:277)
> at org.teiid.query.processor.relational.ProjectNode.nextBatchDirect(ProjectNode.java:146)
> at org.teiid.query.processor.relational.RelationalNode.nextBatch(RelationalNode.java:277)
> at org.teiid.query.processor.BatchCollector.collectTuples(BatchCollector.java:160)
> at org.teiid.query.processor.relational.SourceState.prefetch(SourceState.java:207)
> at org.teiid.query.processor.relational.SourceState.rowCountLE(SourceState.java:154)
> at org.teiid.query.processor.relational.JoinNode.nextBatchDirectInternal(JoinNode.java:252)
> at org.teiid.query.processor.relational.JoinNode.nextBatchDirect(JoinNode.java:195)
> at org.teiid.query.processor.relational.RelationalNode.nextBatch(RelationalNode.java:277)
> at org.teiid.query.processor.relational.ProjectNode.nextBatchDirect(ProjectNode.java:146)
> at org.teiid.query.processor.relational.RelationalNode.nextBatch(RelationalNode.java:277)
> at org.teiid.query.processor.relational.RelationalPlan.nextBatch(RelationalPlan.java:139)
> at org.teiid.query.processor.QueryProcessor.nextBatchDirect(QueryProcessor.java:147)
> at org.teiid.query.processor.QueryProcessor.nextBatch(QueryProcessor.java:110)
> at org.teiid.query.processor.BatchCollector.collectTuples(BatchCollector.java:160)
> at org.teiid.query.processor.BatchCollector.collectTuples(BatchCollector.java:142)
> at org.teiid.dqp.internal.process.RequestWorkItem.processMore(RequestWorkItem.java:492)
> at org.teiid.dqp.internal.process.RequestWorkItem.process(RequestWorkItem.java:362)
> at org.teiid.dqp.internal.process.AbstractWorkItem.run(AbstractWorkItem.java:43)
> at org.teiid.dqp.internal.process.RequestWorkItem.run(RequestWorkItem.java:285)
> at org.teiid.dqp.internal.process.DQPWorkContext.runInContext(DQPWorkContext.java:281)
> at org.teiid.dqp.internal.process.ThreadReuseExecutor$RunnableWrapper.run(ThreadReuseExecutor.java:124)
> at org.teiid.dqp.internal.process.ThreadReuseExecutor$2.run(ThreadReuseExecutor.java:212)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: org.teiid.core.TeiidException: Remote org.teiid.translator.TranslatorException: Error reading the file https://s3.amazonaws.com/bucket1/price.csv; The response code returned 403. Details: <?xml version="1.0" encoding="UTF-8"?>
> <Error><Code>InvalidAccessKeyId</Code><Message>The AWS Access Key Id you provided does not exist in our records.</Message><AWSAccessKeyId>minioadmin</AWSAccessKeyId><RequestId>EB7421ECD8EF9B88</RequestId><HostId>m3fHokjXC5shrV+y+2vIHl7KNcr46RvoKRXuZ8TnU4fiZyi1XG6rT9DiTu6yRZfg328QGcr2w+A=</HostId></Error>
> at org.teiid.translator.amazon.s3.S3ProcedureExecution.execute(S3ProcedureExecution.java:114)
> at org.teiid.dqp.internal.datamgr.ConnectorWorkItem.execute(ConnectorWorkItem.java:402)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.teiid.dqp.internal.datamgr.ConnectorManager$1.invoke(ConnectorManager.java:228)
> at com.sun.proxy.$Proxy43.execute(Unknown Source)
> at org.teiid.dqp.internal.process.DataTierTupleSource.getResults(DataTierTupleSource.java:302)
> at org.teiid.dqp.internal.process.DataTierTupleSource$1.call(DataTierTupleSource.java:108)
> at org.teiid.dqp.internal.process.DataTierTupleSource$1.call(DataTierTupleSource.java:104)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at org.teiid.dqp.internal.process.FutureWork.run(FutureWork.java:59)
> ... 6 more
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
[View Less]
5 years
[JBoss JIRA] (TEIIDSB-186) Fix to use only use alias name from ExternalSource
by Steven Hawkins (Jira)
[ https://issues.redhat.com/browse/TEIIDSB-186?page=com.atlassian.jira.plug... ]
Steven Hawkins commented on TEIIDSB-186:
----------------------------------------
> Need to fix all the places where the translator name used to use alias name with Spring Boot engine.
I've linked this to the discussion on ENTESB-11938 as this assumes a resolution from the last comment.
Just to double check are you saying that for all teiid spring boot usage, implicit vdb or explicit vdb, we'll use the …
[View More]external source alias name in place of translator names?
> Fix to use only use alias name from ExternalSource
> --------------------------------------------------
>
> Key: TEIIDSB-186
> URL: https://issues.redhat.com/browse/TEIIDSB-186
> Project: Teiid Spring Boot
> Issue Type: Quality Risk
> Components: core
> Reporter: Ramesh Reddy
> Priority: Major
>
> As the code progressed the usage of translator name and alias name from ExternalSource class is interchangeably used. This is leading to confusion in terms of development and documents.
> Need to fix all the places where the translator name used to use alias name with Spring Boot engine.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
[View Less]
5 years
[JBoss JIRA] (TEIIDSB-187) Need to pull out the "property prefix" to ExternalSource
by Ramesh Reddy (Jira)
Ramesh Reddy created TEIIDSB-187:
------------------------------------
Summary: Need to pull out the "property prefix" to ExternalSource
Key: TEIIDSB-187
URL: https://issues.redhat.com/browse/TEIIDSB-187
Project: Teiid Spring Boot
Issue Type: Enhancement
Components: core
Reporter: Ramesh Reddy
The prefix of the source like "org.spring.teiid.data.xxx" kind of property patterns are defined in the …
[View More]ConnectionFactory classes, this needs to be pulled into ExternalSource class, then this can be one central place everything about translator and source is managed.
Consider externalizing ExternalSource information into a "json" configuration file, then this can be then used in Operator code load and enforce dependencies and pom file generation and property generation from a single location. Right now all this looks very hacky as it spread out across projects.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
[View Less]
5 years
[JBoss JIRA] (TEIIDSB-186) Fix to use only use alias name from ExternalSource
by Ramesh Reddy (Jira)
Ramesh Reddy created TEIIDSB-186:
------------------------------------
Summary: Fix to use only use alias name from ExternalSource
Key: TEIIDSB-186
URL: https://issues.redhat.com/browse/TEIIDSB-186
Project: Teiid Spring Boot
Issue Type: Quality Risk
Components: core
Reporter: Ramesh Reddy
As the code progressed the usage of translator name and alias name from ExternalSource class is interchangeably …
[View More]used. This is leading to confusion in terms of development and documents.
Need to fix all the places where the translator name used to use alias name with Spring Boot engine.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
[View Less]
5 years
[JBoss JIRA] (TEIIDSB-185) Add a way to build Keystore and Truststore to Spring Boot engine
by Ramesh Reddy (Jira)
Ramesh Reddy created TEIIDSB-185:
------------------------------------
Summary: Add a way to build Keystore and Truststore to Spring Boot engine
Key: TEIIDSB-185
URL: https://issues.redhat.com/browse/TEIIDSB-185
Project: Teiid Spring Boot
Issue Type: Enhancement
Components: core
Reporter: Ramesh Reddy
Fix For: 1.5.0
Build KeyStore and TrustStore for Teiid Spring Boot engine, on startup as …
[View More]Beans that can be @Autowired into other components for use.
The configuration is already available, but currently, it is only being used for transport. This can be reused in components like SFTP, Infinispan, REST like translators where one needs this certificate-based needs.
If we include connection-level changes this may little larger task than what specified above, which includes changes in Infinispan and REST sources.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
[View Less]
5 years
[JBoss JIRA] (TEIID-5927) S3 translator can not support minIO endpoint
by Rui Wang (Jira)
Rui Wang created TEIID-5927:
-------------------------------
Summary: S3 translator can not support minIO endpoint
Key: TEIID-5927
URL: https://issues.redhat.com/browse/TEIID-5927
Project: Teiid
Issue Type: Feature Request
Reporter: Rui Wang
Assignee: Steven Hawkins
When I try to config my on own minIO storage to teiied RA, get following error, seems it tied directly with amazon endpoints, could you …
[View More]pls takes an enhancement to make it generic so it can be used with minio stores. Thanks a lot.
<resource-adapter id="webservice">
<module slot="main" id="org.jboss.teiid.resource-adapter.webservice"/>
<connection-definitions>
<connection-definition class-name="org.teiid.resource.adapter.ws.WSManagedConnectionFactory" jndi-name="java:/wsDS" enabled="true" use-java-context="true" pool-name="wsDS">
<config-property name="EndPoint">
http://myMinioIp:9091/minio/bucket1/
</config-property>
</connection-definition>
</connection-definitions>
</resource-adapter>
Exception in thread "main" org.teiid.jdbc.TeiidSQLException: TEIID30504 Remote org.teiid.core.TeiidProcessingException: TEIID30504 web-connector: Error reading the file https://s3.amazonaws.com/bucket1/price.csv; The response code returned 403. Details: <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>InvalidAccessKeyId</Code><Message>The AWS Access Key Id you provided does not exist in our records.</Message><AWSAccessKeyId>minioadmin</AWSAccessKeyId><RequestId>EB7421ECD8EF9B88</RequestId><HostId>m3fHokjXC5shrV+y+2vIHl7KNcr46RvoKRXuZ8TnU4fiZyi1XG6rT9DiTu6yRZfg328QGcr2w+A=</HostId></Error>
at org.teiid.jdbc.TeiidSQLException.create(TeiidSQLException.java:131)
at org.teiid.jdbc.TeiidSQLException.create(TeiidSQLException.java:67)
at org.teiid.jdbc.StatementImpl.postReceiveResults(StatementImpl.java:783)
at org.teiid.jdbc.StatementImpl.access$100(StatementImpl.java:62)
at org.teiid.jdbc.StatementImpl$2.onCompletion(StatementImpl.java:581)
at org.teiid.client.util.ResultsFuture.done(ResultsFuture.java:131)
at org.teiid.client.util.ResultsFuture.access$200(ResultsFuture.java:36)
at org.teiid.client.util.ResultsFuture$1.receiveResults(ResultsFuture.java:75)
at org.teiid.net.socket.SocketServerInstanceImpl.receivedMessage(SocketServerInstanceImpl.java:281)
at org.teiid.net.socket.SocketServerInstanceImpl.read(SocketServerInstanceImpl.java:333)
at org.teiid.net.socket.SocketServerInstanceImpl$RemoteInvocationHandler$1.get(SocketServerInstanceImpl.java:423)
at org.teiid.jdbc.StatementImpl.executeSql(StatementImpl.java:590)
at org.teiid.jdbc.StatementImpl.executeSql(StatementImpl.java:420)
at org.teiid.jdbc.StatementImpl.executeQuery(StatementImpl.java:351)
at com.ibm.vdb.TeiidFile.showVdbInfo(TeiidFile.java:181)
at com.ibm.vdb.TeiidFile.main(TeiidFile.java:205)
Caused by: org.teiid.core.TeiidProcessingException: TEIID30504 Remote org.teiid.core.TeiidProcessingException: TEIID30504 web-connector: Error reading the file https://s3.amazonaws.com/bucket1/price.csv; The response code returned 403. Details: <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>InvalidAccessKeyId</Code><Message>The AWS Access Key Id you provided does not exist in our records.</Message><AWSAccessKeyId>minioadmin</AWSAccessKeyId><RequestId>EB7421ECD8EF9B88</RequestId><HostId>m3fHokjXC5shrV+y+2vIHl7KNcr46RvoKRXuZ8TnU4fiZyi1XG6rT9DiTu6yRZfg328QGcr2w+A=</HostId></Error>
at org.teiid.dqp.internal.process.DataTierTupleSource.exceptionOccurred(DataTierTupleSource.java:397)
at org.teiid.dqp.internal.process.DataTierTupleSource.nextTuple(DataTierTupleSource.java:157)
at org.teiid.query.processor.relational.AccessNode.nextBatchDirect(AccessNode.java:401)
at org.teiid.query.processor.relational.RelationalNode.nextBatch(RelationalNode.java:277)
at org.teiid.query.processor.relational.ProjectNode.nextBatchDirect(ProjectNode.java:146)
at org.teiid.query.processor.relational.RelationalNode.nextBatch(RelationalNode.java:277)
at org.teiid.query.processor.BatchCollector.collectTuples(BatchCollector.java:160)
at org.teiid.query.processor.relational.SourceState.prefetch(SourceState.java:207)
at org.teiid.query.processor.relational.SourceState.rowCountLE(SourceState.java:154)
at org.teiid.query.processor.relational.JoinNode.nextBatchDirectInternal(JoinNode.java:252)
at org.teiid.query.processor.relational.JoinNode.nextBatchDirect(JoinNode.java:195)
at org.teiid.query.processor.relational.RelationalNode.nextBatch(RelationalNode.java:277)
at org.teiid.query.processor.relational.ProjectNode.nextBatchDirect(ProjectNode.java:146)
at org.teiid.query.processor.relational.RelationalNode.nextBatch(RelationalNode.java:277)
at org.teiid.query.processor.relational.RelationalPlan.nextBatch(RelationalPlan.java:139)
at org.teiid.query.processor.QueryProcessor.nextBatchDirect(QueryProcessor.java:147)
at org.teiid.query.processor.QueryProcessor.nextBatch(QueryProcessor.java:110)
at org.teiid.query.processor.BatchCollector.collectTuples(BatchCollector.java:160)
at org.teiid.query.processor.BatchCollector.collectTuples(BatchCollector.java:142)
at org.teiid.dqp.internal.process.RequestWorkItem.processMore(RequestWorkItem.java:492)
at org.teiid.dqp.internal.process.RequestWorkItem.process(RequestWorkItem.java:362)
at org.teiid.dqp.internal.process.AbstractWorkItem.run(AbstractWorkItem.java:43)
at org.teiid.dqp.internal.process.RequestWorkItem.run(RequestWorkItem.java:285)
at org.teiid.dqp.internal.process.DQPWorkContext.runInContext(DQPWorkContext.java:281)
at org.teiid.dqp.internal.process.ThreadReuseExecutor$RunnableWrapper.run(ThreadReuseExecutor.java:124)
at org.teiid.dqp.internal.process.ThreadReuseExecutor$2.run(ThreadReuseExecutor.java:212)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.teiid.core.TeiidException: Remote org.teiid.translator.TranslatorException: Error reading the file https://s3.amazonaws.com/bucket1/price.csv; The response code returned 403. Details: <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>InvalidAccessKeyId</Code><Message>The AWS Access Key Id you provided does not exist in our records.</Message><AWSAccessKeyId>minioadmin</AWSAccessKeyId><RequestId>EB7421ECD8EF9B88</RequestId><HostId>m3fHokjXC5shrV+y+2vIHl7KNcr46RvoKRXuZ8TnU4fiZyi1XG6rT9DiTu6yRZfg328QGcr2w+A=</HostId></Error>
at org.teiid.translator.amazon.s3.S3ProcedureExecution.execute(S3ProcedureExecution.java:114)
at org.teiid.dqp.internal.datamgr.ConnectorWorkItem.execute(ConnectorWorkItem.java:402)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.teiid.dqp.internal.datamgr.ConnectorManager$1.invoke(ConnectorManager.java:228)
at com.sun.proxy.$Proxy43.execute(Unknown Source)
at org.teiid.dqp.internal.process.DataTierTupleSource.getResults(DataTierTupleSource.java:302)
at org.teiid.dqp.internal.process.DataTierTupleSource$1.call(DataTierTupleSource.java:108)
at org.teiid.dqp.internal.process.DataTierTupleSource$1.call(DataTierTupleSource.java:104)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.teiid.dqp.internal.process.FutureWork.run(FutureWork.java:59)
... 6 more
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
[View Less]
5 years