[JBoss JIRA] (TEIID-4452) Pushdown SQL/XML
by Steven Hawkins (Jira)
[ https://issues.redhat.com/browse/TEIID-4452?page=com.atlassian.jira.plugi... ]
Steven Hawkins resolved TEIID-4452.
-----------------------------------
Resolution: Out of Date
Bulk resolving older issues as out of date.
> Pushdown SQL/XML
> ----------------
>
> Key: TEIID-4452
> URL: https://issues.redhat.com/browse/TEIID-4452
> Project: Teiid
> Issue Type: Enhancement
> Components: JDBC Connector
> Affects Versions: 9.x
> Reporter: Tom Arnold
> Priority: Major
> Fix For: Backlog
>
>
> It would be helpful to pushdown SQL/XML functions for JDBC databases that support them.
> Databases:
> - Oracle
> - Postgres
> Functions:
> - XMLELEMENT
> - XMLATTRIBUTES
> - XMLAGG
> - XMLCONCAT
> We have an application that uses these functions and we support Oracle, Postgres, and Teiid (to integrate external data sources). Here's an example query generated by this application:
> {code:xml}
> select
> "ITEMS"."ITEM_ID" "ITEM_ID",
> (
> select xmlelement (
> name "attributes",
> xmlagg(
> xmlelement(
> name "attribute",
> xmlattributes(
> "ITEM_ATTRIBUTES"."ATTR_NAME" as "name",
> "ITEM_ATTRIBUTES"."ATTR_VALUE" as "value"
> )
> )
> )
> )
> from "ITEM_ATTRIBUTES" "ITEM_ATTRIBUTES"
> where (
> "ITEMS"."ITEM_ID" = "ITEM_ATTRIBUTES"."ITEM_ID"
> )
> ) "ITEM_ATTRIBUTES"
> {code}
> {code}
> ITEM_ID ITEM_ATTRIBUTES
> 3 <attributes><attribute name="foo" value="bar"></attribute><attribute name="baz" value="blah"></attribute></attributes>
> 4 <attributes><attribute name="foo" value="123"></attribute><attribute name="baz" value="456"></attribute></attributes>
> {code}
> When we are using Teiid queries like this do not work well because they cannot be pushed down, so we get N-many queries (one per row) and the query ends up taking much longer than if performed directly against Oracle/Postgres.
> Since SQL/XML is standard and supported by both Oracle/Postgres it would be good if queries like this could be pushed in their entirety so that there would be no performance difference between going through Teiid and native.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
5 years, 7 months
[JBoss JIRA] (TEIID-6013) From where can I download Amazon-s3 translator to read CSV file.
by Nayan Bija (Jira)
[ https://issues.redhat.com/browse/TEIID-6013?page=com.atlassian.jira.plugi... ]
Nayan Bija edited comment on TEIID-6013 at 8/10/20 10:57 AM:
-------------------------------------------------------------
So is there any way to download the amazon-s3 translator?
If you know the download link , could you please provide us?
was (Author: nayan.bijagare):
So is there any way to download the amazon-s3 translator?
If you know the download link , could you provide us?
> From where can I download Amazon-s3 translator to read CSV file.
> ----------------------------------------------------------------
>
> Key: TEIID-6013
> URL: https://issues.redhat.com/browse/TEIID-6013
> Project: Teiid
> Issue Type: Feature Request
> Reporter: Nayan Bija
> Assignee: Steven Hawkins
> Priority: Major
>
> We are referring below link to establish a connection with Google storage using amazon-s3 translator.
> [http://teiid.github.io/teiid-documents/master/content/reference/r_amazon-...]
>
> It is mentioned in the link that
> "amzaon-s3 translator is *deprecated*. Please use an s3 source with an appropriate translator such as file or excel"
>
> We tried to find out the translator on Amazon S3 official website as well as we googled, but couldn't find the appropriate translator for CSV and txt file.
>
> Could you please provide us a link of s3-translator which supports CSV as well as a text file?
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
5 years, 7 months
[JBoss JIRA] (TEIID-6013) From where can I download Amazon-s3 translator to read CSV file.
by Nayan Bija (Jira)
[ https://issues.redhat.com/browse/TEIID-6013?page=com.atlassian.jira.plugi... ]
Nayan Bija edited comment on TEIID-6013 at 8/10/20 10:57 AM:
-------------------------------------------------------------
So is there any way to download the amazon-s3 translator?
If you know the download link , could you provide us?
was (Author: nayan.bijagare):
So is there any way to download the amazon-s3 translator?
If you know the download link , can you provide us?
> From where can I download Amazon-s3 translator to read CSV file.
> ----------------------------------------------------------------
>
> Key: TEIID-6013
> URL: https://issues.redhat.com/browse/TEIID-6013
> Project: Teiid
> Issue Type: Feature Request
> Reporter: Nayan Bija
> Assignee: Steven Hawkins
> Priority: Major
>
> We are referring below link to establish a connection with Google storage using amazon-s3 translator.
> [http://teiid.github.io/teiid-documents/master/content/reference/r_amazon-...]
>
> It is mentioned in the link that
> "amzaon-s3 translator is *deprecated*. Please use an s3 source with an appropriate translator such as file or excel"
>
> We tried to find out the translator on Amazon S3 official website as well as we googled, but couldn't find the appropriate translator for CSV and txt file.
>
> Could you please provide us a link of s3-translator which supports CSV as well as a text file?
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
5 years, 7 months
[JBoss JIRA] (TEIID-6013) From where can I download Amazon-s3 translator to read CSV file.
by Nayan Bija (Jira)
[ https://issues.redhat.com/browse/TEIID-6013?page=com.atlassian.jira.plugi... ]
Nayan Bija updated TEIID-6013:
------------------------------
Description:
We are referring below link to establish a connection with Google storage using amazon-s3 translator.
[http://teiid.github.io/teiid-documents/master/content/reference/r_amazon-...]
It is mentioned in the link that
"amzaon-s3 translator is *deprecated*. Please use an s3 source with an appropriate translator such as file or excel"
We tried to find out the translator on Amazon S3 official website as well as we googled, but couldn't find the appropriate translator for CSV and txt file.
Could you please provide us a link of s3-translator which supports CSV as well as a text file?
> From where can I download Amazon-s3 translator to read CSV file.
> ----------------------------------------------------------------
>
> Key: TEIID-6013
> URL: https://issues.redhat.com/browse/TEIID-6013
> Project: Teiid
> Issue Type: Feature Request
> Reporter: Nayan Bija
> Assignee: Steven Hawkins
> Priority: Major
>
> We are referring below link to establish a connection with Google storage using amazon-s3 translator.
> [http://teiid.github.io/teiid-documents/master/content/reference/r_amazon-...]
>
> It is mentioned in the link that
> "amzaon-s3 translator is *deprecated*. Please use an s3 source with an appropriate translator such as file or excel"
>
> We tried to find out the translator on Amazon S3 official website as well as we googled, but couldn't find the appropriate translator for CSV and txt file.
>
> Could you please provide us a link of s3-translator which supports CSV as well as a text file?
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
5 years, 7 months
[JBoss JIRA] (TEIID-6004) Getting and error while configuring oAuth2 with Teiid.
by Steven Hawkins (Jira)
[ https://issues.redhat.com/browse/TEIID-6004?page=com.atlassian.jira.plugi... ]
Steven Hawkins commented on TEIID-6004:
---------------------------------------
> So I just have a question without using this function can we write a query. just like we write for other databases like MYSQL, SQLServer, BigQuery, etc.
The role of TEXTTABLE is to convert from the raw file to tabular output. There is currently not a translator that will do that automatically. Once you have the sql that defines the file processing, you can wrap that in a view, possibly adding materialization, and then access that view as you would any other table/view.
> Getting and error while configuring oAuth2 with Teiid.
> ------------------------------------------------------
>
> Key: TEIID-6004
> URL: https://issues.redhat.com/browse/TEIID-6004
> Project: Teiid
> Issue Type: Bug
> Components: Build/Kits
> Reporter: Nayan Bija
> Assignee: Steven Hawkins
> Priority: Major
> Fix For: 15.0, 13.1.2, 14.0.1
>
> Original Estimate: 2 hours
> Time Spent: 1 hour, 30 minutes
> Remaining Estimate: 30 minutes
>
> We need to read the Flat file from Google storage(bucket). so that we are following the steps mention in this ticket TEIID-5940".
> So it is mentioned that we will have to make web service data source and will have to configure google credentials into it.
> So to create a datasource below steps has been provided but getting and error in final step.
> Refered below URL for steps.
> [http://teiid.github.io/teiid-documents/master/content/admin/OAuth_Authent...]
>
> C:\Softwares\teiid-wildfly-14.0.0-server1\teiid-14.0.0\bin>teiid-oauth-util.bat
> Select type of OAuth authentication
> 1) OAuth 1.0A
> 2) OAuth 2.0
> 3) OAuth 2.0 - Facebook
> 2
> === OAuth 2.0 Workflow ===
> Enter the Client ID = dfgfdg-dfgdfg.apps.googleusercontent.com
> Enter the Client Secret = dfgd-obggh_unnng_SDD
> Enter the User Authorization URL = https://accounts.google.com/o/oauth2/auth
> Enter scope (hit enter for none) = profile
> Enter callback URL (default: urn:ietf:wg:oauth:2.0:oob) =
> Cut & Paste the URL in a web browser, and Authticate
> Authorize URL = https://accounts.google.com/o/oauth2/auth?client_id=fdfdsfdsdfsdfsdf
> Enter Token Secret (Auth Code, Pin) from previous step = 4/2QdsfdsfEZvSxCK5yEPNJCYcbdsfsd
> Enter the Access Token URL = https://www.googleapis.com/oauth2/v3/token
> Jul 30, 2020 5:29:04 PM org.apache.cxf.configuration.jsse.SSLUtils loadDefaultKeyManagers
> WARNING: Default key managers cannot be initialized: Password must not be null
> java.security.UnrecoverableKeyException: Password must not be null
> at sun.security.provider.JavaKeyStore.engineGetKey(JavaKeyStore.java:124)
> at sun.security.provider.JavaKeyStore$JKS.engineGetKey(JavaKeyStore.java:55)
> at java.security.KeyStore.getKey(KeyStore.java:1011)
> at sun.security.ssl.SunX509KeyManagerImpl.<init>(SunX509KeyManagerImpl.java:133)
> at sun.security.ssl.KeyManagerFactoryImpl$SunX509.engineInit(KeyManagerFactoryImpl.java:70)
> at javax.net.ssl.KeyManagerFactory.init(KeyManagerFactory.java:256)
> at org.apache.cxf.configuration.jsse.SSLUtils.loadDefaultKeyManagers(SSLUtils.java:116)
> at org.apache.cxf.configuration.jsse.SSLUtils.getDefaultKeyStoreManagers(SSLUtils.java:89)
> at org.apache.cxf.transport.https.SSLUtils.getSSLContext(SSLUtils.java:75)
> at org.apache.cxf.transport.https.HttpsURLConnectionFactory.decorateWithTLS(HttpsURLConnectionFactory.java:144)
> at org.apache.cxf.transport.https.HttpsURLConnectionFactory.createConnection(HttpsURLConnectionFactory.java:101
> at org.apache.cxf.transport.http.URLConnectionHTTPConduit.createConnection(URLConnectionHTTPConduit.java:121)
> at org.apache.cxf.transport.http.URLConnectionHTTPConduit.setupConnection(URLConnectionHTTPConduit.java:125)
> at org.apache.cxf.transport.http.asyncclient.AsyncHTTPConduit.setupConnection(AsyncHTTPConduit.java:190)
> at org.apache.cxf.transport.http.HTTPConduit.prepare(HTTPConduit.java:505)
> at org.apache.cxf.interceptor.MessageSenderInterceptor.handleMessage(MessageSenderInterceptor.java:47)
> at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308)
> at org.apache.cxf.jaxrs.client.AbstractClient.doRunInterceptorChain(AbstractClient.java:701)
> at org.apache.cxf.jaxrs.client.WebClient.doChainedInvocation(WebClient.java:1086)
> at org.apache.cxf.jaxrs.client.WebClient.doInvoke(WebClient.java:932)
> at org.apache.cxf.jaxrs.client.WebClient.doInvoke(WebClient.java:901)
> at org.apache.cxf.jaxrs.client.WebClient.form(WebClient.java:434)
> at org.apache.cxf.rs.security.oauth2.client.OAuthClientUtils.getAccessToken(OAuthClientUtils.java:301)
> at org.apache.cxf.rs.security.oauth2.client.OAuthClientUtils.getAccessToken(OAuthClientUtils.java:225)
> at org.teiid.oauth.OAuthUtil.oauth20Flow(OAuthUtil.java:158)
> at org.teiid.oauth.OAuthUtil.main(OAuthUtil.java:76)
> at org.jboss.modules.Module.run(Module.java:352)
> at org.jboss.modules.Module.run(Module.java:320)
> at org.jboss.modules.Main.main(Main.java:593)
> Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/cxf/jaxrs/json/basic/JsonMapObjectReaderWriter
> at org.apache.cxf.rs.security.oauth2.provider.OAuthJSONProvider.readJSONResponse(OAuthJSONProvider.java:307)
> at org.apache.cxf.rs.security.oauth2.client.OAuthClientUtils.getAccessToken(OAuthClientUtils.java:306)
> at org.apache.cxf.rs.security.oauth2.client.OAuthClientUtils.getAccessToken(OAuthClientUtils.java:225)
> at org.teiid.oauth.OAuthUtil.oauth20Flow(OAuthUtil.java:158)
> at org.teiid.oauth.OAuthUtil.main(OAuthUtil.java:76)
> at org.jboss.modules.Module.run(Module.java:352)
> at org.jboss.modules.Module.run(Module.java:320)
> at org.jboss.modules.Main.main(Main.java:593)
> Caused by: java.lang.ClassNotFoundException: org.apache.cxf.jaxrs.json.basic.JsonMapObjectReaderWriter from [Module "or
> 0.0\modules,C:\Softwares\teiid-wildfly-14.0.0-server1\teiid-14.0.0\modules\system\layers\dv,C:\Softwares\teiid-wildfly-
> at org.jboss.modules.ModuleClassLoader.findClass(ModuleClassLoader.java:255)
> at org.jboss.modules.ConcurrentClassLoader.performLoadClassUnchecked(ConcurrentClassLoader.java:410)
> at org.jboss.modules.ConcurrentClassLoader.performLoadClass(ConcurrentClassLoader.java:398)
> at org.jboss.modules.ConcurrentClassLoader.loadClass(ConcurrentClassLoader.java:116)
> ... 8 more
> Press any key to continue . . .
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
5 years, 7 months