[JBoss JIRA] (TEIID-6020) How to specify different config properties while connecting to FTP using Teiid Resource Adapter
by rahul gholap (Jira)
rahul gholap created TEIID-6020:
-----------------------------------
Summary: How to specify different config properties while connecting to FTP using Teiid Resource Adapter
Key: TEIID-6020
URL: https://issues.redhat.com/browse/TEIID-6020
Project: Teiid
Issue Type: Feature Request
Reporter: rahul gholap
Assignee: Steven Hawkins
We are trying to connect FTP and SFTP files using org.teiid.…
[View More]resource.adapter.ftp.FtpManagedConnectionFactory adapter.While configuring Resource Adapter,below options are available in config properties.
Host,Port,ParentDirectory,UserName,Password,Protocol.
Lets say JDBC url for connecting to SFTP file is like below.
jdbc:text:sftp://\{{host}}: \{{port}}(a)\{{ip}}//\{{file_path}}/\{{file_name}}.txt?odbcSchemaFile=\{{schema_file}}.sch;fileExtension=txt;delayedClose=0;refreshInterval=0
My Questions are below .
1)how to specify schema file and actual filepath?.
2)If file is delimited then how to specify delimiter?
3)If parent directory contain multiple files then how to specify file that we want to connect?
4)In case of header false and header true , which config properties need to be added and how?
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
[View Less]
4 years, 6 months
[JBoss JIRA] (TEIID-6018) jayway json processing logic returns single object values as just maps, not JSONObject
by Steven Hawkins (Jira)
[ https://issues.redhat.com/browse/TEIID-6018?page=com.atlassian.jira.plugi... ]
Steven Hawkins commented on TEIID-6018:
---------------------------------------
It looks an odd result as well when dealing with something like a column path of $..prop and json that looks like {"a":1, "prop":2}. Instead of just [2], I'm seeing [null,2].
> jayway json processing logic returns single object values as just maps, not JSONObject
> --------------------------------------------------------------…
[View More]------------------------
>
> Key: TEIID-6018
> URL: https://issues.redhat.com/browse/TEIID-6018
> Project: Teiid
> Issue Type: Bug
> Components: Query Engine
> Reporter: Steven Hawkins
> Assignee: Steven Hawkins
> Priority: Major
> Fix For: 15.0.1, 14.0.2, 16.0
>
> Original Estimate: 2 hours
> Time Spent: 2 hours, 30 minutes
> Remaining Estimate: 0 minutes
>
> When a value is returned from the context read for arrays it's an instanceof JSONArray. There was an expectation that for objects it was JSONObject. Instead it's just a hashmap leading to an invalid string conversion.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
[View Less]
4 years, 6 months
[JBoss JIRA] (TEIID-6018) jayway json processing logic returns single object values as just maps, not JSONObject
by Steven Hawkins (Jira)
[ https://issues.redhat.com/browse/TEIID-6018?focusedWorklogId=12451914&pag... ]
Steven Hawkins logged work on TEIID-6018:
-----------------------------------------
Author: Steven Hawkins
Created on: 13/Aug/20 7:03 PM
Start Date: 13/Aug/20 7:02 PM
Worklog Time Spent: 2 hours, 30 minutes
Work Description: Time spent on this issue and finding a workaround for Nelson
Issue Time Tracking
-------------------
Remaining Estimate: 0 minutes …
[View More] (was: 2 hours)
Time Spent: 2 hours, 30 minutes
Worklog Id: (was: 12451914)
> jayway json processing logic returns single object values as just maps, not JSONObject
> --------------------------------------------------------------------------------------
>
> Key: TEIID-6018
> URL: https://issues.redhat.com/browse/TEIID-6018
> Project: Teiid
> Issue Type: Bug
> Components: Query Engine
> Reporter: Steven Hawkins
> Assignee: Steven Hawkins
> Priority: Major
> Fix For: 15.0.1, 14.0.2, 16.0
>
> Original Estimate: 2 hours
> Time Spent: 2 hours, 30 minutes
> Remaining Estimate: 0 minutes
>
> When a value is returned from the context read for arrays it's an instanceof JSONArray. There was an expectation that for objects it was JSONObject. Instead it's just a hashmap leading to an invalid string conversion.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
[View Less]
4 years, 6 months
[JBoss JIRA] (TEIID-6019) Normalize and expand file api and file glob search
by Steven Hawkins (Jira)
Steven Hawkins created TEIID-6019:
-------------------------------------
Summary: Normalize and expand file api and file glob search
Key: TEIID-6019
URL: https://issues.redhat.com/browse/TEIID-6019
Project: Teiid
Issue Type: Enhancement
Components: Misc. Connectors
Reporter: Steven Hawkins
Assignee: Steven Hawkins
The file sources need to have consistent implementation of getFiles and …
[View More]should provide additional information such as the full file path and if it's a directory. For example currently it's possible to return directories in the file source if you specify a non-glob directory path, but that information is not exposed.
The glob paths should all support multiple, not just a single * in the file name.
At a first glance we may not implement these changes for ftp, but just throw appropriate exceptions - it currently only knows about returning a single file. It would be possible to eventually add logic for that though as it supports similar file visiting logic as Java.
So the focus will be on file, hdfs, and s3 - which [~invinci_1] is already looking into.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
[View Less]
4 years, 6 months
[JBoss JIRA] (TEIID-6017) Not able to connect GCP bucket using S3 translator
by Nayan Bija (Jira)
[ https://issues.redhat.com/browse/TEIID-6017?page=com.atlassian.jira.plugi... ]
Nayan Bija commented on TEIID-6017:
-----------------------------------
Thanks Ramesh for quick reply.
Yes, I have already added admin user.
As you suggested, I will try to download squirrel SQL and test the connection with vdb
Thank you.
> Not able to connect GCP bucket using S3 translator
> --------------------------------------------------
>
> Key: TEIID-6017
> …
[View More] URL: https://issues.redhat.com/browse/TEIID-6017
> Project: Teiid
> Issue Type: Feature Request
> Reporter: Nayan Bija
> Assignee: Steven Hawkins
> Priority: Major
>
> As suggested in the ticket TEIID-6015
> We have tried to connect the GCP bucket using the S3 translator(not amazon-s3).
> As mentioned, S3 doesn't support google authentication,
> so we have created access key and secret key of Google bucket by logging into the GCP accoudnt.
> We have followed below steps to create access key and secret key.
> _*Storage->Setting->INTEROPERABILITY-> Service account HMAC->Create a key for service account"*_
>
> We have also created below adapter file and VDB but still, we are not able to connect to GCP.
>
> <resource-adapter id="amazon-s3-custom">
> <module slot="main" id="org.jboss.teiid.resource-adapter.s3"/>
> <transaction-support>NoTransaction</transaction-support>
> <connection-definitions>
> <connection-definition class-name="org.teiid.resource.adapter.s3.S3ManagedConnectionFactory" jndi-name="java:/s3DS" enabled="true" use-java-context="true" pool-name="teiid-s3-ds">
> <config-property name="bucket">abc</config-property>
> <config-property name="endpoint">[https://storage.googleapis.com|https://storage.googleapis.com/]</config-property>
> <config-property name="secretKey">xxx</config-property>
> <config-property name="accessKey">xxx</config-property>
> </connection-definition>
> </connection-definitions>
> </resource-adapter>
>
>
>
> VDB
> ----
>
> <?xml version="1.0"?>
> <vdb name="gcp" version="1">
> <connection-type>BY_VERSION</connection-type>
> <model name="s3">
> <source name="web-connector" translator-name="amazon-s3-custom" connection-jndi-name="java:/s3DS"/>
> </model>
> <translator name="amazon-s3-custom" type="amazon-s3">
> <property name="accesskey" value="xxx"/>
> <property name="secretkey" value="xxx"/>
> <property name="bucket" value="abc"/>
> </translator>
> </vdb
>
>
> as we tried to connect we are getting below error.
>
> *_"_*_org.teiid.jdbc.TeiidSQLException: TEIID20018 Unable to find a component used authenticate on to Teiid_*_"_*
>
> In the above configuration, where should we mention the File name?
> As I have read the properties in the documentation, I could see bucket property, where we can add a bucket name. but where should we add the file name which is present in the bucket?
>
> Could you please help us with it?
>
>
>
>
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
[View Less]
4 years, 6 months
[JBoss JIRA] (TEIID-6017) Not able to connect GCP bucket using S3 translator
by Ramesh Reddy (Jira)
[ https://issues.redhat.com/browse/TEIID-6017?page=com.atlassian.jira.plugi... ]
Ramesh Reddy commented on TEIID-6017:
-------------------------------------
Did you create a user in Teiid? there is script called "bin/add-user.sh" run it first and add "application realm" user. Then using that user, using a JDBC client tool like `[Squirrel|[http://squirrel-sql.sourceforge.net/]]` connect to the VDB "dummy" and make sure that works. The JDBC url will be something like "jdbc:teiid:dummy@mm://…
[View More]loacalhost:31000"
Once this works, then we will look into your GCP bucket based VDB
> Not able to connect GCP bucket using S3 translator
> --------------------------------------------------
>
> Key: TEIID-6017
> URL: https://issues.redhat.com/browse/TEIID-6017
> Project: Teiid
> Issue Type: Feature Request
> Reporter: Nayan Bija
> Assignee: Steven Hawkins
> Priority: Major
>
> As suggested in the ticket TEIID-6015
> We have tried to connect the GCP bucket using the S3 translator(not amazon-s3).
> As mentioned, S3 doesn't support google authentication,
> so we have created access key and secret key of Google bucket by logging into the GCP accoudnt.
> We have followed below steps to create access key and secret key.
> _*Storage->Setting->INTEROPERABILITY-> Service account HMAC->Create a key for service account"*_
>
> We have also created below adapter file and VDB but still, we are not able to connect to GCP.
>
> <resource-adapter id="amazon-s3-custom">
> <module slot="main" id="org.jboss.teiid.resource-adapter.s3"/>
> <transaction-support>NoTransaction</transaction-support>
> <connection-definitions>
> <connection-definition class-name="org.teiid.resource.adapter.s3.S3ManagedConnectionFactory" jndi-name="java:/s3DS" enabled="true" use-java-context="true" pool-name="teiid-s3-ds">
> <config-property name="bucket">abc</config-property>
> <config-property name="endpoint">[https://storage.googleapis.com|https://storage.googleapis.com/]</config-property>
> <config-property name="secretKey">xxx</config-property>
> <config-property name="accessKey">xxx</config-property>
> </connection-definition>
> </connection-definitions>
> </resource-adapter>
>
>
>
> VDB
> ----
>
> <?xml version="1.0"?>
> <vdb name="gcp" version="1">
> <connection-type>BY_VERSION</connection-type>
> <model name="s3">
> <source name="web-connector" translator-name="amazon-s3-custom" connection-jndi-name="java:/s3DS"/>
> </model>
> <translator name="amazon-s3-custom" type="amazon-s3">
> <property name="accesskey" value="xxx"/>
> <property name="secretkey" value="xxx"/>
> <property name="bucket" value="abc"/>
> </translator>
> </vdb
>
>
> as we tried to connect we are getting below error.
>
> *_"_*_org.teiid.jdbc.TeiidSQLException: TEIID20018 Unable to find a component used authenticate on to Teiid_*_"_*
>
> In the above configuration, where should we mention the File name?
> As I have read the properties in the documentation, I could see bucket property, where we can add a bucket name. but where should we add the file name which is present in the bucket?
>
> Could you please help us with it?
>
>
>
>
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
[View Less]
4 years, 6 months
[JBoss JIRA] (TEIID-6017) Not able to connect GCP bucket using S3 translator
by Nayan Bija (Jira)
[ https://issues.redhat.com/browse/TEIID-6017?page=com.atlassian.jira.plugi... ]
Nayan Bija commented on TEIID-6017:
-----------------------------------
Hi,
Thanks for your suggestion,
We are using Teiid 15.0.0 version and downloaded it from below link.
[https://oss.sonatype.org/service/local/repositories/releases/content/org/...]
And I am also making changes step by step.
First I have configured the adapter by using Google Bucket secret key.
then I have created a above …
[View More]dummy VDB just to check the connectivity with the Google Storage.
But connection is not estabilishing. hence I am not getting what exactly missing here.
Whether there is a problem in adapter or I am following wrong approch.
I have done below things till now.
# Download Teiid 15.0.0
# Created bucket on Google Storage.
# Created a access key and secret key
# Created a adapter by adding google access key and secret key
# Created a dummy VDB to test connection.
# Trying to make connction.
Could you please convey me if I am missing anything?
> Not able to connect GCP bucket using S3 translator
> --------------------------------------------------
>
> Key: TEIID-6017
> URL: https://issues.redhat.com/browse/TEIID-6017
> Project: Teiid
> Issue Type: Feature Request
> Reporter: Nayan Bija
> Assignee: Steven Hawkins
> Priority: Major
>
> As suggested in the ticket TEIID-6015
> We have tried to connect the GCP bucket using the S3 translator(not amazon-s3).
> As mentioned, S3 doesn't support google authentication,
> so we have created access key and secret key of Google bucket by logging into the GCP accoudnt.
> We have followed below steps to create access key and secret key.
> _*Storage->Setting->INTEROPERABILITY-> Service account HMAC->Create a key for service account"*_
>
> We have also created below adapter file and VDB but still, we are not able to connect to GCP.
>
> <resource-adapter id="amazon-s3-custom">
> <module slot="main" id="org.jboss.teiid.resource-adapter.s3"/>
> <transaction-support>NoTransaction</transaction-support>
> <connection-definitions>
> <connection-definition class-name="org.teiid.resource.adapter.s3.S3ManagedConnectionFactory" jndi-name="java:/s3DS" enabled="true" use-java-context="true" pool-name="teiid-s3-ds">
> <config-property name="bucket">abc</config-property>
> <config-property name="endpoint">[https://storage.googleapis.com|https://storage.googleapis.com/]</config-property>
> <config-property name="secretKey">xxx</config-property>
> <config-property name="accessKey">xxx</config-property>
> </connection-definition>
> </connection-definitions>
> </resource-adapter>
>
>
>
> VDB
> ----
>
> <?xml version="1.0"?>
> <vdb name="gcp" version="1">
> <connection-type>BY_VERSION</connection-type>
> <model name="s3">
> <source name="web-connector" translator-name="amazon-s3-custom" connection-jndi-name="java:/s3DS"/>
> </model>
> <translator name="amazon-s3-custom" type="amazon-s3">
> <property name="accesskey" value="xxx"/>
> <property name="secretkey" value="xxx"/>
> <property name="bucket" value="abc"/>
> </translator>
> </vdb
>
>
> as we tried to connect we are getting below error.
>
> *_"_*_org.teiid.jdbc.TeiidSQLException: TEIID20018 Unable to find a component used authenticate on to Teiid_*_"_*
>
> In the above configuration, where should we mention the File name?
> As I have read the properties in the documentation, I could see bucket property, where we can add a bucket name. but where should we add the file name which is present in the bucket?
>
> Could you please help us with it?
>
>
>
>
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
[View Less]
4 years, 6 months