August 2020 - teiid-issues - Jboss List Archives

[JBoss JIRA] (TEIID-6020) How to specify different config properties while connecting to FTP using Teiid Resource Adapter

by rahul gholap (Jira)

rahul gholap created TEIID-6020: ----------------------------------- Summary: How to specify different config properties while connecting to FTP using Teiid Resource Adapter Key: TEIID-6020 URL: https://issues.redhat.com/browse/TEIID-6020 Project: Teiid Issue Type: Feature Request Reporter: rahul gholap Assignee: Steven Hawkins We are trying to connect FTP and SFTP files using org.teiid.resource.adapter.ftp.FtpManagedConnectionFactory adapter.While configuring Resource Adapter,below options are available in config properties. Host,Port,ParentDirectory,UserName,Password,Protocol. Lets say JDBC url for connecting to SFTP file is like below. jdbc:text:sftp://\{{host}}: \{{port}}(a)\{{ip}}//\{{file_path}}/\{{file_name}}.txt?odbcSchemaFile=\{{schema_file}}.sch;fileExtension=txt;delayedClose=0;refreshInterval=0 My Questions are below . 1)how to specify schema file and actual filepath?. 2)If file is delimited then how to specify delimiter? 3)If parent directory contain multiple files then how to specify file that we want to connect? 4)In case of header false and header true , which config properties need to be added and how? -- This message was sent by Atlassian Jira (v7.13.8#713008)

3 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-6018) jayway json processing logic returns single object values as just maps, not JSONObject

by Steven Hawkins (Jira)

[ https://issues.redhat.com/browse/TEIID-6018?page=com.atlassian.jira.plugi... ] Steven Hawkins commented on TEIID-6018: --------------------------------------- It looks an odd result as well when dealing with something like a column path of $..prop and json that looks like {"a":1, "prop":2}. Instead of just [2], I'm seeing [null,2]. > jayway json processing logic returns single object values as just maps, not JSONObject > -------------------------------------------------------------------------------------- > > Key: TEIID-6018 > URL: https://issues.redhat.com/browse/TEIID-6018 > Project: Teiid > Issue Type: Bug > Components: Query Engine > Reporter: Steven Hawkins > Assignee: Steven Hawkins > Priority: Major > Fix For: 15.0.1, 14.0.2, 16.0 > > Original Estimate: 2 hours > Time Spent: 2 hours, 30 minutes > Remaining Estimate: 0 minutes > > When a value is returned from the context read for arrays it's an instanceof JSONArray. There was an expectation that for objects it was JSONObject. Instead it's just a hashmap leading to an invalid string conversion. -- This message was sent by Atlassian Jira (v7.13.8#713008)

3 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-6018) jayway json processing logic returns single object values as just maps, not JSONObject

by Steven Hawkins (Jira)

[ https://issues.redhat.com/browse/TEIID-6018?focusedWorklogId=12451914&pag... ] Steven Hawkins logged work on TEIID-6018: ----------------------------------------- Author: Steven Hawkins Created on: 13/Aug/20 7:03 PM Start Date: 13/Aug/20 7:02 PM Worklog Time Spent: 2 hours, 30 minutes Work Description: Time spent on this issue and finding a workaround for Nelson Issue Time Tracking ------------------- Remaining Estimate: 0 minutes (was: 2 hours) Time Spent: 2 hours, 30 minutes Worklog Id: (was: 12451914) > jayway json processing logic returns single object values as just maps, not JSONObject > -------------------------------------------------------------------------------------- > > Key: TEIID-6018 > URL: https://issues.redhat.com/browse/TEIID-6018 > Project: Teiid > Issue Type: Bug > Components: Query Engine > Reporter: Steven Hawkins > Assignee: Steven Hawkins > Priority: Major > Fix For: 15.0.1, 14.0.2, 16.0 > > Original Estimate: 2 hours > Time Spent: 2 hours, 30 minutes > Remaining Estimate: 0 minutes > > When a value is returned from the context read for arrays it's an instanceof JSONArray. There was an expectation that for objects it was JSONObject. Instead it's just a hashmap leading to an invalid string conversion. -- This message was sent by Atlassian Jira (v7.13.8#713008)

3 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-6018) jayway json processing logic returns single object values as just maps, not JSONObject

by Steven Hawkins (Jira)

[ https://issues.redhat.com/browse/TEIID-6018?page=com.atlassian.jira.plugi... ] Steven Hawkins resolved TEIID-6018. ----------------------------------- Fix Version/s: 14.0.2 Resolution: Done Checked for a map in the method to produce the stringified json. > jayway json processing logic returns single object values as just maps, not JSONObject > -------------------------------------------------------------------------------------- > > Key: TEIID-6018 > URL: https://issues.redhat.com/browse/TEIID-6018 > Project: Teiid > Issue Type: Bug > Components: Query Engine > Reporter: Steven Hawkins > Assignee: Steven Hawkins > Priority: Major > Fix For: 15.0.1, 14.0.2, 16.0 > > Original Estimate: 2 hours > Remaining Estimate: 2 hours > > When a value is returned from the context read for arrays it's an instanceof JSONArray. There was an expectation that for objects it was JSONObject. Instead it's just a hashmap leading to an invalid string conversion. -- This message was sent by Atlassian Jira (v7.13.8#713008)

3 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-6018) jayway json processing logic returns single object values as just maps, not JSONObject

by Steven Hawkins (Jira)

[ https://issues.redhat.com/browse/TEIID-6018?page=com.atlassian.jira.plugi... ] Steven Hawkins updated TEIID-6018: ---------------------------------- Component/s: Query Engine > jayway json processing logic returns single object values as just maps, not JSONObject > -------------------------------------------------------------------------------------- > > Key: TEIID-6018 > URL: https://issues.redhat.com/browse/TEIID-6018 > Project: Teiid > Issue Type: Bug > Components: Query Engine > Reporter: Steven Hawkins > Assignee: Steven Hawkins > Priority: Major > Fix For: 15.0.1, 16.0 > > Original Estimate: 2 hours > Remaining Estimate: 2 hours > > When a value is returned from the context read for arrays it's an instanceof JSONArray. There was an expectation that for objects it was JSONObject. Instead it's just a hashmap leading to an invalid string conversion. -- This message was sent by Atlassian Jira (v7.13.8#713008)

3 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-6019) Normalize and expand file api and file glob search

by Steven Hawkins (Jira)

Steven Hawkins created TEIID-6019: ------------------------------------- Summary: Normalize and expand file api and file glob search Key: TEIID-6019 URL: https://issues.redhat.com/browse/TEIID-6019 Project: Teiid Issue Type: Enhancement Components: Misc. Connectors Reporter: Steven Hawkins Assignee: Steven Hawkins The file sources need to have consistent implementation of getFiles and should provide additional information such as the full file path and if it's a directory. For example currently it's possible to return directories in the file source if you specify a non-glob directory path, but that information is not exposed. The glob paths should all support multiple, not just a single * in the file name. At a first glance we may not implement these changes for ftp, but just throw appropriate exceptions - it currently only knows about returning a single file. It would be possible to eventually add logic for that though as it supports similar file visiting logic as Java. So the focus will be on file, hdfs, and s3 - which [~invinci_1] is already looking into. -- This message was sent by Atlassian Jira (v7.13.8#713008)

3 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-6017) Not able to connect GCP bucket using S3 translator

by Nayan Bija (Jira)

[ https://issues.redhat.com/browse/TEIID-6017?page=com.atlassian.jira.plugi... ] Nayan Bija commented on TEIID-6017: ----------------------------------- Thanks Ramesh for quick reply. Yes, I have already added admin user. As you suggested, I will try to download squirrel SQL and test the connection with vdb Thank you. > Not able to connect GCP bucket using S3 translator > -------------------------------------------------- > > Key: TEIID-6017 > URL: https://issues.redhat.com/browse/TEIID-6017 > Project: Teiid > Issue Type: Feature Request > Reporter: Nayan Bija > Assignee: Steven Hawkins > Priority: Major > > As suggested in the ticket TEIID-6015 > We have tried to connect the GCP bucket using the S3 translator(not amazon-s3). > As mentioned, S3 doesn't support google authentication, > so we have created access key and secret key of Google bucket by logging into the GCP accoudnt. > We have followed below steps to create access key and secret key. > _*Storage->Setting->INTEROPERABILITY-> Service account HMAC->Create a key for service account"*_ > > We have also created below adapter file and VDB but still, we are not able to connect to GCP. > > <resource-adapter id="amazon-s3-custom"> > <module slot="main" id="org.jboss.teiid.resource-adapter.s3"/> > <transaction-support>NoTransaction</transaction-support> > <connection-definitions> > <connection-definition class-name="org.teiid.resource.adapter.s3.S3ManagedConnectionFactory" jndi-name="java:/s3DS" enabled="true" use-java-context="true" pool-name="teiid-s3-ds"> > <config-property name="bucket">abc</config-property> > <config-property name="endpoint">[https://storage.googleapis.com|https://storage.googleapis.com/]</config-property> > <config-property name="secretKey">xxx</config-property> > <config-property name="accessKey">xxx</config-property> > </connection-definition> > </connection-definitions> > </resource-adapter> > > > > VDB > ---- > > <?xml version="1.0"?> > <vdb name="gcp" version="1"> > <connection-type>BY_VERSION</connection-type> > <model name="s3"> > <source name="web-connector" translator-name="amazon-s3-custom" connection-jndi-name="java:/s3DS"/> > </model> > <translator name="amazon-s3-custom" type="amazon-s3"> > <property name="accesskey" value="xxx"/> > <property name="secretkey" value="xxx"/> > <property name="bucket" value="abc"/> > </translator> > </vdb > > > as we tried to connect we are getting below error. > > *_"_*_org.teiid.jdbc.TeiidSQLException: TEIID20018 Unable to find a component used authenticate on to Teiid_*_"_* > > In the above configuration, where should we mention the File name? > As I have read the properties in the documentation, I could see bucket property, where we can add a bucket name. but where should we add the file name which is present in the bucket? > > Could you please help us with it? > > > > -- This message was sent by Atlassian Jira (v7.13.8#713008)

3 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-6018) jayway json processing logic returns single object values as just maps, not JSONObject

by Steven Hawkins (Jira)

Steven Hawkins created TEIID-6018: ------------------------------------- Summary: jayway json processing logic returns single object values as just maps, not JSONObject Key: TEIID-6018 URL: https://issues.redhat.com/browse/TEIID-6018 Project: Teiid Issue Type: Bug Reporter: Steven Hawkins Assignee: Steven Hawkins Fix For: 15.0.1, 16.0 When a value is returned from the context read for arrays it's an instanceof JSONArray. There was an expectation that for objects it was JSONObject. Instead it's just a hashmap leading to an invalid string conversion. -- This message was sent by Atlassian Jira (v7.13.8#713008)

3 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-6017) Not able to connect GCP bucket using S3 translator

by Ramesh Reddy (Jira)

[ https://issues.redhat.com/browse/TEIID-6017?page=com.atlassian.jira.plugi... ] Ramesh Reddy commented on TEIID-6017: ------------------------------------- Did you create a user in Teiid? there is script called "bin/add-user.sh" run it first and add "application realm" user. Then using that user, using a JDBC client tool like `[Squirrel|[http://squirrel-sql.sourceforge.net/]]` connect to the VDB "dummy" and make sure that works. The JDBC url will be something like "jdbc:teiid:dummy@mm://loacalhost:31000" Once this works, then we will look into your GCP bucket based VDB > Not able to connect GCP bucket using S3 translator > -------------------------------------------------- > > Key: TEIID-6017 > URL: https://issues.redhat.com/browse/TEIID-6017 > Project: Teiid > Issue Type: Feature Request > Reporter: Nayan Bija > Assignee: Steven Hawkins > Priority: Major > > As suggested in the ticket TEIID-6015 > We have tried to connect the GCP bucket using the S3 translator(not amazon-s3). > As mentioned, S3 doesn't support google authentication, > so we have created access key and secret key of Google bucket by logging into the GCP accoudnt. > We have followed below steps to create access key and secret key. > _*Storage->Setting->INTEROPERABILITY-> Service account HMAC->Create a key for service account"*_ > > We have also created below adapter file and VDB but still, we are not able to connect to GCP. > > <resource-adapter id="amazon-s3-custom"> > <module slot="main" id="org.jboss.teiid.resource-adapter.s3"/> > <transaction-support>NoTransaction</transaction-support> > <connection-definitions> > <connection-definition class-name="org.teiid.resource.adapter.s3.S3ManagedConnectionFactory" jndi-name="java:/s3DS" enabled="true" use-java-context="true" pool-name="teiid-s3-ds"> > <config-property name="bucket">abc</config-property> > <config-property name="endpoint">[https://storage.googleapis.com|https://storage.googleapis.com/]</config-property> > <config-property name="secretKey">xxx</config-property> > <config-property name="accessKey">xxx</config-property> > </connection-definition> > </connection-definitions> > </resource-adapter> > > > > VDB > ---- > > <?xml version="1.0"?> > <vdb name="gcp" version="1"> > <connection-type>BY_VERSION</connection-type> > <model name="s3"> > <source name="web-connector" translator-name="amazon-s3-custom" connection-jndi-name="java:/s3DS"/> > </model> > <translator name="amazon-s3-custom" type="amazon-s3"> > <property name="accesskey" value="xxx"/> > <property name="secretkey" value="xxx"/> > <property name="bucket" value="abc"/> > </translator> > </vdb > > > as we tried to connect we are getting below error. > > *_"_*_org.teiid.jdbc.TeiidSQLException: TEIID20018 Unable to find a component used authenticate on to Teiid_*_"_* > > In the above configuration, where should we mention the File name? > As I have read the properties in the documentation, I could see bucket property, where we can add a bucket name. but where should we add the file name which is present in the bucket? > > Could you please help us with it? > > > > -- This message was sent by Atlassian Jira (v7.13.8#713008)

3 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-6017) Not able to connect GCP bucket using S3 translator

by Nayan Bija (Jira)

[ https://issues.redhat.com/browse/TEIID-6017?page=com.atlassian.jira.plugi... ] Nayan Bija commented on TEIID-6017: ----------------------------------- Hi, Thanks for your suggestion, We are using Teiid 15.0.0 version and downloaded it from below link. [https://oss.sonatype.org/service/local/repositories/releases/content/org/...] And I am also making changes step by step. First I have configured the adapter by using Google Bucket secret key. then I have created a above dummy VDB just to check the connectivity with the Google Storage. But connection is not estabilishing. hence I am not getting what exactly missing here. Whether there is a problem in adapter or I am following wrong approch. I have done below things till now. # Download Teiid 15.0.0 # Created bucket on Google Storage. # Created a access key and secret key # Created a adapter by adding google access key and secret key # Created a dummy VDB to test connection. # Trying to make connction. Could you please convey me if I am missing anything? > Not able to connect GCP bucket using S3 translator > -------------------------------------------------- > > Key: TEIID-6017 > URL: https://issues.redhat.com/browse/TEIID-6017 > Project: Teiid > Issue Type: Feature Request > Reporter: Nayan Bija > Assignee: Steven Hawkins > Priority: Major > > As suggested in the ticket TEIID-6015 > We have tried to connect the GCP bucket using the S3 translator(not amazon-s3). > As mentioned, S3 doesn't support google authentication, > so we have created access key and secret key of Google bucket by logging into the GCP accoudnt. > We have followed below steps to create access key and secret key. > _*Storage->Setting->INTEROPERABILITY-> Service account HMAC->Create a key for service account"*_ > > We have also created below adapter file and VDB but still, we are not able to connect to GCP. > > <resource-adapter id="amazon-s3-custom"> > <module slot="main" id="org.jboss.teiid.resource-adapter.s3"/> > <transaction-support>NoTransaction</transaction-support> > <connection-definitions> > <connection-definition class-name="org.teiid.resource.adapter.s3.S3ManagedConnectionFactory" jndi-name="java:/s3DS" enabled="true" use-java-context="true" pool-name="teiid-s3-ds"> > <config-property name="bucket">abc</config-property> > <config-property name="endpoint">[https://storage.googleapis.com|https://storage.googleapis.com/]</config-property> > <config-property name="secretKey">xxx</config-property> > <config-property name="accessKey">xxx</config-property> > </connection-definition> > </connection-definitions> > </resource-adapter> > > > > VDB > ---- > > <?xml version="1.0"?> > <vdb name="gcp" version="1"> > <connection-type>BY_VERSION</connection-type> > <model name="s3"> > <source name="web-connector" translator-name="amazon-s3-custom" connection-jndi-name="java:/s3DS"/> > </model> > <translator name="amazon-s3-custom" type="amazon-s3"> > <property name="accesskey" value="xxx"/> > <property name="secretkey" value="xxx"/> > <property name="bucket" value="abc"/> > </translator> > </vdb > > > as we tried to connect we are getting below error. > > *_"_*_org.teiid.jdbc.TeiidSQLException: TEIID20018 Unable to find a component used authenticate on to Teiid_*_"_* > > In the above configuration, where should we mention the File name? > As I have read the properties in the documentation, I could see bucket property, where we can add a bucket name. but where should we add the file name which is present in the bucket? > > Could you please help us with it? > > > > -- This message was sent by Atlassian Jira (v7.13.8#713008)

3 years, 8 months

1
0
0 / 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

teiid-issues August 2020