[teiid-issues] [JBoss JIRA] (TEIID-6015) GCP Storage(bucket) connection with Teiid.

Nayan Bija (Jira) issues at jboss.org
Tue Aug 11 12:18:00 EDT 2020


     [ https://issues.redhat.com/browse/TEIID-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Nayan Bija updated TEIID-6015:
------------------------------
    Description: 
We need to read CSV file from the GCP storage file using SQL query.

we are following the steps mentioned in - TEIID-5940  ticket.

As suggested by [~shawkins] we have updated or Teiid to 15.x version.

and we are using Amazon-s3 translator to read the csv file from the GCP bucket.

As suggested in the ticket,  we have configured oauth2 in GCP and configured the secret key and refresh token in security deomain. .

 

<security-domain name="oauth2-security">
 <authentication>
 <login-module code="org.teiid.jboss.oauth.OAuth20LoginModule" flag="required" module="org.jboss.teiid.web.cxf">
 <module-option name="client-id" value="xxx.apps.googleusercontent.com"/>
 <module-option name="client-secret" value="xxx"/>
 <module-option name="refresh-token" value="xx"/>
 <module-option name="access-token-uri" value="https://www.googleapis.com/oauth2/v3/token"/>
 </login-module>
 </authentication>
 </security-domain>
 </security-domains>

 

we have also created resource adaptor.

<resource-adapter id="amazon-s3-custom">
 <resource-adapter id="amazon-s3-custom">
 <module slot="main" id="org.jboss.teiid.resource-adapter.s3"/> 
 <transaction-support>NoTransaction</transaction-support>
 <connection-definitions> 
 <connection-definition class-name="org.teiid.resource.adapter.s3.S3ManagedConnectionFactory"  jndi-name="java:/s3DS"  enabled="true"  use-java-context="true"  pool-name="teiid-s3-ds"> 
    <config-property name="endpoint">[https://storage.googleapis.com|https://storage.googleapis.com/]</config-property>
    <config-property name="bucket">abc</config-property>
    <config-property name="accessKey">xxxx.apps.googleusercontent.com</config-property> 
    <config-property name="secretKey">xxxx</config-property>

</connection-definition> </connection-definitions>
 </resource-adapter>

 

Could you please review the changes and suggest to us if we are missing anything.

and also let us inform

1. how to test the above configuration from the Teiid console whether it is connected to GCP bucket or not

2. how to create VDB and datasource from the above configuration.

 

 

 

 

 

 

 

 

 

  was:
We need to read CSV  file from  GCP storage file using SQL query.

we are following the steps maitined in - TEIID-5940  ticket.

As suggest by [~shawkins] we have updated or Teiid to 15.x version.

and we are using Amazon-s3 translator to read the csv file from the GCP bucket.

As suggested in the ticket,  we have configured oauth2 in GCP and configured secret key and refresh token in security deomain. .

 

<security-domain name="oauth2-security">
 <authentication>
 <login-module code="org.teiid.jboss.oauth.OAuth20LoginModule" flag="required" module="org.jboss.teiid.web.cxf">
 <module-option name="client-id" value="xxx.apps.googleusercontent.com"/>
 <module-option name="client-secret" value="xxx"/>
 <module-option name="refresh-token" value="xx"/>
 <module-option name="access-token-uri" value="https://www.googleapis.com/oauth2/v3/token"/>
 </login-module>
 </authentication>
 </security-domain>
 </security-domains>

 

we have also created resource adaptor.

<resource-adapter id="amazon-s3-custom">
 <resource-adapter id="amazon-s3-custom">
 <module slot="main" id="org.jboss.teiid.resource-adapter.s3"/> 
 <transaction-support>NoTransaction</transaction-support>
 <connection-definitions> 
 <connection-definition class-name="org.teiid.resource.adapter.s3.S3ManagedConnectionFactory"  jndi-name="java:/s3DS"  enabled="true"  use-java-context="true"  pool-name="teiid-s3-ds"> 
    <config-property name="endpoint">[https://storage.googleapis.com|https://storage.googleapis.com/]</config-property>
    <config-property name="bucket">abc</config-property>
    <config-property name="accessKey">xxxx.apps.googleusercontent.com</config-property> 
    <config-property name="secretKey">xxxx</config-property>

</connection-definition> </connection-definitions>
 </resource-adapter>

 

Could you please review the changes and suggest us if we are missing anything.

and also let us inform

1. how to test the above configuration from the Teiid console whether it is connected to GCP bucket or not

2. how to create VDB and datasource from above configuration.

 

 

 

 

 

 

 

 

 



> GCP Storage(bucket) connection with Teiid.
> ------------------------------------------
>
>                 Key: TEIID-6015
>                 URL: https://issues.redhat.com/browse/TEIID-6015
>             Project: Teiid
>          Issue Type: Feature Request
>            Reporter: Nayan Bija
>            Assignee: Steven Hawkins
>            Priority: Major
>
> We need to read CSV file from the GCP storage file using SQL query.
> we are following the steps mentioned in - TEIID-5940  ticket.
> As suggested by [~shawkins] we have updated or Teiid to 15.x version.
> and we are using Amazon-s3 translator to read the csv file from the GCP bucket.
> As suggested in the ticket,  we have configured oauth2 in GCP and configured the secret key and refresh token in security deomain. .
>  
> <security-domain name="oauth2-security">
>  <authentication>
>  <login-module code="org.teiid.jboss.oauth.OAuth20LoginModule" flag="required" module="org.jboss.teiid.web.cxf">
>  <module-option name="client-id" value="xxx.apps.googleusercontent.com"/>
>  <module-option name="client-secret" value="xxx"/>
>  <module-option name="refresh-token" value="xx"/>
>  <module-option name="access-token-uri" value="https://www.googleapis.com/oauth2/v3/token"/>
>  </login-module>
>  </authentication>
>  </security-domain>
>  </security-domains>
>  
> we have also created resource adaptor.
> <resource-adapter id="amazon-s3-custom">
>  <resource-adapter id="amazon-s3-custom">
>  <module slot="main" id="org.jboss.teiid.resource-adapter.s3"/> 
>  <transaction-support>NoTransaction</transaction-support>
>  <connection-definitions> 
>  <connection-definition class-name="org.teiid.resource.adapter.s3.S3ManagedConnectionFactory"  jndi-name="java:/s3DS"  enabled="true"  use-java-context="true"  pool-name="teiid-s3-ds"> 
>     <config-property name="endpoint">[https://storage.googleapis.com|https://storage.googleapis.com/]</config-property>
>     <config-property name="bucket">abc</config-property>
>     <config-property name="accessKey">xxxx.apps.googleusercontent.com</config-property> 
>     <config-property name="secretKey">xxxx</config-property>
> </connection-definition> </connection-definitions>
>  </resource-adapter>
>  
> Could you please review the changes and suggest to us if we are missing anything.
> and also let us inform
> 1. how to test the above configuration from the Teiid console whether it is connected to GCP bucket or not
> 2. how to create VDB and datasource from the above configuration.
>  
>  
>  
>  
>  
>  
>  
>  
>  



--
This message was sent by Atlassian Jira
(v7.13.8#713008)



More information about the teiid-issues mailing list