[JBoss JIRA] (TEIIDDES-3228) Getting and error while configuring oAuth2 with Teiid.
by Nayan Bija (Jira)
[ https://issues.redhat.com/browse/TEIIDDES-3228?page=com.atlassian.jira.pl... ]
Nayan Bija updated TEIIDDES-3228:
---------------------------------
Description:
We need to read the Flat file from Google storage(bucket). so that we are following the steps mention in this ticket TEIID-5940".
So it is mentioned that we will have to make web service data source and will have to configure google credentials into it.
So to create a datasource below steps has been provided but getting and error in final step.
Refered below URL for steps.
[http://teiid.github.io/teiid-documents/master/content/admin/OAuth_Authent...]
C:\Softwares\teiid-wildfly-14.0.0-server1\teiid-14.0.0\bin>teiid-oauth-util.bat
Select type of OAuth authentication
1) OAuth 1.0A
2) OAuth 2.0
3) OAuth 2.0 - Facebook
2
=== OAuth 2.0 Workflow ===
Enter the Client ID = dfgfdg-dfgdfg.apps.googleusercontent.com
Enter the Client Secret = dfgd-obggh_unnng_SDD
Enter the User Authorization URL = https://accounts.google.com/o/oauth2/auth
Enter scope (hit enter for none) = profile
Enter callback URL (default: urn:ietf:wg:oauth:2.0:oob) =
Cut & Paste the URL in a web browser, and Authticate
Authorize URL = https://accounts.google.com/o/oauth2/auth?client_id=fdfdsfdsdfsdfsdf
Enter Token Secret (Auth Code, Pin) from previous step = 4/2QdsfdsfEZvSxCK5yEPNJCYcbdsfsd
Enter the Access Token URL = https://www.googleapis.com/oauth2/v3/token
Jul 30, 2020 5:29:04 PM org.apache.cxf.configuration.jsse.SSLUtils loadDefaultKeyManagers
WARNING: Default key managers cannot be initialized: Password must not be null
java.security.UnrecoverableKeyException: Password must not be null
at sun.security.provider.JavaKeyStore.engineGetKey(JavaKeyStore.java:124)
at sun.security.provider.JavaKeyStore$JKS.engineGetKey(JavaKeyStore.java:55)
at java.security.KeyStore.getKey(KeyStore.java:1011)
at sun.security.ssl.SunX509KeyManagerImpl.<init>(SunX509KeyManagerImpl.java:133)
at sun.security.ssl.KeyManagerFactoryImpl$SunX509.engineInit(KeyManagerFactoryImpl.java:70)
at javax.net.ssl.KeyManagerFactory.init(KeyManagerFactory.java:256)
at org.apache.cxf.configuration.jsse.SSLUtils.loadDefaultKeyManagers(SSLUtils.java:116)
at org.apache.cxf.configuration.jsse.SSLUtils.getDefaultKeyStoreManagers(SSLUtils.java:89)
at org.apache.cxf.transport.https.SSLUtils.getSSLContext(SSLUtils.java:75)
at org.apache.cxf.transport.https.HttpsURLConnectionFactory.decorateWithTLS(HttpsURLConnectionFactory.java:144)
at org.apache.cxf.transport.https.HttpsURLConnectionFactory.createConnection(HttpsURLConnectionFactory.java:101
at org.apache.cxf.transport.http.URLConnectionHTTPConduit.createConnection(URLConnectionHTTPConduit.java:121)
at org.apache.cxf.transport.http.URLConnectionHTTPConduit.setupConnection(URLConnectionHTTPConduit.java:125)
at org.apache.cxf.transport.http.asyncclient.AsyncHTTPConduit.setupConnection(AsyncHTTPConduit.java:190)
at org.apache.cxf.transport.http.HTTPConduit.prepare(HTTPConduit.java:505)
at org.apache.cxf.interceptor.MessageSenderInterceptor.handleMessage(MessageSenderInterceptor.java:47)
at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308)
at org.apache.cxf.jaxrs.client.AbstractClient.doRunInterceptorChain(AbstractClient.java:701)
at org.apache.cxf.jaxrs.client.WebClient.doChainedInvocation(WebClient.java:1086)
at org.apache.cxf.jaxrs.client.WebClient.doInvoke(WebClient.java:932)
at org.apache.cxf.jaxrs.client.WebClient.doInvoke(WebClient.java:901)
at org.apache.cxf.jaxrs.client.WebClient.form(WebClient.java:434)
at org.apache.cxf.rs.security.oauth2.client.OAuthClientUtils.getAccessToken(OAuthClientUtils.java:301)
at org.apache.cxf.rs.security.oauth2.client.OAuthClientUtils.getAccessToken(OAuthClientUtils.java:225)
at org.teiid.oauth.OAuthUtil.oauth20Flow(OAuthUtil.java:158)
at org.teiid.oauth.OAuthUtil.main(OAuthUtil.java:76)
at org.jboss.modules.Module.run(Module.java:352)
at org.jboss.modules.Module.run(Module.java:320)
at org.jboss.modules.Main.main(Main.java:593)
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/cxf/jaxrs/json/basic/JsonMapObjectReaderWriter
at org.apache.cxf.rs.security.oauth2.provider.OAuthJSONProvider.readJSONResponse(OAuthJSONProvider.java:307)
at org.apache.cxf.rs.security.oauth2.client.OAuthClientUtils.getAccessToken(OAuthClientUtils.java:306)
at org.apache.cxf.rs.security.oauth2.client.OAuthClientUtils.getAccessToken(OAuthClientUtils.java:225)
at org.teiid.oauth.OAuthUtil.oauth20Flow(OAuthUtil.java:158)
at org.teiid.oauth.OAuthUtil.main(OAuthUtil.java:76)
at org.jboss.modules.Module.run(Module.java:352)
at org.jboss.modules.Module.run(Module.java:320)
at org.jboss.modules.Main.main(Main.java:593)
Caused by: java.lang.ClassNotFoundException: org.apache.cxf.jaxrs.json.basic.JsonMapObjectReaderWriter from [Module "or
0.0\modules,C:\Softwares\teiid-wildfly-14.0.0-server1\teiid-14.0.0\modules\system\layers\dv,C:\Softwares\teiid-wildfly-
at org.jboss.modules.ModuleClassLoader.findClass(ModuleClassLoader.java:255)
at org.jboss.modules.ConcurrentClassLoader.performLoadClassUnchecked(ConcurrentClassLoader.java:410)
at org.jboss.modules.ConcurrentClassLoader.performLoadClass(ConcurrentClassLoader.java:398)
at org.jboss.modules.ConcurrentClassLoader.loadClass(ConcurrentClassLoader.java:116)
... 8 more
Press any key to continue . . .
> Getting and error while configuring oAuth2 with Teiid.
> ------------------------------------------------------
>
> Key: TEIIDDES-3228
> URL: https://issues.redhat.com/browse/TEIIDDES-3228
> Project: Teiid Designer
> Issue Type: Feature Request
> Reporter: Nayan Bija
> Priority: Major
>
> We need to read the Flat file from Google storage(bucket). so that we are following the steps mention in this ticket TEIID-5940".
> So it is mentioned that we will have to make web service data source and will have to configure google credentials into it.
> So to create a datasource below steps has been provided but getting and error in final step.
> Refered below URL for steps.
> [http://teiid.github.io/teiid-documents/master/content/admin/OAuth_Authent...]
>
> C:\Softwares\teiid-wildfly-14.0.0-server1\teiid-14.0.0\bin>teiid-oauth-util.bat
> Select type of OAuth authentication
> 1) OAuth 1.0A
> 2) OAuth 2.0
> 3) OAuth 2.0 - Facebook
> 2
> === OAuth 2.0 Workflow ===
> Enter the Client ID = dfgfdg-dfgdfg.apps.googleusercontent.com
> Enter the Client Secret = dfgd-obggh_unnng_SDD
> Enter the User Authorization URL = https://accounts.google.com/o/oauth2/auth
> Enter scope (hit enter for none) = profile
> Enter callback URL (default: urn:ietf:wg:oauth:2.0:oob) =
> Cut & Paste the URL in a web browser, and Authticate
> Authorize URL = https://accounts.google.com/o/oauth2/auth?client_id=fdfdsfdsdfsdfsdf
> Enter Token Secret (Auth Code, Pin) from previous step = 4/2QdsfdsfEZvSxCK5yEPNJCYcbdsfsd
> Enter the Access Token URL = https://www.googleapis.com/oauth2/v3/token
> Jul 30, 2020 5:29:04 PM org.apache.cxf.configuration.jsse.SSLUtils loadDefaultKeyManagers
> WARNING: Default key managers cannot be initialized: Password must not be null
> java.security.UnrecoverableKeyException: Password must not be null
> at sun.security.provider.JavaKeyStore.engineGetKey(JavaKeyStore.java:124)
> at sun.security.provider.JavaKeyStore$JKS.engineGetKey(JavaKeyStore.java:55)
> at java.security.KeyStore.getKey(KeyStore.java:1011)
> at sun.security.ssl.SunX509KeyManagerImpl.<init>(SunX509KeyManagerImpl.java:133)
> at sun.security.ssl.KeyManagerFactoryImpl$SunX509.engineInit(KeyManagerFactoryImpl.java:70)
> at javax.net.ssl.KeyManagerFactory.init(KeyManagerFactory.java:256)
> at org.apache.cxf.configuration.jsse.SSLUtils.loadDefaultKeyManagers(SSLUtils.java:116)
> at org.apache.cxf.configuration.jsse.SSLUtils.getDefaultKeyStoreManagers(SSLUtils.java:89)
> at org.apache.cxf.transport.https.SSLUtils.getSSLContext(SSLUtils.java:75)
> at org.apache.cxf.transport.https.HttpsURLConnectionFactory.decorateWithTLS(HttpsURLConnectionFactory.java:144)
> at org.apache.cxf.transport.https.HttpsURLConnectionFactory.createConnection(HttpsURLConnectionFactory.java:101
> at org.apache.cxf.transport.http.URLConnectionHTTPConduit.createConnection(URLConnectionHTTPConduit.java:121)
> at org.apache.cxf.transport.http.URLConnectionHTTPConduit.setupConnection(URLConnectionHTTPConduit.java:125)
> at org.apache.cxf.transport.http.asyncclient.AsyncHTTPConduit.setupConnection(AsyncHTTPConduit.java:190)
> at org.apache.cxf.transport.http.HTTPConduit.prepare(HTTPConduit.java:505)
> at org.apache.cxf.interceptor.MessageSenderInterceptor.handleMessage(MessageSenderInterceptor.java:47)
> at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:308)
> at org.apache.cxf.jaxrs.client.AbstractClient.doRunInterceptorChain(AbstractClient.java:701)
> at org.apache.cxf.jaxrs.client.WebClient.doChainedInvocation(WebClient.java:1086)
> at org.apache.cxf.jaxrs.client.WebClient.doInvoke(WebClient.java:932)
> at org.apache.cxf.jaxrs.client.WebClient.doInvoke(WebClient.java:901)
> at org.apache.cxf.jaxrs.client.WebClient.form(WebClient.java:434)
> at org.apache.cxf.rs.security.oauth2.client.OAuthClientUtils.getAccessToken(OAuthClientUtils.java:301)
> at org.apache.cxf.rs.security.oauth2.client.OAuthClientUtils.getAccessToken(OAuthClientUtils.java:225)
> at org.teiid.oauth.OAuthUtil.oauth20Flow(OAuthUtil.java:158)
> at org.teiid.oauth.OAuthUtil.main(OAuthUtil.java:76)
> at org.jboss.modules.Module.run(Module.java:352)
> at org.jboss.modules.Module.run(Module.java:320)
> at org.jboss.modules.Main.main(Main.java:593)
> Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/cxf/jaxrs/json/basic/JsonMapObjectReaderWriter
> at org.apache.cxf.rs.security.oauth2.provider.OAuthJSONProvider.readJSONResponse(OAuthJSONProvider.java:307)
> at org.apache.cxf.rs.security.oauth2.client.OAuthClientUtils.getAccessToken(OAuthClientUtils.java:306)
> at org.apache.cxf.rs.security.oauth2.client.OAuthClientUtils.getAccessToken(OAuthClientUtils.java:225)
> at org.teiid.oauth.OAuthUtil.oauth20Flow(OAuthUtil.java:158)
> at org.teiid.oauth.OAuthUtil.main(OAuthUtil.java:76)
> at org.jboss.modules.Module.run(Module.java:352)
> at org.jboss.modules.Module.run(Module.java:320)
> at org.jboss.modules.Main.main(Main.java:593)
> Caused by: java.lang.ClassNotFoundException: org.apache.cxf.jaxrs.json.basic.JsonMapObjectReaderWriter from [Module "or
> 0.0\modules,C:\Softwares\teiid-wildfly-14.0.0-server1\teiid-14.0.0\modules\system\layers\dv,C:\Softwares\teiid-wildfly-
> at org.jboss.modules.ModuleClassLoader.findClass(ModuleClassLoader.java:255)
> at org.jboss.modules.ConcurrentClassLoader.performLoadClassUnchecked(ConcurrentClassLoader.java:410)
> at org.jboss.modules.ConcurrentClassLoader.performLoadClass(ConcurrentClassLoader.java:398)
> at org.jboss.modules.ConcurrentClassLoader.loadClass(ConcurrentClassLoader.java:116)
> ... 8 more
> Press any key to continue . . .
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
3 years, 8 months
[JBoss JIRA] (TEIIDDES-3227) Facing an issue while fetching records from CSV file with multiple character(~|*) delimiter.
by Steven Hawkins (Jira)
[ https://issues.redhat.com/browse/TEIIDDES-3227?page=com.atlassian.jira.pl... ]
Steven Hawkins commented on TEIIDDES-3227:
------------------------------------------
I'm not sure there's much we can do here. Your issue also seems to be specifically with the HXTT driver and not related to Teiid or Teiid Designer in any particular way. Please note that Teiid Designer is not actively maintained.
> Facing an issue while fetching records from CSV file with multiple character(~|*) delimiter.
> --------------------------------------------------------------------------------------------
>
> Key: TEIIDDES-3227
> URL: https://issues.redhat.com/browse/TEIIDDES-3227
> Project: Teiid Designer
> Issue Type: Feature Request
> Reporter: Nayan Bija
> Priority: Major
>
> Hi,
> We are fetching data from CSV file(without header) using HXTT driver.
> It is properly fetching records with the single charecter delimiter but not working with multiple charector delimiter.
> We are having delimited csv file without having headers which contains "*|~" charector as a delimiter.
> We have written below schema file for it.
> Schema file
> ========
> [target.csv]
> ColNameHeader=False
> Format=Delimited("~|*")
> CharacterSet=ANSI
> COL1=first_name varchar
> COL2=last_name varchar
> COL3=city varchar
>
> Data
> ====
> Sachin~|*Tendulkar~|*Mumbai
> Saurav~|*Ganguly~|*Kolkata
>
> so when we perform select operation on it "|*" character is appended to result.
>
> Result of select query
> ===============
>
> |\|*Sachin|\|*Tendulkar|\|*Mumbai|
>
> Datasource in standalone-teiid.xml
> =======================
>
> <datasource jndi-name="java:/FileDS20200713211347079" pool-name="FileDS20200713211347079">
> <connection-url>jdbc:text:sftp://abc:efg@10.10.10.10:22/home/abc/target.csv?odbcSchemaFile=target.sch;fileExtension=csv;delayedClose=0;refreshInterval=0</connection-url>
> <driver>textfile</driver>
> <pool>
> <max-pool-size>20</max-pool-size>
> </pool>
> </datasource>
>
>
>
> As I read in some blogs, they suggested to change the "*CharacterSet*" from *ANSI* to *UTF-8* in schema file(.sch file).
> So I tried to change it to UTF-8 as well as *65001* still getting same result
> *refered link - [https://www.ibm.com/support/pages/special-characters-data-imported-through-odbc-import-using-microsoft-text-driver-are-not-displayed-correctly-admin-client]*
> we also tried to add";charSet=UTF-8" in datasource URL but still its giving same kind of result.
> Could you please suggest some solution for this issue.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
3 years, 8 months
[JBoss JIRA] (TEIIDDES-3227) Facing an issue while fetching records from CSV file with multiple character(~|*) delimiter.
by Nayan Bija (Jira)
[ https://issues.redhat.com/browse/TEIIDDES-3227?page=com.atlassian.jira.pl... ]
Nayan Bija commented on TEIIDDES-3227:
--------------------------------------
Could you please help us with it? and up to when it will get resolved?
> Facing an issue while fetching records from CSV file with multiple character(~|*) delimiter.
> --------------------------------------------------------------------------------------------
>
> Key: TEIIDDES-3227
> URL: https://issues.redhat.com/browse/TEIIDDES-3227
> Project: Teiid Designer
> Issue Type: Feature Request
> Reporter: Nayan Bija
> Priority: Major
>
> Hi,
> We are fetching data from CSV file(without header) using HXTT driver.
> It is properly fetching records with the single charecter delimiter but not working with multiple charector delimiter.
> We are having delimited csv file without having headers which contains "*|~" charector as a delimiter.
> We have written below schema file for it.
> Schema file
> ========
> [target.csv]
> ColNameHeader=False
> Format=Delimited("~|*")
> CharacterSet=ANSI
> COL1=first_name varchar
> COL2=last_name varchar
> COL3=city varchar
>
> Data
> ====
> Sachin~|*Tendulkar~|*Mumbai
> Saurav~|*Ganguly~|*Kolkata
>
> so when we perform select operation on it "|*" character is appended to result.
>
> Result of select query
> ===============
>
> |\|*Sachin|\|*Tendulkar|\|*Mumbai|
>
> Datasource in standalone-teiid.xml
> =======================
>
> <datasource jndi-name="java:/FileDS20200713211347079" pool-name="FileDS20200713211347079">
> <connection-url>jdbc:text:sftp://abc:efg@10.10.10.10:22/home/abc/target.csv?odbcSchemaFile=target.sch;fileExtension=csv;delayedClose=0;refreshInterval=0</connection-url>
> <driver>textfile</driver>
> <pool>
> <max-pool-size>20</max-pool-size>
> </pool>
> </datasource>
>
>
>
> As I read in some blogs, they suggested to change the "*CharacterSet*" from *ANSI* to *UTF-8* in schema file(.sch file).
> So I tried to change it to UTF-8 as well as *65001* still getting same result
> *refered link - [https://www.ibm.com/support/pages/special-characters-data-imported-through-odbc-import-using-microsoft-text-driver-are-not-displayed-correctly-admin-client]*
> we also tried to add";charSet=UTF-8" in datasource URL but still its giving same kind of result.
> Could you please suggest some solution for this issue.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
3 years, 8 months
[JBoss JIRA] (TEIIDDES-3227) Facing an issue while fetching records from CSV file with multiple character(~|*) delimiter.
by Nayan Bija (Jira)
[ https://issues.redhat.com/browse/TEIIDDES-3227?page=com.atlassian.jira.pl... ]
Nayan Bija updated TEIIDDES-3227:
---------------------------------
Summary: Facing an issue while fetching records from CSV file with multiple character(~|*) delimiter. (was: Facing an issue with multiple character delimiter in CSV File.)
> Facing an issue while fetching records from CSV file with multiple character(~|*) delimiter.
> --------------------------------------------------------------------------------------------
>
> Key: TEIIDDES-3227
> URL: https://issues.redhat.com/browse/TEIIDDES-3227
> Project: Teiid Designer
> Issue Type: Feature Request
> Reporter: Nayan Bija
> Priority: Major
>
> Hi,
> We are fetching data from CSV file(without header) using HXTT driver.
> It is properly fetching records with the single charecter delimiter but not working with multiple charector delimiter.
> We are having delimited csv file without having headers which contains "*|~" charector as a delimiter.
> We have written below schema file for it.
> Schema file
> ========
> [target.csv]
> ColNameHeader=False
> Format=Delimited("~|*")
> CharacterSet=ANSI
> COL1=first_name varchar
> COL2=last_name varchar
> COL3=city varchar
>
> Data
> ====
> Sachin~|*Tendulkar~|*Mumbai
> Saurav~|*Ganguly~|*Kolkata
>
> so when we perform select operation on it "|*" character is appended to result.
>
> Result of select query
> ===============
>
> |\|*Sachin|\|*Tendulkar|\|*Mumbai|
>
> Datasource in standalone-teiid.xml
> =======================
>
> <datasource jndi-name="java:/FileDS20200713211347079" pool-name="FileDS20200713211347079">
> <connection-url>jdbc:text:sftp://abc:efg@10.10.10.10:22/home/abc/target.csv?odbcSchemaFile=target.sch;fileExtension=csv;delayedClose=0;refreshInterval=0</connection-url>
> <driver>textfile</driver>
> <pool>
> <max-pool-size>20</max-pool-size>
> </pool>
> </datasource>
>
>
>
> As I read in some blogs, they suggested to change the "*CharacterSet*" from *ANSI* to *UTF-8* in schema file(.sch file).
> So I tried to change it to UTF-8 as well as *65001* still getting same result
> *refered link - [https://www.ibm.com/support/pages/special-characters-data-imported-through-odbc-import-using-microsoft-text-driver-are-not-displayed-correctly-admin-client]*
> we also tried to add";charSet=UTF-8" in datasource URL but still its giving same kind of result.
> Could you please suggest some solution for this issue.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
3 years, 9 months
[JBoss JIRA] (TEIIDDES-3227) Facing an issue with multiple character delimiter in CSV File.
by Nayan Bija (Jira)
[ https://issues.redhat.com/browse/TEIIDDES-3227?page=com.atlassian.jira.pl... ]
Nayan Bija updated TEIIDDES-3227:
---------------------------------
Summary: Facing an issue with multiple character delimiter in CSV File. (was: Issue with multiple character delimiter in CSV File.)
> Facing an issue with multiple character delimiter in CSV File.
> --------------------------------------------------------------
>
> Key: TEIIDDES-3227
> URL: https://issues.redhat.com/browse/TEIIDDES-3227
> Project: Teiid Designer
> Issue Type: Feature Request
> Reporter: Nayan Bija
> Priority: Major
>
> Hi,
> We are fetching data from CSV file(without header) using HXTT driver.
> It is properly fetching records with the single charecter delimiter but not working with multiple charector delimiter.
> We are having delimited csv file without having headers which contains "*|~" charector as a delimiter.
> We have written below schema file for it.
> Schema file
> ========
> [target.csv]
> ColNameHeader=False
> Format=Delimited("~|*")
> CharacterSet=ANSI
> COL1=first_name varchar
> COL2=last_name varchar
> COL3=city varchar
>
> Data
> ====
> Sachin~|*Tendulkar~|*Mumbai
> Saurav~|*Ganguly~|*Kolkata
>
> so when we perform select operation on it "|*" character is appended to result.
>
> Result of select query
> ===============
>
> |\|*Sachin|\|*Tendulkar|\|*Mumbai|
>
> Datasource in standalone-teiid.xml
> =======================
>
> <datasource jndi-name="java:/FileDS20200713211347079" pool-name="FileDS20200713211347079">
> <connection-url>jdbc:text:sftp://abc:efg@10.10.10.10:22/home/abc/target.csv?odbcSchemaFile=target.sch;fileExtension=csv;delayedClose=0;refreshInterval=0</connection-url>
> <driver>textfile</driver>
> <pool>
> <max-pool-size>20</max-pool-size>
> </pool>
> </datasource>
>
>
>
> As I read in some blogs, they suggested to change the "*CharacterSet*" from *ANSI* to *UTF-8* in schema file(.sch file).
> So I tried to change it to UTF-8 as well as *65001* still getting same result
> *refered link - [https://www.ibm.com/support/pages/special-characters-data-imported-through-odbc-import-using-microsoft-text-driver-are-not-displayed-correctly-admin-client]*
> we also tried to add";charSet=UTF-8" in datasource URL but still its giving same kind of result.
> Could you please suggest some solution for this issue.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
3 years, 9 months
[JBoss JIRA] (TEIIDDES-3227) Issue with multiple character delimiter in CSV File.
by Nayan Bija (Jira)
[ https://issues.redhat.com/browse/TEIIDDES-3227?page=com.atlassian.jira.pl... ]
Nayan Bija updated TEIIDDES-3227:
---------------------------------
Description:
Hi,
We are fetching data from CSV file(without header) using HXTT driver.
It is properly fetching records with the single charecter delimiter but not working with multiple charector delimiter.
We are having delimited csv file without having headers which contains "*|~" charector as a delimiter.
We have written below schema file for it.
Schema file
========
[target.csv]
ColNameHeader=False
Format=Delimited("~|*")
CharacterSet=ANSI
COL1=first_name varchar
COL2=last_name varchar
COL3=city varchar
Data
====
Sachin~|*Tendulkar~|*Mumbai
Saurav~|*Ganguly~|*Kolkata
so when we perform select operation on it "|*" character is appended to result.
Result of select query
===============
|\|*Sachin|\|*Tendulkar|\|*Mumbai|
Datasource in standalone-teiid.xml
=======================
<datasource jndi-name="java:/FileDS20200713211347079" pool-name="FileDS20200713211347079">
<connection-url>jdbc:text:sftp://abc:efg@10.10.10.10:22/home/abc/target.csv?odbcSchemaFile=target.sch;fileExtension=csv;delayedClose=0;refreshInterval=0</connection-url>
<driver>textfile</driver>
<pool>
<max-pool-size>20</max-pool-size>
</pool>
</datasource>
As I read in some blogs, they suggested to change the "*CharacterSet*" from *ANSI* to *UTF-8* in schema file(.sch file).
So I tried to change it to UTF-8 as well as *65001* still getting same result
*refered link - [https://www.ibm.com/support/pages/special-characters-data-imported-through-odbc-import-using-microsoft-text-driver-are-not-displayed-correctly-admin-client]*
we also tried to add";charSet=UTF-8" in datasource URL but still its giving same kind of result.
Could you please suggest some solution for this issue.
was:
Hi,
We are fetching data from CSV file(without header) using HXTT driver.
It is properly fetching records with the single charecter delimiter but not working with multiple charector delimiter.
We are having delimited csv file without having headers which contains "*|~" charector as a delimiter.
We have written below schema file for it.
Schema file
========
[target.csv]
ColNameHeader=False
Format=Delimited("~|*")
CharacterSet=ANSI
COL1=first_name varchar
COL2=last_name varchar
COL3=city varchar
Data
====
Sachin~|*Tendulkar~|*Mumbai
Saurav~|*Ganguly~|*Kolkata
so when we perform select operation on it "|*" character comes in the result like below
|\|*Sachin|\|*Tendulkar|\|*Mumbai|
Datasource in standalone-teiid.xml
=======================
<datasource jndi-name="java:/FileDS20200713211347079" pool-name="FileDS20200713211347079">
<connection-url>jdbc:text:sftp://abc:efg@10.10.10.10:22/home/abc/target.csv?odbcSchemaFile=target.sch;fileExtension=csv;delayedClose=0;refreshInterval=0</connection-url>
<driver>textfile</driver>
<pool>
<max-pool-size>20</max-pool-size>
</pool>
</datasource>
As I read in some blogs, they suggested to change the "*CharacterSet*" from *ANSI* to *UTF-8* in schema file(.sch file).
So I tried to change it to UTF-8 as well as *65001* still getting same result
*refered link - [https://www.ibm.com/support/pages/special-characters-data-imported-through-odbc-import-using-microsoft-text-driver-are-not-displayed-correctly-admin-client]*
we also tried to add";charSet=UTF-8" in datasource URL but still its giving same kind of result.
Could you please suggest some solution for this issue.
> Issue with multiple character delimiter in CSV File.
> ----------------------------------------------------
>
> Key: TEIIDDES-3227
> URL: https://issues.redhat.com/browse/TEIIDDES-3227
> Project: Teiid Designer
> Issue Type: Feature Request
> Reporter: Nayan Bija
> Priority: Major
>
> Hi,
> We are fetching data from CSV file(without header) using HXTT driver.
> It is properly fetching records with the single charecter delimiter but not working with multiple charector delimiter.
> We are having delimited csv file without having headers which contains "*|~" charector as a delimiter.
> We have written below schema file for it.
> Schema file
> ========
> [target.csv]
> ColNameHeader=False
> Format=Delimited("~|*")
> CharacterSet=ANSI
> COL1=first_name varchar
> COL2=last_name varchar
> COL3=city varchar
>
> Data
> ====
> Sachin~|*Tendulkar~|*Mumbai
> Saurav~|*Ganguly~|*Kolkata
>
> so when we perform select operation on it "|*" character is appended to result.
>
> Result of select query
> ===============
>
> |\|*Sachin|\|*Tendulkar|\|*Mumbai|
>
> Datasource in standalone-teiid.xml
> =======================
>
> <datasource jndi-name="java:/FileDS20200713211347079" pool-name="FileDS20200713211347079">
> <connection-url>jdbc:text:sftp://abc:efg@10.10.10.10:22/home/abc/target.csv?odbcSchemaFile=target.sch;fileExtension=csv;delayedClose=0;refreshInterval=0</connection-url>
> <driver>textfile</driver>
> <pool>
> <max-pool-size>20</max-pool-size>
> </pool>
> </datasource>
>
>
>
> As I read in some blogs, they suggested to change the "*CharacterSet*" from *ANSI* to *UTF-8* in schema file(.sch file).
> So I tried to change it to UTF-8 as well as *65001* still getting same result
> *refered link - [https://www.ibm.com/support/pages/special-characters-data-imported-through-odbc-import-using-microsoft-text-driver-are-not-displayed-correctly-admin-client]*
> we also tried to add";charSet=UTF-8" in datasource URL but still its giving same kind of result.
> Could you please suggest some solution for this issue.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
3 years, 9 months
[JBoss JIRA] (TEIIDDES-3227) Issue with multiple character delimiter in CSV File.
by Nayan Bija (Jira)
[ https://issues.redhat.com/browse/TEIIDDES-3227?page=com.atlassian.jira.pl... ]
Nayan Bija updated TEIIDDES-3227:
---------------------------------
Description:
Hi,
We are fetching data from CSV file(without header) using HXTT driver.
It is properly fetching records with the single charecter delimiter but not working with multiple charector delimiter.
We are having delimited csv file without having headers which contains "*|~" charector as a delimiter.
We have written below schema file for it.
Schema file
========
[target.csv]
ColNameHeader=False
Format=Delimited("~|*")
CharacterSet=ANSI
COL1=first_name varchar
COL2=last_name varchar
COL3=city varchar
Data
====
Sachin~|*Tendulkar~|*Mumbai
Saurav~|*Ganguly~|*Kolkata
so when we perform select operation on it "|*" character comes in the result like below
|\|*Sachin|\|*Tendulkar|\|*Mumbai|
Datasource in standalone-teiid.xml
=======================
<datasource jndi-name="java:/FileDS20200713211347079" pool-name="FileDS20200713211347079">
<connection-url>jdbc:text:sftp://abc:efg@10.10.10.10:22/home/abc/target.csv?odbcSchemaFile=target.sch;fileExtension=csv;delayedClose=0;refreshInterval=0</connection-url>
<driver>textfile</driver>
<pool>
<max-pool-size>20</max-pool-size>
</pool>
</datasource>
As I read in some blogs, they suggested to change the "*CharacterSet*" from *ANSI* to *UTF-8* in schema file(.sch file).
So I tried to change it to UTF-8 as well as *65001* still getting same result
*refered link - [https://www.ibm.com/support/pages/special-characters-data-imported-through-odbc-import-using-microsoft-text-driver-are-not-displayed-correctly-admin-client]*
we also tried to add";charSet=UTF-8" in datasource URL but still its giving same kind of result.
Could you please suggest some solution for this issue.
was:
Hi, We are fetching data from CSV file(without header) using HXTT driver.
It is properly fetching records with the single charecter delimiter but not working with multiple charector delimiter.
We are having delimited csv file without having headers which contains "*|~" charector as a delimiter.
We have written below schema file for it.
Schema file
========
[target.csv]
ColNameHeader=False
Format=Delimited("~|*")
CharacterSet=ANSI
COL1=first_name varchar
COL2=last_name varchar
COL3=city varchar
Data
====
Sachin~|*Tendulkar~|*Mumbai
Saurav~|*Ganguly~|*Kolkata
so when we perform select operation on it "|*" character comes in the result like below
|\|*Sachin|\|*Tendulkar|\|*Mumbai|
Datasource in standalone-teiid.xml
=======================
<datasource jndi-name="java:/FileDS20200713211347079" pool-name="FileDS20200713211347079">
<connection-url>jdbc:text:sftp://abc:efg@10.10.10.10:22/home/abc/target.csv?odbcSchemaFile=target.sch;fileExtension=csv;delayedClose=0;refreshInterval=0</connection-url>
<driver>textfile</driver>
<pool>
<max-pool-size>20</max-pool-size>
</pool>
</datasource>
As I read in some blogs, they suggested to change the "*CharacterSet*" from *ANSI* to *UTF-8* in schema file(.sch file).
So I tried to change it to UTF-8 as well as *65001* still getting same result
*refered link - [https://www.ibm.com/support/pages/special-characters-data-imported-through-odbc-import-using-microsoft-text-driver-are-not-displayed-correctly-admin-client]*
we also tried to add";charSet=UTF-8" in datasource URL but still its giving same kind of result.
Could you please suggest some solution for this issue.
> Issue with multiple character delimiter in CSV File.
> ----------------------------------------------------
>
> Key: TEIIDDES-3227
> URL: https://issues.redhat.com/browse/TEIIDDES-3227
> Project: Teiid Designer
> Issue Type: Feature Request
> Reporter: Nayan Bija
> Priority: Major
>
> Hi,
> We are fetching data from CSV file(without header) using HXTT driver.
> It is properly fetching records with the single charecter delimiter but not working with multiple charector delimiter.
> We are having delimited csv file without having headers which contains "*|~" charector as a delimiter.
> We have written below schema file for it.
> Schema file
> ========
> [target.csv]
> ColNameHeader=False
> Format=Delimited("~|*")
> CharacterSet=ANSI
> COL1=first_name varchar
> COL2=last_name varchar
> COL3=city varchar
>
> Data
> ====
> Sachin~|*Tendulkar~|*Mumbai
> Saurav~|*Ganguly~|*Kolkata
>
> so when we perform select operation on it "|*" character comes in the result like below
> |\|*Sachin|\|*Tendulkar|\|*Mumbai|
>
> Datasource in standalone-teiid.xml
> =======================
>
> <datasource jndi-name="java:/FileDS20200713211347079" pool-name="FileDS20200713211347079">
> <connection-url>jdbc:text:sftp://abc:efg@10.10.10.10:22/home/abc/target.csv?odbcSchemaFile=target.sch;fileExtension=csv;delayedClose=0;refreshInterval=0</connection-url>
> <driver>textfile</driver>
> <pool>
> <max-pool-size>20</max-pool-size>
> </pool>
> </datasource>
>
>
>
> As I read in some blogs, they suggested to change the "*CharacterSet*" from *ANSI* to *UTF-8* in schema file(.sch file).
> So I tried to change it to UTF-8 as well as *65001* still getting same result
> *refered link - [https://www.ibm.com/support/pages/special-characters-data-imported-through-odbc-import-using-microsoft-text-driver-are-not-displayed-correctly-admin-client]*
> we also tried to add";charSet=UTF-8" in datasource URL but still its giving same kind of result.
> Could you please suggest some solution for this issue.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
3 years, 9 months
[JBoss JIRA] (TEIIDDES-3227) Issue with multiple character delimiter in CSV File.
by Nayan Bija (Jira)
[ https://issues.redhat.com/browse/TEIIDDES-3227?page=com.atlassian.jira.pl... ]
Nayan Bija updated TEIIDDES-3227:
---------------------------------
Description:
Hi, We are fetching data from CSV file(without header) using HXTT driver.
It is properly fetching records with the single charecter delimiter but not working with multiple charector delimiter.
We are having delimited csv file without having headers which contains "*|~" charector as a delimiter.
We have written below schema file for it.
Schema file
========
[target.csv]
ColNameHeader=False
Format=Delimited("~|*")
CharacterSet=ANSI
COL1=first_name varchar
COL2=last_name varchar
COL3=city varchar
Data
====
Sachin~|*Tendulkar~|*Mumbai
Saurav~|*Ganguly~|*Kolkata
so when we perform select operation on it "|*" character comes in the result like below
|\|*Sachin|\|*Tendulkar|\|*Mumbai|
Datasource in standalone-teiid.xml
=======================
<datasource jndi-name="java:/FileDS20200713211347079" pool-name="FileDS20200713211347079">
<connection-url>jdbc:text:sftp://abc:efg@10.10.10.10:22/home/abc/target.csv?odbcSchemaFile=target.sch;fileExtension=csv;delayedClose=0;refreshInterval=0</connection-url>
<driver>textfile</driver>
<pool>
<max-pool-size>20</max-pool-size>
</pool>
</datasource>
As I read in some blogs, they suggested to change the "*CharacterSet*" from *ANSI* to *UTF-8* in schema file(.sch file).
So I tried to change it to UTF-8 as well as *65001* still getting same result
*refered link - [https://www.ibm.com/support/pages/special-characters-data-imported-through-odbc-import-using-microsoft-text-driver-are-not-displayed-correctly-admin-client]*
we also tried to add";charSet=UTF-8" in datasource URL but still its giving same kind of result.
Could you please suggest some solution for this issue.
was:
Hi, We are fetching data from CSV file(without header) using HXTT driver.
It is properly fetching records with the single charecter delimiter but not working with multiple charector delimiter.
We are having delimited csv file without having headers which contains "*|~" charector as a delimiter.
We have written below schema file for it.
Schema file
========
[target.csv]
ColNameHeader=False
Format=Delimited("~|*")
CharacterSet=ANSI
COL1=first_name varchar
COL2=last_name varchar
COL3=city varchar
Data
====
Sachin~|*Tendulkar~|*Mumbai
Saurav~|*Ganguly~|*Kolkata
so when we perform select operation on it "|*" character comes in the result like below
|\|*Sachin|\|*Tendulkar|\|*Mumbai|
Datasource in standalone-teiid.xml
=======================
<datasource jndi-name="java:/FileDS20200713211347079" pool-name="FileDS20200713211347079">
<connection-url>jdbc:text:sftp://abc:efg@10.10.10.10:22/home/abc/target.csv?odbcSchemaFile=target.sch;fileExtension=csv;delayedClose=0;refreshInterval=0</connection-url>
<driver>textfile</driver>
<pool>
<max-pool-size>20</max-pool-size>
</pool>
</datasource>
we also tried to add";charSet=UTF-8" in above URL but still its giving same kind of result.
Could you please suggest some solution for this issue.
> Issue with multiple character delimiter in CSV File.
> ----------------------------------------------------
>
> Key: TEIIDDES-3227
> URL: https://issues.redhat.com/browse/TEIIDDES-3227
> Project: Teiid Designer
> Issue Type: Feature Request
> Reporter: Nayan Bija
> Priority: Major
>
> Hi, We are fetching data from CSV file(without header) using HXTT driver.
> It is properly fetching records with the single charecter delimiter but not working with multiple charector delimiter.
> We are having delimited csv file without having headers which contains "*|~" charector as a delimiter.
> We have written below schema file for it.
> Schema file
> ========
> [target.csv]
> ColNameHeader=False
> Format=Delimited("~|*")
> CharacterSet=ANSI
> COL1=first_name varchar
> COL2=last_name varchar
> COL3=city varchar
>
> Data
> ====
> Sachin~|*Tendulkar~|*Mumbai
> Saurav~|*Ganguly~|*Kolkata
>
> so when we perform select operation on it "|*" character comes in the result like below
> |\|*Sachin|\|*Tendulkar|\|*Mumbai|
>
> Datasource in standalone-teiid.xml
> =======================
>
> <datasource jndi-name="java:/FileDS20200713211347079" pool-name="FileDS20200713211347079">
> <connection-url>jdbc:text:sftp://abc:efg@10.10.10.10:22/home/abc/target.csv?odbcSchemaFile=target.sch;fileExtension=csv;delayedClose=0;refreshInterval=0</connection-url>
> <driver>textfile</driver>
> <pool>
> <max-pool-size>20</max-pool-size>
> </pool>
> </datasource>
>
>
>
> As I read in some blogs, they suggested to change the "*CharacterSet*" from *ANSI* to *UTF-8* in schema file(.sch file).
> So I tried to change it to UTF-8 as well as *65001* still getting same result
> *refered link - [https://www.ibm.com/support/pages/special-characters-data-imported-through-odbc-import-using-microsoft-text-driver-are-not-displayed-correctly-admin-client]*
> we also tried to add";charSet=UTF-8" in datasource URL but still its giving same kind of result.
> Could you please suggest some solution for this issue.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
3 years, 9 months
[JBoss JIRA] (TEIIDDES-3227) Issue with multiple character delimiter in CSV File.
by Nayan Bija (Jira)
[ https://issues.redhat.com/browse/TEIIDDES-3227?page=com.atlassian.jira.pl... ]
Nayan Bija updated TEIIDDES-3227:
---------------------------------
Description:
Hi, We are fetching data from CSV file(without header) using HXTT driver.
It is properly fetching records with the single charecter delimiter but not working with multiple charector delimiter.
We are having delimited csv file without having headers which contains "*|~" charector as a delimiter.
We have written below schema file for it.
Schema file
========
[target.csv]
ColNameHeader=False
Format=Delimited("~|*")
CharacterSet=ANSI
COL1=first_name varchar
COL2=last_name varchar
COL3=city varchar
Data
====
Sachin~|*Tendulkar~|*Mumbai
Saurav~|*Ganguly~|*Kolkata
so when we perform select operation on it "|*" character comes in the result like below
|\|*Sachin|\|*Tendulkar|\|*Mumbai|
Datasource in standalone-teiid.xml
=======================
<datasource jndi-name="java:/FileDS20200713211347079" pool-name="FileDS20200713211347079">
<connection-url>jdbc:text:sftp://abc:efg@10.10.10.10:22/home/abc/target.csv?odbcSchemaFile=target.sch;fileExtension=csv;delayedClose=0;refreshInterval=0</connection-url>
<driver>textfile</driver>
<pool>
<max-pool-size>20</max-pool-size>
</pool>
</datasource>
we also tried to add";charSet=UTF-8" in above URL but still its giving same kind of result.
Could you please suggest some solution for this issue.
> Issue with multiple character delimiter in CSV File.
> ----------------------------------------------------
>
> Key: TEIIDDES-3227
> URL: https://issues.redhat.com/browse/TEIIDDES-3227
> Project: Teiid Designer
> Issue Type: Feature Request
> Reporter: Nayan Bija
> Priority: Major
>
> Hi, We are fetching data from CSV file(without header) using HXTT driver.
> It is properly fetching records with the single charecter delimiter but not working with multiple charector delimiter.
> We are having delimited csv file without having headers which contains "*|~" charector as a delimiter.
> We have written below schema file for it.
> Schema file
> ========
> [target.csv]
> ColNameHeader=False
> Format=Delimited("~|*")
> CharacterSet=ANSI
> COL1=first_name varchar
> COL2=last_name varchar
> COL3=city varchar
>
> Data
> ====
> Sachin~|*Tendulkar~|*Mumbai
> Saurav~|*Ganguly~|*Kolkata
>
> so when we perform select operation on it "|*" character comes in the result like below
> |\|*Sachin|\|*Tendulkar|\|*Mumbai|
>
> Datasource in standalone-teiid.xml
> =======================
>
> <datasource jndi-name="java:/FileDS20200713211347079" pool-name="FileDS20200713211347079">
> <connection-url>jdbc:text:sftp://abc:efg@10.10.10.10:22/home/abc/target.csv?odbcSchemaFile=target.sch;fileExtension=csv;delayedClose=0;refreshInterval=0</connection-url>
> <driver>textfile</driver>
> <pool>
> <max-pool-size>20</max-pool-size>
> </pool>
> </datasource>
>
>
>
> we also tried to add";charSet=UTF-8" in above URL but still its giving same kind of result.
> Could you please suggest some solution for this issue.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
3 years, 9 months