[JBoss JIRA] (TEIID-2998) problems with DDL returned for dynamic vdb with google spreadsheet source
by Steven Hawkins (JIRA)
[ https://issues.jboss.org/browse/TEIID-2998?page=com.atlassian.jira.plugin... ]
Steven Hawkins resolved TEIID-2998.
-----------------------------------
Resolution: Unresolved
Marking as unresolved with a KI as there is nothing that we can do on our end.
> problems with DDL returned for dynamic vdb with google spreadsheet source
> -------------------------------------------------------------------------
>
> Key: TEIID-2998
> URL: https://issues.jboss.org/browse/TEIID-2998
> Project: Teiid
> Issue Type: Bug
> Security Level: Public(Everyone can see)
> Components: Misc. Connectors
> Affects Versions: 8.4
> Reporter: Mark Drilling
> Attachments: ChromeSheet.png, FirefoxSheet.png, GoogleSpreadsheetJIRA.txt
>
>
> I am seeing inconsistent DDL returned for dynamic VDB with a google spreadsheet source. In the same google account, I created two spreadsheets. One was created in firefox browser, one was created in chrome browser (don't know why that matters)
> See the attached document showing a comparison of the dynamic VDBs and the DDL that I got back. The only difference is that the source was pointing to a different spreadsheet.
> Notice that the DDL for the "ChromeSheet" returns the concatenated datavalues for the column name. But it includes a NIS OPTION for the column name.
--
This message was sent by Atlassian JIRA
(v6.2.6#6264)
10 years, 7 months
[JBoss JIRA] (TEIID-2998) problems with DDL returned for dynamic vdb with google spreadsheet source
by Steven Hawkins (JIRA)
[ https://issues.jboss.org/browse/TEIID-2998?page=com.atlassian.jira.plugin... ]
Steven Hawkins updated TEIID-2998:
----------------------------------
Assignee: (was: Steven Hawkins)
Affects Version/s: 8.4
(was: 8.7)
Component/s: Misc. Connectors
(was: AdminApi)
> problems with DDL returned for dynamic vdb with google spreadsheet source
> -------------------------------------------------------------------------
>
> Key: TEIID-2998
> URL: https://issues.jboss.org/browse/TEIID-2998
> Project: Teiid
> Issue Type: Bug
> Security Level: Public(Everyone can see)
> Components: Misc. Connectors
> Affects Versions: 8.4
> Reporter: Mark Drilling
> Attachments: ChromeSheet.png, FirefoxSheet.png, GoogleSpreadsheetJIRA.txt
>
>
> I am seeing inconsistent DDL returned for dynamic VDB with a google spreadsheet source. In the same google account, I created two spreadsheets. One was created in firefox browser, one was created in chrome browser (don't know why that matters)
> See the attached document showing a comparison of the dynamic VDBs and the DDL that I got back. The only difference is that the source was pointing to a different spreadsheet.
> Notice that the DDL for the "ChromeSheet" returns the concatenated datavalues for the column name. But it includes a NIS OPTION for the column name.
--
This message was sent by Atlassian JIRA
(v6.2.6#6264)
10 years, 7 months
[JBoss JIRA] (TEIID-2998) problems with DDL returned for dynamic vdb with google spreadsheet source
by RH Bugzilla Integration (JIRA)
[ https://issues.jboss.org/browse/TEIID-2998?page=com.atlassian.jira.plugin... ]
RH Bugzilla Integration updated TEIID-2998:
-------------------------------------------
Bugzilla Update: Perform
Bugzilla References: https://bugzilla.redhat.com/show_bug.cgi?id=1109421
> problems with DDL returned for dynamic vdb with google spreadsheet source
> -------------------------------------------------------------------------
>
> Key: TEIID-2998
> URL: https://issues.jboss.org/browse/TEIID-2998
> Project: Teiid
> Issue Type: Bug
> Security Level: Public(Everyone can see)
> Components: AdminApi
> Affects Versions: 8.7
> Reporter: Mark Drilling
> Assignee: Steven Hawkins
> Attachments: ChromeSheet.png, FirefoxSheet.png, GoogleSpreadsheetJIRA.txt
>
>
> I am seeing inconsistent DDL returned for dynamic VDB with a google spreadsheet source. In the same google account, I created two spreadsheets. One was created in firefox browser, one was created in chrome browser (don't know why that matters)
> See the attached document showing a comparison of the dynamic VDBs and the DDL that I got back. The only difference is that the source was pointing to a different spreadsheet.
> Notice that the DDL for the "ChromeSheet" returns the concatenated datavalues for the column name. But it includes a NIS OPTION for the column name.
--
This message was sent by Atlassian JIRA
(v6.2.6#6264)
10 years, 7 months
[JBoss JIRA] (TEIID-2998) problems with DDL returned for dynamic vdb with google spreadsheet source
by Mark Drilling (JIRA)
[ https://issues.jboss.org/browse/TEIID-2998?page=com.atlassian.jira.plugin... ]
Mark Drilling commented on TEIID-2998:
--------------------------------------
It looks like it is an 'all string' problem. If I add a numeric column, all is well. For now, I'll add that as a KI on our Google spreadsheet source example. You may want to add a note in your documentation also.
> problems with DDL returned for dynamic vdb with google spreadsheet source
> -------------------------------------------------------------------------
>
> Key: TEIID-2998
> URL: https://issues.jboss.org/browse/TEIID-2998
> Project: Teiid
> Issue Type: Bug
> Security Level: Public(Everyone can see)
> Components: AdminApi
> Affects Versions: 8.7
> Reporter: Mark Drilling
> Assignee: Steven Hawkins
> Attachments: ChromeSheet.png, FirefoxSheet.png, GoogleSpreadsheetJIRA.txt
>
>
> I am seeing inconsistent DDL returned for dynamic VDB with a google spreadsheet source. In the same google account, I created two spreadsheets. One was created in firefox browser, one was created in chrome browser (don't know why that matters)
> See the attached document showing a comparison of the dynamic VDBs and the DDL that I got back. The only difference is that the source was pointing to a different spreadsheet.
> Notice that the DDL for the "ChromeSheet" returns the concatenated datavalues for the column name. But it includes a NIS OPTION for the column name.
--
This message was sent by Atlassian JIRA
(v6.2.6#6264)
10 years, 7 months
[JBoss JIRA] (TEIID-3004) TEIID30183 Message:TEIID30183 Text parse error: Non-whitespace character found between the qualifier and the delimiter in text line 16, 161 in Unknown. SQLState: TEIID30183
by Steven Hawkins (JIRA)
[ https://issues.jboss.org/browse/TEIID-3004?page=com.atlassian.jira.plugin... ]
Steven Hawkins commented on TEIID-3004:
---------------------------------------
> Sorry Steve how can I inspect the content read from the webservice translator before that is parsed? To know if it got truncated.
You'd select the clob value with different sql and inspect it in a client. However it's now clear what is going on, so that won't be necessary.
> The content are rows whose fields are delimited by TAB and not quote, but the row 16161 is the only one that has double quote as content (I believe that even if I declared the TAB as delimiter TEIID find the double quote and complain).
With TAB as the delimiter (rather than the single space, which I had initially assumed) and the default double quote qualifier, then yes that row is invalid.
> you can see that there is only the 16161 row with some double quote in the field, but is not a delimiter (not understand what you mean by qualifier)
Qualifier or quote character are used interchangeably. It means the character that should go around an entire value. So by having the quote character as ", it would need to appear around the entire entry
valid: "abc""xyz"
not valid: abc"xyz
The take away here is that this data set is not using a qualifier/quote character. You should instead tell text table that an escape is being used. The escape character can appear before the row or column delimiter to indicate that it's part of the current value. If there is no such character - for example if it's assumed that tab / newline will never appear in the data values - then just use the null character:
TEXTTABLE(.... ESCAPE '\u0000')
> TEIID30183 Message:TEIID30183 Text parse error: Non-whitespace character found between the qualifier and the delimiter in text line 16,161 in Unknown. SQLState: TEIID30183
> ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: TEIID-3004
> URL: https://issues.jboss.org/browse/TEIID-3004
> Project: Teiid
> Issue Type: Bug
> Security Level: Public(Everyone can see)
> Affects Versions: 8.8
> Reporter: luca gioppo
> Assignee: Steven Hawkins
> Priority: Minor
>
> On the same use case of TEIID30181 I now got the error in object:
> TEIID30183 Message:TEIID30183 Text parse error: Non-whitespace character found between the qualifier and the delimiter in text line 16,161 in Unknown.
> SQLState: TEIID30183
> the row should be:
> istsc_pgee021002 Direzione Didattica Statale "Franco Rasetti" Castiglione del Lago ANTONIETTA MANNUCCI 06061 PG Umbria www.dirclago.it Via Carducci, 25 Dirigente Scolastico Istituti di Istruzione Statale di Ogni Ordine e Grado Pubbliche Amministrazioni S 80005650546 pgee021002(a)pec.istruzione.it pec pgee021002(a)istruzione.it altro null null null null null null 0
> the only difference I find between the previous rows that passed without problems is that a field has double quote in its content.
> The delimiter is tabulation so there should not be any problem.
> Could it be this the problem and how to solve it?
> Thanks
--
This message was sent by Atlassian JIRA
(v6.2.6#6264)
10 years, 7 months
[JBoss JIRA] (TEIID-2998) problems with DDL returned for dynamic vdb with google spreadsheet source
by Mark Drilling (JIRA)
[ https://issues.jboss.org/browse/TEIID-2998?page=com.atlassian.jira.plugin... ]
Mark Drilling commented on TEIID-2998:
--------------------------------------
The firefox vs chrome thing is not consistent. Thats how I can reproduce it, but another user tried that - and it fails on both.
I guess we will test with sheets where data is not all strings. See if that will consistently work. Then the "known issue" will be "add some non string data"
> problems with DDL returned for dynamic vdb with google spreadsheet source
> -------------------------------------------------------------------------
>
> Key: TEIID-2998
> URL: https://issues.jboss.org/browse/TEIID-2998
> Project: Teiid
> Issue Type: Bug
> Security Level: Public(Everyone can see)
> Components: AdminApi
> Affects Versions: 8.7
> Reporter: Mark Drilling
> Assignee: Steven Hawkins
> Attachments: ChromeSheet.png, FirefoxSheet.png, GoogleSpreadsheetJIRA.txt
>
>
> I am seeing inconsistent DDL returned for dynamic VDB with a google spreadsheet source. In the same google account, I created two spreadsheets. One was created in firefox browser, one was created in chrome browser (don't know why that matters)
> See the attached document showing a comparison of the dynamic VDBs and the DDL that I got back. The only difference is that the source was pointing to a different spreadsheet.
> Notice that the DDL for the "ChromeSheet" returns the concatenated datavalues for the column name. But it includes a NIS OPTION for the column name.
--
This message was sent by Atlassian JIRA
(v6.2.6#6264)
10 years, 7 months
[JBoss JIRA] (TEIID-2998) problems with DDL returned for dynamic vdb with google spreadsheet source
by Steven Hawkins (JIRA)
[ https://issues.jboss.org/browse/TEIID-2998?page=com.atlassian.jira.plugin... ]
Steven Hawkins commented on TEIID-2998:
---------------------------------------
Use firefox :)
I can't find a google ki, but presumably there is an issue on their end. It's limited to sheets with all string data, so it's fairly narrowly scoped. I don't think there is anything we can do on our end.
> problems with DDL returned for dynamic vdb with google spreadsheet source
> -------------------------------------------------------------------------
>
> Key: TEIID-2998
> URL: https://issues.jboss.org/browse/TEIID-2998
> Project: Teiid
> Issue Type: Bug
> Security Level: Public(Everyone can see)
> Components: AdminApi
> Affects Versions: 8.7
> Reporter: Mark Drilling
> Assignee: Steven Hawkins
> Attachments: ChromeSheet.png, FirefoxSheet.png, GoogleSpreadsheetJIRA.txt
>
>
> I am seeing inconsistent DDL returned for dynamic VDB with a google spreadsheet source. In the same google account, I created two spreadsheets. One was created in firefox browser, one was created in chrome browser (don't know why that matters)
> See the attached document showing a comparison of the dynamic VDBs and the DDL that I got back. The only difference is that the source was pointing to a different spreadsheet.
> Notice that the DDL for the "ChromeSheet" returns the concatenated datavalues for the column name. But it includes a NIS OPTION for the column name.
--
This message was sent by Atlassian JIRA
(v6.2.6#6264)
10 years, 7 months