[JBoss JIRA] (TEIID-3157) Allow streaming without an intermediate copy
by Steven Hawkins (JIRA)
[ https://issues.jboss.org/browse/TEIID-3157?page=com.atlassian.jira.plugin... ]
Steven Hawkins updated TEIID-3157:
----------------------------------
Component/s: Server
> Allow streaming without an intermediate copy
> --------------------------------------------
>
> Key: TEIID-3157
> URL: https://issues.jboss.org/browse/TEIID-3157
> Project: Teiid
> Issue Type: Enhancement
> Components: JDBC Driver, Server
> Reporter: Haifen Bi
> Assignee: Steven Hawkins
> Fix For: 8.9
>
>
> We have quite large size of data file (>10G) that needs to be sent back to server from client. Following is JDBC client code:
> void writeData(int id) {
> String sql = "UPDATE DataSet set data = ? WHERE id = ?";
> try {
> InputStream is = new FileInputStream("c:\\temp\\data");
> this.ps = connection.prepareStatement(sql);
> this.ps.setBlob(1, is);
> this.ps.setInt(2, id);
> ps.executeUpdate();
> } catch (Exception e) {
> ..
> }
> }
> Teiid throws "lob too big" error when executing above code:
> 10:01:18,801 WARN [org.teiid.TRANSPORT] (New I/O worker #1) TEIID40113 Unhandled exception, aborting operation: java.io.StreamCorruptedException: lob too big:
> 429496456065534 (max: 4294967296)
> at org.teiid.transport.ObjectDecoder.decode(ObjectDecoder.java:142) [teiid-runtime-8.7.0.Final.jar:8.7.0.Final]
> at org.jboss.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:425) [netty-3.6.2.Final.jar:]
> at org.jboss.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:310) [netty-3.6.2.Final.jar:]
> at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) [netty-3.6.2.Final.jar:]
> at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) [netty-3.6.2.Final.jar:]
> at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) [netty-3.6.2.Final.jar:]
>
> It seemed teiid has stream data size limit (4G?). With this limitation, it is not possible to send more than 4G of stream data in Teiid.
--
This message was sent by Atlassian JIRA
(v6.3.1#6329)
9 years, 7 months
[JBoss JIRA] (TEIID-3153) Allow to write stream data with large size (>10G)
by Steven Hawkins (JIRA)
[ https://issues.jboss.org/browse/TEIID-3153?page=com.atlassian.jira.plugin... ]
Steven Hawkins updated TEIID-3153:
----------------------------------
Fix Version/s: 8.9
Component/s: JDBC Driver
> Allow to write stream data with large size (>10G)
> -------------------------------------------------
>
> Key: TEIID-3153
> URL: https://issues.jboss.org/browse/TEIID-3153
> Project: Teiid
> Issue Type: Enhancement
> Components: JDBC Driver
> Reporter: Haifen Bi
> Assignee: Steven Hawkins
> Fix For: 8.9
>
>
> We have quite large size of data file (>10G) that needs to be sent back to server from client. Following is JDBC client code:
> void writeData(int id) {
> String sql = "UPDATE DataSet set data = ? WHERE id = ?";
> try {
> InputStream is = new FileInputStream("c:\\temp\\data");
> this.ps = connection.prepareStatement(sql);
> this.ps.setBlob(1, is);
> this.ps.setInt(2, id);
> ps.executeUpdate();
> } catch (Exception e) {
> ..
> }
> }
> Teiid throws "lob too big" error when executing above code:
> 10:01:18,801 WARN [org.teiid.TRANSPORT] (New I/O worker #1) TEIID40113 Unhandled exception, aborting operation: java.io.StreamCorruptedException: lob too big:
> 429496456065534 (max: 4294967296)
> at org.teiid.transport.ObjectDecoder.decode(ObjectDecoder.java:142) [teiid-runtime-8.7.0.Final.jar:8.7.0.Final]
> at org.jboss.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:425) [netty-3.6.2.Final.jar:]
> at org.jboss.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:310) [netty-3.6.2.Final.jar:]
> at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) [netty-3.6.2.Final.jar:]
> at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) [netty-3.6.2.Final.jar:]
> at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) [netty-3.6.2.Final.jar:]
>
> It seemed teiid has stream data size limit (4G?). With this limitation, it is not possible to send more than 4G of stream data in Teiid.
--
This message was sent by Atlassian JIRA
(v6.3.1#6329)
9 years, 7 months
[JBoss JIRA] (TEIID-3156) Provide a mechanism to turn off string sorting
by Steven Hawkins (JIRA)
Steven Hawkins created TEIID-3156:
-------------------------------------
Summary: Provide a mechanism to turn off string sorting
Key: TEIID-3156
URL: https://issues.jboss.org/browse/TEIID-3156
Project: Teiid
Issue Type: Feature Request
Components: Misc. Connectors, Query Engine
Reporter: Steven Hawkins
Assignee: Steven Hawkins
Fix For: 8.9
Currently we don't have a fine grained mechanism to turn off source sorting of specifically string data. If a source is using a different collation for example and cannot be set on a session basis (that could be configured on the datasource) to an ansi/utf collation, then at least for join scenarios we have to process the sort in the engine. Optionally the user may wan the Teiid default collation enforced even for other sorts.
--
This message was sent by Atlassian JIRA
(v6.3.1#6329)
9 years, 7 months
[JBoss JIRA] (TEIID-3141) Bad result of query with GROUB BY clause (underlying sybase15 datasource)
by Steven Hawkins (JIRA)
[ https://issues.jboss.org/browse/TEIID-3141?page=com.atlassian.jira.plugin... ]
Steven Hawkins commented on TEIID-3141:
---------------------------------------
I can double check that aggregate scenario if you provide the details of the query.
> Bad result of query with GROUB BY clause (underlying sybase15 datasource)
> -------------------------------------------------------------------------
>
> Key: TEIID-3141
> URL: https://issues.jboss.org/browse/TEIID-3141
> Project: Teiid
> Issue Type: Bug
> Affects Versions: 8.7.1
> Environment: OS: fedora20
> arch: x86_64
> java: sun 1.7
> Reporter: Juraj Duráni
> Assignee: Steven Hawkins
>
> Description:
> There is sybase15 database with table named SmallA and table named SmallA in VDB which is mapped to sybase table (see tables definition below).
> I am trying to run query against VDB:
> SELECT
> INTKEY, STRINGKEY, INTNUM, STRINGNUM, FLOATNUM, LONGNUM, DOUBLENUM, BYTENUM, DATEVALUE, TIMEVALUE, TIMESTAMPVALUE, BOOLEANVALUE, CHARVALUE, SHORTVALUE, BIGINTEGERVALUE, BIGDECIMALVALUE
> FROM
> BQT1.SMALLA
> GROUP BY
> INTKEY, STRINGKEY, INTNUM, STRINGNUM, FLOATNUM, LONGNUM, DOUBLENUM, BYTENUM, DATEVALUE, TIMEVALUE, TIMESTAMPVALUE, BOOLEANVALUE, CHARVALUE, SHORTVALUE, BIGINTEGERVALUE, BIGDECIMALVALUE
> Result is table which misses some values (the other values are OK):
> FloatNum: always 0
> ByteNum: always 0
> DateValue: always 1900-01-01
> TimeValue: always 00:00:00
> BooleanValue: always 'false'
> CharValue: always empty character
> ShortValue: always 0
> BigIntegerValue: always 0
> BigDecimalValue: always 0
> After removing 'INTKEY' and 'STRINGKEY' from the query is result OK (sybase15 has indices only for these two columns).
> ///////////////////
> Table definition
> ///////////////////
> SmallA (sybase) has these columns (name:type):
> IntKey:int -> PRIMARY KEY, HAS INDEX
> StringKey:varchar -> HAS INDEX
> IntNum:int
> StringNum:varchar
> FloatNum:float
> LongNum:numeric
> DoubleNum:float
> ByteNum:real
> DateValue:datetime
> TimeValue:datetime
> TimestampValue:datetime
> BooleanValue:tinyint
> CharValue:char
> ShortValue:numeric
> BigIntegerValue:numeric
> BigDecimalValue:numeric
> ObjectValue:text
> SmallA (VDB) has these columns (name:type):
> IntKey:integer
> StringKey:string
> IntNum:integer
> StringNum:string
> FloatNum:float
> LongNum:long
> DoubleNum:double
> ByteNum:byte
> DateValue:date
> TimeValue:time
> TimestampValue:timestamp
> BooleanValue:boolean
> CharValue:char
> ShortValue:short
> BigIntegerValue:biginteger
> BigDecimalValue:bigdecimal
> ObjectValue:object
--
This message was sent by Atlassian JIRA
(v6.3.1#6329)
9 years, 7 months
[JBoss JIRA] (TEIID-3121) Teiid Standalone Server
by Tom Arnold (JIRA)
[ https://issues.jboss.org/browse/TEIID-3121?page=com.atlassian.jira.plugin... ]
Tom Arnold commented on TEIID-3121:
-----------------------------------
I updated the script to verify downloaded files using their SHA1 checksums. I'd like to get it included it in the main repo (as a development aid) if it meets everyone's approval.
https://github.com/Tom9729/teiid/blob/master/install.sh
I will try to look at packaging everything in the Maven build since that seems to be the preferred approach.
> Teiid Standalone Server
> -----------------------
>
> Key: TEIID-3121
> URL: https://issues.jboss.org/browse/TEIID-3121
> Project: Teiid
> Issue Type: Feature Request
> Components: Build/Kits
> Reporter: Tom Arnold
> Fix For: Open To Community
>
>
> Perform the server installation steps as part of the build and add the result to the downloads page. It seems like this is something that everyone who isn't using the embedded kit has to do anyways, and would hopefully eliminate confusion caused by people trying to deploy the runtime in unsupported versions of JBoss.
> * Teiid Runtime
> * Teiid Web Console
> * JBoss EAP 6.1 Alpha
> * Resteasy JAX-RS Patch
> End result would simplify the installation process to:
> 1. Unzip Teiid server.
> 2. Run `bin/add-user.sh` script.
> 3. Deploy custom translators, VDB, etc.
--
This message was sent by Atlassian JIRA
(v6.3.1#6329)
9 years, 7 months