[teiid-issues] [JBoss JIRA] (TEIID-3157) Allow streaming without an intermediate copy
Steven Hawkins (JIRA)
issues at jboss.org
Thu Oct 2 15:07:02 EDT 2014
[ https://issues.jboss.org/browse/TEIID-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steven Hawkins updated TEIID-3157:
----------------------------------
Component/s: Server
> Allow streaming without an intermediate copy
> --------------------------------------------
>
> Key: TEIID-3157
> URL: https://issues.jboss.org/browse/TEIID-3157
> Project: Teiid
> Issue Type: Enhancement
> Components: JDBC Driver, Server
> Reporter: Haifen Bi
> Assignee: Steven Hawkins
> Fix For: 8.9
>
>
> We have quite large size of data file (>10G) that needs to be sent back to server from client. Following is JDBC client code:
> void writeData(int id) {
> String sql = "UPDATE DataSet set data = ? WHERE id = ?";
> try {
> InputStream is = new FileInputStream("c:\\temp\\data");
> this.ps = connection.prepareStatement(sql);
> this.ps.setBlob(1, is);
> this.ps.setInt(2, id);
> ps.executeUpdate();
> } catch (Exception e) {
> ..
> }
> }
> Teiid throws "lob too big" error when executing above code:
> 10:01:18,801 WARN [org.teiid.TRANSPORT] (New I/O worker #1) TEIID40113 Unhandled exception, aborting operation: java.io.StreamCorruptedException: lob too big:
> 429496456065534 (max: 4294967296)
> at org.teiid.transport.ObjectDecoder.decode(ObjectDecoder.java:142) [teiid-runtime-8.7.0.Final.jar:8.7.0.Final]
> at org.jboss.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:425) [netty-3.6.2.Final.jar:]
> at org.jboss.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:310) [netty-3.6.2.Final.jar:]
> at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) [netty-3.6.2.Final.jar:]
> at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) [netty-3.6.2.Final.jar:]
> at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) [netty-3.6.2.Final.jar:]
>
> It seemed teiid has stream data size limit (4G?). With this limitation, it is not possible to send more than 4G of stream data in Teiid.
--
This message was sent by Atlassian JIRA
(v6.3.1#6329)
More information about the teiid-issues
mailing list