[teiid-issues] [JBoss JIRA] (TEIID-3153) Allow to write stream data with large size (>10G)

[Steven Hawkins (JIRA)]

     [ https://issues.jboss.org/browse/TEIID-3153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Steven Hawkins updated TEIID-3153:
----------------------------------
    Fix Version/s: 8.9
      Component/s: JDBC Driver


> Allow to write stream data with large size (>10G)
> -------------------------------------------------
>
>                 Key: TEIID-3153
>                 URL: https://issues.jboss.org/browse/TEIID-3153
>             Project: Teiid
>          Issue Type: Enhancement
>          Components: JDBC Driver
>            Reporter: Haifen Bi
>            Assignee: Steven Hawkins
>             Fix For: 8.9
>
>
> We have quite large size of data file (>10G) that needs to be sent back to server from client. Following is JDBC client code: 
> void writeData(int id) {
>      String sql = "UPDATE DataSet set data =  ? WHERE id = ?";
>      try {
>           InputStream is = new FileInputStream("c:\\temp\\data");
>           this.ps = connection.prepareStatement(sql);
>           this.ps.setBlob(1, is);
>           this.ps.setInt(2, id);
>           ps.executeUpdate();
>      } catch (Exception e) {
>           ..
>      }
> }
> Teiid throws  "lob too big" error when executing above code:
> 10:01:18,801 WARN  [org.teiid.TRANSPORT] (New I/O worker #1) TEIID40113 Unhandled exception, aborting operation: java.io.StreamCorruptedException: lob too big:
> 429496456065534 (max: 4294967296)
>         at org.teiid.transport.ObjectDecoder.decode(ObjectDecoder.java:142) [teiid-runtime-8.7.0.Final.jar:8.7.0.Final]
>         at org.jboss.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:425) [netty-3.6.2.Final.jar:]
>         at org.jboss.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:310) [netty-3.6.2.Final.jar:]
>         at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) [netty-3.6.2.Final.jar:]
>         at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) [netty-3.6.2.Final.jar:]
>         at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) [netty-3.6.2.Final.jar:]
>  
> It seemed teiid has stream data size limit (4G?).  With this limitation, it is not possible to send more than 4G of stream data in Teiid. 



--
This message was sent by Atlassian JIRA
(v6.3.1#6329)