[teiid-issues] [JBoss JIRA] Commented: (TEIID-401) Increase performance of XML-Relational connectors file cache

[John Doyle (JIRA)]

    [ https://jira.jboss.org/jira/browse/TEIID-401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12469911#action_12469911 ] 

John Doyle commented on TEIID-401:
----------------------------------

Because I was trying to solve the memory issue at the same time as the caching issue, I changed the XML parsing to a streaming parser at the same time I changed the cache.  So it would be pretty difficult to determine how to divide out the performance improvement.  That said, I have done some side by side testing 5.5.3 using directories of very large documents and the performance improvement is great.  Minutes to seconds.

> Increase performance of XML-Relational connectors file cache
> ------------------------------------------------------------
>
>                 Key: TEIID-401
>                 URL: https://jira.jboss.org/jira/browse/TEIID-401
>             Project: Teiid
>          Issue Type: Feature Request
>          Components: XML Connector
>    Affects Versions: 6.0.0
>            Reporter: Marc Shirley
>            Assignee: John Doyle
>             Fix For: 6.1.0
>
>
> I-T 248339.  XML-Relational File Connector has severe performance issues when forced to use file caching on Linux/Solaris OS.  When using only the in-memory cache, the sample query in 248339 takes around 10 seconds.  When using the file cache, the query takes around 270 seconds to complete.  The sample data file source in 248339 consumes around 25MB of memory, so the default memory cache setting of 16MB forces the file cache to be used.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira