[teiid-issues] [JBoss JIRA] (TEIID-2429) Large sort performance

[Steven Hawkins (JIRA)]

    [ https://issues.jboss.org/browse/TEIID-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12760330#comment-12760330 ] 

Steven Hawkins commented on TEIID-2429:
---------------------------------------

Another issue with the default logic is that blocked exceptions with dup remove may result in fairly large sets of the workingTuple collection staying in memory, but not being accounted for by a memory reservation.
                
> Large sort performance
> ----------------------
>
>                 Key: TEIID-2429
>                 URL: https://issues.jboss.org/browse/TEIID-2429
>             Project: Teiid
>          Issue Type: Quality Risk
>          Components: Query Engine
>    Affects Versions: 7.4
>            Reporter: Steven Hawkins
>            Assignee: Steven Hawkins
>             Fix For: 8.4
>
>
> Large sorts (high data volume over above several hundred thousand rows) experience a disproportionate performance degradation as the data set grows larger.
> This is due to the SortUtility default collection strategy that will create intermediate sort buffers too proactively. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira