[teiid-issues] [JBoss JIRA] (TEIID-3119) Improve full sort performance for dup removal and grouping

[Steven Hawkins (JIRA)]

    [ https://issues.jboss.org/browse/TEIID-3119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000080#comment-13000080 ] 

Steven Hawkins commented on TEIID-3119:
---------------------------------------

Updated dup removal to use tree logic instead of the progressive multi-pass sort.  This should be better in almost all scenarios as any recopy of the result is offset by not having to buffer the input and not perform additional passes.

> Improve full sort performance for dup removal and grouping
> ----------------------------------------------------------
>
>                 Key: TEIID-3119
>                 URL: https://issues.jboss.org/browse/TEIID-3119
>             Project: Teiid
>          Issue Type: Enhancement
>          Components: Query Engine
>            Reporter: Steven Hawkins
>            Assignee: Steven Hawkins
>             Fix For: 8.9
>
>
> We perform a full sort for grouping/distinct reusing the existing sorting logic.  This is not as efficient as it could for larger data sets with smaller numbers of groups.  A hash implementation or combining the grouping with the sorting would perform better.



--
This message was sent by Atlassian JIRA
(v6.3.1#6329)