[teiid-issues] [JBoss JIRA] (TEIID-4858) hive translator is extremely slow

Steven Hawkins (JIRA) issues at jboss.org
Fri May 19 14:44:00 EDT 2017


     [ https://issues.jboss.org/browse/TEIID-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Steven Hawkins resolved TEIID-4858.
-----------------------------------
    Resolution: Done


After some testing, it does appear that the use of order by in hive introduces significantly more overhead than expected (comparing to Teiid or databases).  Relying on Teiid sorting will generally be more performant.

So the default support was changed and a release note added.

We can revisit this if there are circumstances that still require order by pushdown.

> hive translator is extremely slow
> ---------------------------------
>
>                 Key: TEIID-4858
>                 URL: https://issues.jboss.org/browse/TEIID-4858
>             Project: Teiid
>          Issue Type: Quality Risk
>          Components: JDBC Connector
>    Affects Versions: 8.12.9.6_3
>         Environment: Tested against JDV 6.3.4 and the Cloudera quickstart 5.8 VM with the Cloudera sample data loaded into hive
>            Reporter: Michael Echevarria
>            Assignee: Steven Hawkins
>             Fix For: 9.3
>
>         Attachments: fast.log, override1.png, override2.png, slow.log
>
>
> When querying a table through the hive translator the results take close to 30 seconds to return.
> When querying a table through jdbc default results take under 1 second to return.
> Both use the same underlying jboss server datasource.



--
This message was sent by Atlassian JIRA
(v7.2.3#72005)


More information about the teiid-issues mailing list