[teiid-issues] [JBoss JIRA] (TEIID-2842) Impala/ HIVE2: Unsupported compress file

[Ivan Chan (JIRA)]

Ivan Chan created TEIID-2842:
--------------------------------

             Summary: Impala/ HIVE2:  Unsupported compress file
                 Key: TEIID-2842
                 URL: https://issues.jboss.org/browse/TEIID-2842
             Project: Teiid
          Issue Type: Bug
          Components: Query Engine
    Affects Versions: 8.6
         Environment: Impala/HIVE2 with Teiid
            Reporter: Ivan Chan
            Assignee: Steven Hawkins


Teiid makes a query call "Describe table" in HiveMetadataProcessor.addTable(....).   However, if the table contains compress file, HIVE2 driver would return the following execption:

java.sql.SQLException: AnalysisException: Failed to load metadata for table: default.omniturelogs

CAUSED BY: TableLoadingException: Failed to load metadata for table: 
omniturelogs
CAUSED BY: RuntimeException: Compressed text files are not supported: hdfs://localhost.localdomain:8020/user/cloudera/omniturelogs/Omniture.0.tsv.gz
	
at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:161)
	
at org.apache.hive.jdbc.Utils.verifySuccessWithInfo(Utils.java:149)
	
at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:182)
	
at org.apache.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:246)
	
at org.apache.tomcat.dbcp.dbcp.DelegatingStatement.executeQuery(DelegatingStatement.java:208)
	
at org.apache.tomcat.dbcp.dbcp.DelegatingStatement.executeQuery(DelegatingStatement.java:208)
	
at org.teiid.translator.hive.HiveMetadataProcessor.addTable(HiveMetadataProcessor.java:112)
	
at org.teiid.translator.hive.HiveMetadataProcessor.getConnectorMetadata(HiveMetadataProcessor.java:48)
	
at org.teiid.translator.jdbc.JDBCExecutionFactory.getMetadata(JDBCExecutionFactory.java:311)
	... 155 more

Maybe Teiid should call "DESCRIBE FORMATTED table" for table that contains compress file.

Reference:


http://grokbase.com/t/cloudera/impala-user/13b7c9apmx/impala-failed-to-query-snappy-compression-data



--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira