[teiid-issues] [JBoss JIRA] (TEIID-2842) Impala/ HIVE2: Unsupported compress file

Impala/ HIVE2: Unsupported compress file ----------------------------------------- Key: TEIID-2842 URL: https://issues.jboss.org/browse/TEIID-2842 Project: Teiid Issue Type: Bug Components: Query Engine Affects Versions: 8.6 Environment: Impala/HIVE2 with Teiid Reporter: Ivan Chan Assignee: Ramesh Reddy Labels: teiid Teiid makes a query call "Describe table" in HiveMetadataProcessor.addTable(....). However, if the table contains compress file, HIVE2 driver would return the following execption: java.sql.SQLException: AnalysisException: Failed to load metadata for table: default.omniturelogs CAUSED BY: TableLoadingException: Failed to load metadata for table: omniturelogs CAUSED BY: RuntimeException: Compressed text files are not supported: hdfs://localhost.localdomain:8020/user/cloudera/omniturelogs/Omniture.0.tsv.gz at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:161) at org.apache.hive.jdbc.Utils.verifySuccessWithInfo(Utils.java:149) at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:182) at org.apache.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:246) at org.apache.tomcat.dbcp.dbcp.DelegatingStatement.executeQuery(DelegatingStatement.java:208) at org.apache.tomcat.dbcp.dbcp.DelegatingStatement.executeQuery(DelegatingStatement.java:208) at org.teiid.translator.hive.HiveMetadataProcessor.addTable(HiveMetadataProcessor.java:112) at org.teiid.translator.hive.HiveMetadataProcessor.getConnectorMetadata(HiveMetadataProcessor.java:48) at org.teiid.translator.jdbc.JDBCExecutionFactory.getMetadata(JDBCExecutionFactory.java:311) ... 155 more Maybe Teiid should call "DESCRIBE FORMATTED table" for table that contains compress file. Reference: http://grokbase.com/t/cloudera/impala-user/13b7c9apmx/impala-failed-to-qu...