Impala/ HIVE2: Unsupported compress file
-----------------------------------------
Key: TEIID-2842
URL:
https://issues.jboss.org/browse/TEIID-2842
Project: Teiid
Issue Type: Bug
Components: Query Engine
Affects Versions: 8.6
Environment: Impala/HIVE2 with Teiid
Reporter: Ivan Chan
Assignee: Ramesh Reddy
Labels: teiid
Fix For: 8.7
Teiid makes a query call "Describe table" in
HiveMetadataProcessor.addTable(....). However, if the table contains compress file,
HIVE2 driver would return the following execption:
{code}
java.sql.SQLException: AnalysisException: Failed to load metadata for table:
default.omniturelogs
CAUSED BY: TableLoadingException: Failed to load metadata for table:
omniturelogs
CAUSED BY: RuntimeException: Compressed text files are not supported:
hdfs://localhost.localdomain:8020/user/cloudera/omniturelogs/Omniture.0.tsv.gz
at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:161)
at org.apache.hive.jdbc.Utils.verifySuccessWithInfo(Utils.java:149)
at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:182)
at org.apache.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:246)
at
org.apache.tomcat.dbcp.dbcp.DelegatingStatement.executeQuery(DelegatingStatement.java:208)
at
org.apache.tomcat.dbcp.dbcp.DelegatingStatement.executeQuery(DelegatingStatement.java:208)
at
org.teiid.translator.hive.HiveMetadataProcessor.addTable(HiveMetadataProcessor.java:112)
at
org.teiid.translator.hive.HiveMetadataProcessor.getConnectorMetadata(HiveMetadataProcessor.java:48)
at
org.teiid.translator.jdbc.JDBCExecutionFactory.getMetadata(JDBCExecutionFactory.java:311)
... 155 more
{code}
Maybe Teiid should call "DESCRIBE FORMATTED table" for table that contains
compress file.
Reference:
http://grokbase.com/t/cloudera/impala-user/13b7c9apmx/impala-failed-to-qu...