April 2015 - teiid-issues - Jboss List Archives

[JBoss JIRA] (TEIID-3442) Apache Spark support via SparkSQL and DataFrames

by Ramesh Reddy (JIRA)

[ https://issues.jboss.org/browse/TEIID-3442?page=com.atlassian.jira.plugin... ] Ramesh Reddy commented on TEIID-3442: ------------------------------------- [~blue666man] is this something you have bandwidth to contribute to Teiid? For me, it seems like using the Thrift JDBC driver is good idea. Also, want to make sure you are primarily intending to use as source? > Apache Spark support via SparkSQL and DataFrames > ------------------------------------------------ > > Key: TEIID-3442 > URL: https://issues.jboss.org/browse/TEIID-3442 > Project: Teiid > Issue Type: Feature Request > Components: Misc. Connectors > Affects Versions: 8.10 > Reporter: John Muller > Labels: Connectors, Spark, Translators > Fix For: Open To Community > > Original Estimate: 20 weeks > Remaining Estimate: 20 weeks > > Eliciting comments for Apache Spark support. With the release of Panda's like DataFrames, it is a little more feasible to directly translate to SparkSQL: > https://spark.apache.org/docs/latest/sql-programming-guide.html > Options in order of complexity: > 1. Use the existing Hive connector / translator. Spark still uses the Hive metastore. > 2. Thrift JDBC driver. This is what Microstrategy, Tableau, QlikView and others use, most rudimentary API for accessing Spark. > 3. Native SparkSQL via building Spark jobs and submitting them to a running Spark driver. -- This message was sent by Atlassian JIRA (v6.3.15#6346)

10 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-3436) Add array type support to the odata translator

by Ramesh Reddy (JIRA)

[ https://issues.jboss.org/browse/TEIID-3436?page=com.atlassian.jira.plugin... ] Ramesh Reddy commented on TEIID-3436: ------------------------------------- [https://github.com/teiid/teiid/blob/master/odata/src/test/java/org/teiid/...] line #460, V2 spec has been little blur to me right now :) > Add array type support to the odata translator > ---------------------------------------------- > > Key: TEIID-3436 > URL: https://issues.jboss.org/browse/TEIID-3436 > Project: Teiid > Issue Type: Enhancement > Components: Misc. Connectors > Reporter: Steven Hawkins > > Arrays of basic types in odata responses should be convertible into a runtime array type. -- This message was sent by Atlassian JIRA (v6.3.15#6346)

10 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-3436) Add array type support to the odata translator

by Steven Hawkins (JIRA)

[ https://issues.jboss.org/browse/TEIID-3436?page=com.atlassian.jira.plugin... ] Steven Hawkins commented on TEIID-3436: --------------------------------------- What unit test and where? As far as I can tell no, it's not supported without changes. If you take the edm metadata xml and try to set something as a list or bag type, it will fail to parse. > Add array type support to the odata translator > ---------------------------------------------- > > Key: TEIID-3436 > URL: https://issues.jboss.org/browse/TEIID-3436 > Project: Teiid > Issue Type: Enhancement > Components: Misc. Connectors > Reporter: Steven Hawkins > > Arrays of basic types in odata responses should be convertible into a runtime array type. -- This message was sent by Atlassian JIRA (v6.3.15#6346)

10 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-3436) Add array type support to the odata translator

by Ramesh Reddy (JIRA)

[ https://issues.jboss.org/browse/TEIID-3436?page=com.atlassian.jira.plugin... ] Ramesh Reddy commented on TEIID-3436: ------------------------------------- I see a unit test that is testing array types in V2, that is not sufficient? > Add array type support to the odata translator > ---------------------------------------------- > > Key: TEIID-3436 > URL: https://issues.jboss.org/browse/TEIID-3436 > Project: Teiid > Issue Type: Enhancement > Components: Misc. Connectors > Reporter: Steven Hawkins > > Arrays of basic types in odata responses should be convertible into a runtime array type. -- This message was sent by Atlassian JIRA (v6.3.15#6346)

10 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-3454) Dependent Join optimizations for Netezza and Hive

by Steven Hawkins (JIRA)

[ https://issues.jboss.org/browse/TEIID-3454?page=com.atlassian.jira.plugin... ] Steven Hawkins commented on TEIID-3454: --------------------------------------- There is a feature to perform a dependent join using a temp table. On the JDBC translator the property enableDependentJoins needs to be set - https://docs.jboss.org/author/display/TEIID/JDBC+Translator But we don't currently have a hibernate dialect associated with netezza. The closest would be postgresql. If also isn't yet any key creation on the temporary table. The Hive translator would take more work as there isn't any temp support there yet. > Dependent Join optimizations for Netezza and Hive > ------------------------------------------------- > > Key: TEIID-3454 > URL: https://issues.jboss.org/browse/TEIID-3454 > Project: Teiid > Issue Type: Feature Request > Components: Query Engine > Affects Versions: 8.10 > Reporter: John Muller > Assignee: Steven Hawkins > Priority: Minor > > Currently, dependent joins create 1 or more IN clauses. Many MPP / NoSQL systems can have drastically better performance by creating temp tables that match key distributions. Two examples I know of would be Netezza and Hive. > In Netezza, if the incoming dependent join (small dimension; here "Customer" using Northwind data model concepts) has a key that will be joined to to a big fact table that is DISTRIBUTED ON or ORGANIZED BY 'ed then creating a temp table that matches this distribution will result in ~100x query performance. Sometimes, if the dimension is small enough, this doesn't make a big difference as Netezza will perform a broadcast join, but it's never a bad idea to create the temp table. > Similarly, Hive DDL has both partitions and buckets (pre-sorted). -- This message was sent by Atlassian JIRA (v6.3.15#6346)

10 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-3454) Dependent Join optimizations for Netezza and Hive

by John Muller (JIRA)

John Muller created TEIID-3454: ---------------------------------- Summary: Dependent Join optimizations for Netezza and Hive Key: TEIID-3454 URL: https://issues.jboss.org/browse/TEIID-3454 Project: Teiid Issue Type: Feature Request Components: Query Engine Affects Versions: 8.10 Reporter: John Muller Assignee: Steven Hawkins Priority: Minor Currently, dependent joins create 1 or more IN clauses. Many MPP / NoSQL systems can have drastically better performance by creating temp tables that match key distributions. Two examples I know of would be Netezza and Hive. In Netezza, if the incoming dependent join (small dimension; here "Customer" using Northwind data model concepts) has a key that will be joined to to a big fact table that is DISTRIBUTED ON or ORGANIZED BY 'ed then creating a temp table that matches this distribution will result in ~100x query performance. Sometimes, if the dimension is small enough, this doesn't make a big difference as Netezza will perform a broadcast join, but it's never a bad idea to create the temp table. Similarly, Hive DDL has both partitions and buckets (pre-sorted). -- This message was sent by Atlassian JIRA (v6.3.15#6346)

10 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-3432) support: MongoDB 3.0

by Steven Hawkins (JIRA)

[ https://issues.jboss.org/browse/TEIID-3432?page=com.atlassian.jira.plugin... ] Steven Hawkins resolved TEIID-3432. ----------------------------------- Resolution: Done Updated the root pom version to 2.13.1. As feature work is ending on 2.13, we'll have to switch to 3 at some later point. > support: MongoDB 3.0 > --------------------- > > Key: TEIID-3432 > URL: https://issues.jboss.org/browse/TEIID-3432 > Project: Teiid > Issue Type: Feature Request > Components: Misc. Connectors > Affects Versions: 8.10 > Reporter: Ivan Chan > Assignee: Ramesh Reddy > Fix For: 8.11 > > > According latest documentation for MongoDB 3.0 (Driver Compatibility Changes[1]) the minimum driver version required is 2.13. Currently Teiid 8.10 is using 2.12 > http://docs.mongodb.org/manual/release-notes/3.0-compatibility/ -- This message was sent by Atlassian JIRA (v6.3.15#6346)

10 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-3453) Add NOT (negation) support for other non-equality sql criteria, example Not Like, Not In, etc.

by Van Halbert (JIRA)

[ https://issues.jboss.org/browse/TEIID-3453?page=com.atlassian.jira.plugin... ] Van Halbert updated TEIID-3453: ------------------------------- Git Pull Request: https://github.com/teiid/teiid/pull/442 > Add NOT (negation) support for other non-equality sql criteria, example Not Like, Not In, etc. > ---------------------------------------------------------------------------------------------- > > Key: TEIID-3453 > URL: https://issues.jboss.org/browse/TEIID-3453 > Project: Teiid > Issue Type: Enhancement > Components: Misc. Connectors > Affects Versions: 8.7.1.6_2, 8.11 > Reporter: Van Halbert > Assignee: Van Halbert > > Add NOT (negation) support for when using other non-equality type sql criteria. Example: Not in (1,2,..) or Not like (' '). -- This message was sent by Atlassian JIRA (v6.3.15#6346)

10 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-3453) Add NOT (negation) support for other non-equality sql criteria, example Not Like, Not In, etc.

by Van Halbert (JIRA)

[ https://issues.jboss.org/browse/TEIID-3453?page=com.atlassian.jira.plugin... ] Van Halbert reassigned TEIID-3453: ---------------------------------- Assignee: Steven Hawkins (was: Van Halbert) > Add NOT (negation) support for other non-equality sql criteria, example Not Like, Not In, etc. > ---------------------------------------------------------------------------------------------- > > Key: TEIID-3453 > URL: https://issues.jboss.org/browse/TEIID-3453 > Project: Teiid > Issue Type: Enhancement > Components: Misc. Connectors > Affects Versions: 8.7.1.6_2, 8.11 > Reporter: Van Halbert > Assignee: Steven Hawkins > > Add NOT (negation) support for when using other non-equality type sql criteria. Example: Not in (1,2,..) or Not like (' '). -- This message was sent by Atlassian JIRA (v6.3.15#6346)

10 years, 8 months

1
0
0 / 0

[JBoss JIRA] (TEIID-3453) Add NOT (negation) support for other non-equality sql criteria, example Not Like, Not In, etc.

by RH Bugzilla Integration (JIRA)

[ https://issues.jboss.org/browse/TEIID-3453?page=com.atlassian.jira.plugin... ] RH Bugzilla Integration updated TEIID-3453: ------------------------------------------- Bugzilla Update: Perform Bugzilla References: https://bugzilla.redhat.com/show_bug.cgi?id=1190691 > Add NOT (negation) support for other non-equality sql criteria, example Not Like, Not In, etc. > ---------------------------------------------------------------------------------------------- > > Key: TEIID-3453 > URL: https://issues.jboss.org/browse/TEIID-3453 > Project: Teiid > Issue Type: Enhancement > Components: Misc. Connectors > Affects Versions: 8.7.1.6_2, 8.11 > Reporter: Van Halbert > Assignee: Van Halbert > > Add NOT (negation) support for when using other non-equality type sql criteria. Example: Not in (1,2,..) or Not like (' '). -- This message was sent by Atlassian JIRA (v6.3.15#6346)

10 years, 8 months

1
0
0 / 0

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

teiid-issues April 2015