October 2013 - teiid-commits - Jboss List Archives

[teiid/teiid] 5725bf: TEIID-2674 allowing makedep to work when aggregate...

by shawkins

Branch: refs/heads/master Home: https://github.com/teiid/teiid Commit: 5725bf80112ba68683b0f280988eb80462ff0280 https://github.com/teiid/teiid/commit/5725bf80112ba68683b0f280988eb80462f... Author: shawkins <shawkins(a)redhat.com> Date: 2013-10-10 (Thu, 10 Oct 2013) Changed paths: M engine/src/main/java/org/teiid/query/optimizer/relational/rules/RuleChooseDependent.java M engine/src/test/java/org/teiid/query/optimizer/TestDependentJoins.java Log Message: ----------- TEIID-2674 allowing makedep to work when aggregates aren't completely pushed

10 years, 7 months

1
0
0 / 0

[confluence] Teiid 8.6 (draft) > Cassandra Translator

by Steven Hawkins (Confluence)

10 years, 7 months

1
0
0 / 0

[confluence] Teiid 8.6 (draft) > File Translator

by Steven Hawkins (Confluence)

10 years, 7 months

1
0
0 / 0

[teiid/teiid] 6de8d3: TEIID-2693 misc. cleanups

by shawkins

Branch: refs/heads/master Home: https://github.com/teiid/teiid Commit: 6de8d3c4d881bbe821bb95065f3d33bd841d155b https://github.com/teiid/teiid/commit/6de8d3c4d881bbe821bb95065f3d33bd841... Author: shawkins <shawkins(a)redhat.com> Date: 2013-10-09 (Wed, 09 Oct 2013) Changed paths: M client/src/main/java/org/teiid/jdbc/EmbeddedProfile.java M client/src/main/java/org/teiid/jdbc/JDBCPlugin.java M client/src/main/resources/org/teiid/jdbc/i18n.properties M connectors/translator-jdbc/src/main/java/org/teiid/translator/jdbc/JDBCQueryExecution.java M runtime/src/main/java/org/teiid/transport/ODBCClientInstance.java M runtime/src/main/java/org/teiid/transport/SocketClientInstance.java Log Message: ----------- TEIID-2693 misc. cleanups

10 years, 7 months

1
0
0 / 0

teiid SVN: r4602 - in branches/7.7.x/engine/src: test/java/org/teiid/query/processor and 1 other directory.

by teiid-commits＠lists.jboss.org

Author: jolee Date: 2013-10-09 11:43:19 -0400 (Wed, 09 Oct 2013) New Revision: 4602 Modified: branches/7.7.x/engine/src/main/java/org/teiid/query/tempdata/TempTableStore.java branches/7.7.x/engine/src/test/java/org/teiid/query/processor/TestWithClauseProcessing.java Log: TEIID-2690: Tuples lost in a with clause item Modified: branches/7.7.x/engine/src/main/java/org/teiid/query/tempdata/TempTableStore.java =================================================================== --- branches/7.7.x/engine/src/main/java/org/teiid/query/tempdata/TempTableStore.java 2013-10-08 19:41:59 UTC (rev 4601) +++ branches/7.7.x/engine/src/main/java/org/teiid/query/tempdata/TempTableStore.java 2013-10-09 15:43:19 UTC (rev 4602) @@ -87,7 +87,7 @@ QueryProcessor queryProcessor; List<ElementSymbol> columns; BatchIterator iterator; - + public TableProcessor(QueryProcessor queryProcessor, List<ElementSymbol> columns) { this.queryProcessor = queryProcessor; @@ -361,7 +361,7 @@ TableProcessor withProcessor, TempTable tempTable) throws TeiidComponentException, ExpressionEvaluationException, TeiidProcessingException { - tempTable.insert(new BatchCollector.BatchProducerTupleSource(withProcessor.queryProcessor), withProcessor.columns, false); + tempTable.insert(withProcessor.iterator, withProcessor.columns, false); tempTable.setUpdatable(false); processors.remove(tempTableID); } Modified: branches/7.7.x/engine/src/test/java/org/teiid/query/processor/TestWithClauseProcessing.java =================================================================== --- branches/7.7.x/engine/src/test/java/org/teiid/query/processor/TestWithClauseProcessing.java 2013-10-08 19:41:59 UTC (rev 4601) +++ branches/7.7.x/engine/src/test/java/org/teiid/query/processor/TestWithClauseProcessing.java 2013-10-09 15:43:19 UTC (rev 4602) @@ -199,33 +199,32 @@ //check the full pushdown command helpProcess(plan, dataManager, new List[0]); } - - + @Test public void testWithBlockingJoin() throws TeiidException { - - String sql = "with a (x, y) as (select e1, e2 from pm1.g1) SELECT a.x, a.y, pm1.g2.e1 from a left outer join pm1.g2 makenotdep on (rtrim(a.x) = pm1.g2.e1) order by a.y"; //$NON-NLS-1$ - - HardcodedDataManager dataManager = new HardcodedDataManager() { - @Override - public TupleSource registerRequest(CommandContext context, + + String sql = "with a (x, y) as (select e1, e2 from pm1.g1) SELECT a.x, a.y, pm1.g2.e1 from a left outer join pm1.g2 makenotdep on (rtrim(a.x) = pm1.g2.e1) order by a.y"; //$NON-NLS-1$ + + HardcodedDataManager dataManager = new HardcodedDataManager() { + @Override + public TupleSource registerRequest(CommandContext context, Command command, String modelName, String connectorBindingId, int nodeID, int limit) - throws TeiidComponentException { - final TupleSource ts = super.registerRequest(context, command, modelName, null, 0, 0); - return new TupleSource() { - int i = 0; - - @Override - public List<?> nextTuple() throws TeiidComponentException, - TeiidProcessingException { - if ((i++ % 100)<3) { - throw BlockedException.INSTANCE; - } - return ts.nextTuple(); - } + throws TeiidComponentException { + final TupleSource ts = super.registerRequest(context, command, modelName, null, 0, 0); + return new TupleSource() { + int i = 0; @Override + public List<?> nextTuple() throws TeiidComponentException, + TeiidProcessingException { + if ((i++ % 100)<3) { + throw BlockedException.INSTANCE; + } + return ts.nextTuple(); + } + + @Override public void closeSource() { ts.closeSource(); } @@ -237,7 +236,7 @@ rows[i] = Arrays.asList(String.valueOf(i)); } dataManager.addData("SELECT g_0.e1 AS c_0 FROM pm1.g2 AS g_0 ORDER BY c_0", rows); - rows = new List[100]; + rows = new List[2000]; for (int i = 0; i < rows.length; i++) { rows[i] = Arrays.asList(String.valueOf(i), i); } @@ -247,12 +246,11 @@ ProcessorPlan plan = TestOptimizer.helpPlan(sql, RealMetadataFactory.example1Cached(), null, new DefaultCapabilitiesFinder(TestOptimizer.getTypicalCapabilities()), new String[] {"SELECT a.x, a.y FROM a", "SELECT g_0.e1 AS c_0 FROM pm1.g2 AS g_0 ORDER BY c_0"}, ComparisonMode.EXACT_COMMAND_STRING); //check the full pushdown command - List<?>[] result = new List[100]; + List<?>[] result = new List[2000]; for (int i = 0; i < result.length; i++) { result[i] = Arrays.asList(String.valueOf(i), i, i < 10?String.valueOf(i):null); } helpProcess(plan, dataManager, result); } - }

10 years, 7 months

1
0
0 / 0

teiid SVN: r4601 - in branches/7.7.x/engine/src: test/java/org/teiid/query/processor and 1 other directory.

by teiid-commits＠lists.jboss.org

Author: jolee Date: 2013-10-08 15:41:59 -0400 (Tue, 08 Oct 2013) New Revision: 4601 Modified: branches/7.7.x/engine/src/main/java/org/teiid/query/tempdata/TempTableStore.java branches/7.7.x/engine/src/test/java/org/teiid/query/processor/TestWithClauseProcessing.java Log: TEIID-2690: Tuples lost in a with clause item. Modified: branches/7.7.x/engine/src/main/java/org/teiid/query/tempdata/TempTableStore.java =================================================================== --- branches/7.7.x/engine/src/main/java/org/teiid/query/tempdata/TempTableStore.java 2013-10-04 20:57:36 UTC (rev 4600) +++ branches/7.7.x/engine/src/main/java/org/teiid/query/tempdata/TempTableStore.java 2013-10-08 19:41:59 UTC (rev 4601) @@ -48,6 +48,7 @@ import org.teiid.query.QueryPlugin; import org.teiid.query.metadata.TempMetadataID; import org.teiid.query.metadata.TempMetadataStore; +import org.teiid.query.processor.BatchCollector; import org.teiid.query.processor.BatchIterator; import org.teiid.query.processor.QueryProcessor; import org.teiid.query.resolver.command.TempTableResolver; @@ -85,11 +86,13 @@ public static class TableProcessor { QueryProcessor queryProcessor; List<ElementSymbol> columns; - + BatchIterator iterator; + public TableProcessor(QueryProcessor queryProcessor, List<ElementSymbol> columns) { this.queryProcessor = queryProcessor; this.columns = columns; + this.iterator = new BatchIterator(queryProcessor); } public QueryProcessor getQueryProcessor() { @@ -358,7 +361,7 @@ TableProcessor withProcessor, TempTable tempTable) throws TeiidComponentException, ExpressionEvaluationException, TeiidProcessingException { - tempTable.insert(new BatchIterator(withProcessor.queryProcessor), withProcessor.columns, false); + tempTable.insert(new BatchCollector.BatchProducerTupleSource(withProcessor.queryProcessor), withProcessor.columns, false); tempTable.setUpdatable(false); processors.remove(tempTableID); } Modified: branches/7.7.x/engine/src/test/java/org/teiid/query/processor/TestWithClauseProcessing.java =================================================================== --- branches/7.7.x/engine/src/test/java/org/teiid/query/processor/TestWithClauseProcessing.java 2013-10-04 20:57:36 UTC (rev 4600) +++ branches/7.7.x/engine/src/test/java/org/teiid/query/processor/TestWithClauseProcessing.java 2013-10-08 19:41:59 UTC (rev 4601) @@ -6,13 +6,20 @@ import java.util.List; import org.junit.Test; +import org.teiid.common.buffer.BlockedException; +import org.teiid.common.buffer.TupleSource; +import org.teiid.core.TeiidComponentException; import org.teiid.core.TeiidException; +import org.teiid.core.TeiidProcessingException; import org.teiid.query.optimizer.TestOptimizer; import org.teiid.query.optimizer.TestOptimizer.ComparisonMode; import org.teiid.query.optimizer.capabilities.BasicSourceCapabilities; +import org.teiid.query.optimizer.capabilities.DefaultCapabilitiesFinder; import org.teiid.query.optimizer.capabilities.FakeCapabilitiesFinder; import org.teiid.query.optimizer.capabilities.SourceCapabilities.Capability; +import org.teiid.query.sql.lang.Command; import org.teiid.query.unittest.RealMetadataFactory; +import org.teiid.query.util.CommandContext; @SuppressWarnings({"nls", "unchecked"}) public class TestWithClauseProcessing { @@ -193,4 +200,59 @@ helpProcess(plan, dataManager, new List[0]); } + + @Test public void testWithBlockingJoin() throws TeiidException { + + String sql = "with a (x, y) as (select e1, e2 from pm1.g1) SELECT a.x, a.y, pm1.g2.e1 from a left outer join pm1.g2 makenotdep on (rtrim(a.x) = pm1.g2.e1) order by a.y"; //$NON-NLS-1$ + + HardcodedDataManager dataManager = new HardcodedDataManager() { + @Override + public TupleSource registerRequest(CommandContext context, + Command command, + String modelName, + String connectorBindingId, int nodeID, int limit) + throws TeiidComponentException { + final TupleSource ts = super.registerRequest(context, command, modelName, null, 0, 0); + return new TupleSource() { + int i = 0; + + @Override + public List<?> nextTuple() throws TeiidComponentException, + TeiidProcessingException { + if ((i++ % 100)<3) { + throw BlockedException.INSTANCE; + } + return ts.nextTuple(); + } + + @Override + public void closeSource() { + ts.closeSource(); + } + }; + } + }; + List<?>[] rows = new List[10]; + for (int i = 0; i < rows.length; i++) { + rows[i] = Arrays.asList(String.valueOf(i)); + } + dataManager.addData("SELECT g_0.e1 AS c_0 FROM pm1.g2 AS g_0 ORDER BY c_0", rows); + rows = new List[100]; + for (int i = 0; i < rows.length; i++) { + rows[i] = Arrays.asList(String.valueOf(i), i); + } + dataManager.addData("SELECT g_0.e1, g_0.e2 FROM pm1.g1 AS g_0", rows); + + dataManager.addData("WITH a (x, y) AS (SELECT 1, 2 FROM g1 AS g_0) SELECT g_0.x AS c_0 FROM a AS g_0, a AS g_1 ORDER BY c_0", new List[0]); + ProcessorPlan plan = TestOptimizer.helpPlan(sql, RealMetadataFactory.example1Cached(), null, new DefaultCapabilitiesFinder(TestOptimizer.getTypicalCapabilities()), new String[] {"SELECT a.x, a.y FROM a", "SELECT g_0.e1 AS c_0 FROM pm1.g2 AS g_0 ORDER BY c_0"}, ComparisonMode.EXACT_COMMAND_STRING); + //check the full pushdown command + + List<?>[] result = new List[100]; + for (int i = 0; i < result.length; i++) { + result[i] = Arrays.asList(String.valueOf(i), i, i < 10?String.valueOf(i):null); + } + + helpProcess(plan, dataManager, result); + } + }

10 years, 7 months

1
0
0 / 0

[teiid/teiid] 9497b7: TEIID-2665: Added support for decimal, date and va...

by Ramesh Reddy

Branch: refs/heads/8.4.x Home: https://github.com/teiid/teiid Commit: 9497b7862de3efa0194b4698a6ea5d96f23f5333 https://github.com/teiid/teiid/commit/9497b7862de3efa0194b4698a6ea5d96f23... Author: Ramesh Reddy <rareddy(a)jboss.org> Date: 2013-10-08 (Tue, 08 Oct 2013) Changed paths: M connectors/translator-hive/src/main/java/org/teiid/translator/hive/HiveExecutionFactory.java M connectors/translator-hive/src/main/java/org/teiid/translator/hive/HiveMetadataProcessor.java M connectors/translator-hive/src/main/java/org/teiid/translator/hive/HiveSQLConversionVisitor.java M connectors/translator-hive/src/test/java/org/teiid/translator/hive/TestHiveExecutionFactory.java Log Message: ----------- TEIID-2665: Added support for decimal, date and varchar types during the metadata import, added support for analytic functions and rollup functionality for pushdown Commit: 03459a68051ed5c33124bc3a9338ec482f8e6e17 https://github.com/teiid/teiid/commit/03459a68051ed5c33124bc3a9338ec482f8... Author: Ramesh Reddy <rareddy(a)jboss.org> Date: 2013-10-08 (Tue, 08 Oct 2013) Changed paths: M engine/src/main/java/org/teiid/dqp/internal/datamgr/LanguageBridgeFactory.java M engine/src/main/java/org/teiid/query/function/FunctionTree.java M engine/src/main/java/org/teiid/query/function/aggregate/UserDefined.java M engine/src/main/java/org/teiid/query/optimizer/relational/rules/CapabilitiesUtil.java M engine/src/test/java/org/teiid/dqp/internal/datamgr/TestAggregateImpl.java M engine/src/test/java/org/teiid/query/optimizer/relational/rules/TestCapabilitiesUtil.java Log Message: ----------- TEIID-2665: adding capability to pushdown for the user defined aggregate functions Commit: 1697ec509f787ae3ea6544ca9049b11efdbf44e0 https://github.com/teiid/teiid/commit/1697ec509f787ae3ea6544ca9049b11efdb... Author: Ramesh Reddy <rareddy(a)jboss.org> Date: 2013-10-08 (Tue, 08 Oct 2013) Changed paths: M engine/src/test/java/org/teiid/query/optimizer/FakeFunctionMetadataSource.java M engine/src/test/java/org/teiid/query/optimizer/TestAggregatePushdown.java M engine/src/test/java/org/teiid/query/optimizer/relational/rules/TestCapabilitiesUtil.java Log Message: ----------- TEIID-2665: Improvements to Hive Connector 1) Added support for decimal, date and varchar types during the metadata import, added support for analytic functions and rollup functionality for pushdown 2) Adding capability to pushdown for the user defined aggregate functions Commit: d1d742587f50db3e76d043b74f2d4452269f55ec https://github.com/teiid/teiid/commit/d1d742587f50db3e76d043b74f2d4452269... Author: shawkins <shawkins(a)redhat.com> Date: 2013-10-08 (Tue, 08 Oct 2013) Changed paths: M engine/src/main/java/org/teiid/query/function/aggregate/UserDefined.java Log Message: ----------- TEIID-2665 removing pushdown checks from UserDefined Commit: 50b6f42cf28f392793ab4fd3d2d40b2935c57f5b https://github.com/teiid/teiid/commit/50b6f42cf28f392793ab4fd3d2d40b2935c... Author: Ramesh Reddy <rareddy(a)jboss.org> Date: 2013-10-08 (Tue, 08 Oct 2013) Changed paths: M connectors/translator-hive/src/main/java/org/teiid/translator/hive/HiveExecutionFactory.java M engine/src/test/java/org/teiid/query/optimizer/TestAggregatePushdown.java Log Message: ----------- TEIID-2665: compensating the test to include ALL for agggregate functions; rolling back ROLLUP capability Commit: 22b7f9c3b661daf80e9aff18c6674ba757d6cba6 https://github.com/teiid/teiid/commit/22b7f9c3b661daf80e9aff18c6674ba757d... Author: Ramesh Reddy <rareddy(a)jboss.org> Date: 2013-10-08 (Tue, 08 Oct 2013) Changed paths: M connectors/translator-hive/src/main/java/org/teiid/translator/hive/HiveExecutionFactory.java M connectors/translator-hive/src/main/java/org/teiid/translator/hive/HiveMetadataProcessor.java M connectors/translator-hive/src/main/java/org/teiid/translator/hive/HiveSQLConversionVisitor.java M connectors/translator-hive/src/test/java/org/teiid/translator/hive/TestHiveExecutionFactory.java M engine/src/main/java/org/teiid/dqp/internal/datamgr/LanguageBridgeFactory.java M engine/src/main/java/org/teiid/query/function/FunctionTree.java M engine/src/main/java/org/teiid/query/optimizer/relational/rules/CapabilitiesUtil.java M engine/src/test/java/org/teiid/dqp/internal/datamgr/TestAggregateImpl.java M engine/src/test/java/org/teiid/query/optimizer/FakeFunctionMetadataSource.java M engine/src/test/java/org/teiid/query/optimizer/TestAggregatePushdown.java M engine/src/test/java/org/teiid/query/optimizer/relational/rules/TestCapabilitiesUtil.java Log Message: ----------- Merge pull request #129 from rareddy/TEIID-2665 Teiid 2665 Compare: https://github.com/teiid/teiid/compare/bae742ff8f9c...22b7f9c3b661

10 years, 7 months

1
0
0 / 0

[teiid/teiid] 133b7e: TEIID-2691 fix for grouping compensation with expr...

by shawkins

Branch: refs/heads/master Home: https://github.com/teiid/teiid Commit: 133b7e1e5dce46952d2d83d75545c4bd548d5989 https://github.com/teiid/teiid/commit/133b7e1e5dce46952d2d83d75545c4bd548... Author: shawkins <shawkins(a)redhat.com> Date: 2013-10-08 (Tue, 08 Oct 2013) Changed paths: M connectors/translator-jdbc/src/main/java/org/teiid/translator/jdbc/mysql/MySQL5ExecutionFactory.java M engine/src/main/java/org/teiid/query/optimizer/relational/rules/RuleCollapseSource.java M engine/src/test/java/org/teiid/query/optimizer/TestAggregatePushdown.java M engine/src/test/java/org/teiid/query/optimizer/TestExpressionsInGroupBy.java M engine/src/test/java/org/teiid/query/processor/TestAggregateProcessing.java Log Message: ----------- TEIID-2691 fix for grouping compensation with expressions with the same name in the view projection

10 years, 7 months

1
0
0 / 0

[teiid/teiid] d1a361: TEIID-2424: fixing embedded kit which not correctl...

by Ramesh Reddy

Branch: refs/heads/master Home: https://github.com/teiid/teiid Commit: d1a361f221f312589449a28c25a1a50ba7fe5135 https://github.com/teiid/teiid/commit/d1a361f221f312589449a28c25a1a50ba7f... Author: Ramesh Reddy <rareddy(a)jboss.org> Date: 2013-10-07 (Mon, 07 Oct 2013) Changed paths: M build/assembly/embedded-dist.xml M build/assembly/jboss-as7/dist.xml M build/kits/karaf/teiid-karaf-features.xml M connectors/connector-cassandra/pom.xml M connectors/connector-file/pom.xml M connectors/connector-google/pom.xml M connectors/connector-infinispan/pom.xml M connectors/connector-ldap/pom.xml M connectors/connector-mongodb/pom.xml A connectors/connector-mongodb/src/test/.gitignore M connectors/connector-salesforce/pom.xml M connectors/connector-ws/pom.xml A connectors/ra-parent-pom.xml Log Message: ----------- TEIID-2424: fixing embedded kit which not correctly adding the connector jar files Commit: d082f757a59b1788011c8d8ee165691de402d8a7 https://github.com/teiid/teiid/commit/d082f757a59b1788011c8d8ee165691de40... Author: Ramesh Reddy <rareddy(a)jboss.org> Date: 2013-10-08 (Tue, 08 Oct 2013) Changed paths: M build/assembly/embedded-dist.xml M build/assembly/jboss-as7/dist.xml M build/kits/karaf/teiid-karaf-features.xml M connectors/connector-cassandra/pom.xml M connectors/connector-file/pom.xml M connectors/connector-google/pom.xml M connectors/connector-infinispan/pom.xml M connectors/connector-ldap/pom.xml M connectors/connector-mongodb/pom.xml A connectors/connector-mongodb/src/test/.gitignore M connectors/connector-salesforce/pom.xml M connectors/connector-ws/pom.xml A connectors/ra-parent-pom.xml Log Message: ----------- Merge pull request #128 from rareddy/TEIID-2424 TEIID-2424: fixing embedded kit which not correctly adding the connector... Compare: https://github.com/teiid/teiid/compare/d79bf7b7373a...d082f757a59b

10 years, 7 months

1
0
0 / 0

Teiid - Continuous Build - Build # 2194 - Failure!

by ci-builds＠redhat.com

Teiid - Continuous Build - Build # 2194 - Failure: Check console output at http://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/Teiid%20-%20Continuou... to view the results.

10 years, 7 months

1
1
0 / 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

teiid-commits October 2013