[JBoss JIRA] (TEIID-3038) Add spatial query support to the Teiid MongoDB translator
by Michael Farwell (JIRA)
[ https://issues.jboss.org/browse/TEIID-3038?page=com.atlassian.jira.plugin... ]
Michael Farwell edited comment on TEIID-3038 at 8/25/14 3:57 PM:
-----------------------------------------------------------------
Ramesh,
Thanks for implementing these functions. The geoPolygonIntersects() function works great, but I'm having trouble with the other functions.
SELECT * FROM tracks WHERE mongo.geoIntersects(loc, 'Polygon', ((-77.800884, 43.300259), (-77.794790, 43.300259), (-77.794790, 43.297886), (-77.800884, 43.297886), (-77.800884, 43.300259)))
throws the following exception:
Error: can't serialize class java.math.BigDecimal
I get the exception when there is a BigDecimal in the BasicDBList object representing the coordinates. See MongoDBSelectVisitor.buildGeoFunction(). MongoDB does not support the BigDecimal type. The query works if I convert the BigDecimals to Doubles in this method.
was (Author: mdfspiff):
Ramesh,
Thanks for implementing these functions. The geoPolygonIntersects() function works great, but I'm having trouble with the other functions.
:
Error: can't serialize class java.math.BigDecimal.
> Add spatial query support to the Teiid MongoDB translator
> ---------------------------------------------------------
>
> Key: TEIID-3038
> URL: https://issues.jboss.org/browse/TEIID-3038
> Project: Teiid
> Issue Type: Feature Request
> Security Level: Public(Everyone can see)
> Components: Misc. Connectors
> Affects Versions: 8.8
> Reporter: Michael Farwell
> Assignee: Ramesh Reddy
> Fix For: 8.7.1, 8.9
>
>
> We'd like to be able to issue geoIntersects and geoWithin queries through the MongoDB translator. See comment below on a proposed approach.
--
This message was sent by Atlassian JIRA
(v6.3.1#6329)
11 years, 1 month
[JBoss JIRA] (TEIID-3038) Add spatial query support to the Teiid MongoDB translator
by Michael Farwell (JIRA)
[ https://issues.jboss.org/browse/TEIID-3038?page=com.atlassian.jira.plugin... ]
Michael Farwell commented on TEIID-3038:
----------------------------------------
Ramesh,
Thanks for implementing these functions. The geoPolygonIntersects() function works great, but I'm having trouble with the other functions.
:
Error: can't serialize class java.math.BigDecimal.
> Add spatial query support to the Teiid MongoDB translator
> ---------------------------------------------------------
>
> Key: TEIID-3038
> URL: https://issues.jboss.org/browse/TEIID-3038
> Project: Teiid
> Issue Type: Feature Request
> Security Level: Public(Everyone can see)
> Components: Misc. Connectors
> Affects Versions: 8.8
> Reporter: Michael Farwell
> Assignee: Ramesh Reddy
> Fix For: 8.7.1, 8.9
>
>
> We'd like to be able to issue geoIntersects and geoWithin queries through the MongoDB translator. See comment below on a proposed approach.
--
This message was sent by Atlassian JIRA
(v6.3.1#6329)
11 years, 1 month
[JBoss JIRA] (TEIID-3099) RejectedExecutionException for Teiid during high query load
by Steven Hawkins (JIRA)
[ https://issues.jboss.org/browse/TEIID-3099?page=com.atlassian.jira.plugin... ]
Steven Hawkins resolved TEIID-3099.
-----------------------------------
Fix Version/s: 8.7.1
8.9
Resolution: Done
Changed the core pool to have unbounded threads, which may lead to temporarily exceeding the max, but it should tend back to the max with via the timeout as we'll attempt to reuse existing threads as much as possible.
> RejectedExecutionException for Teiid during high query load
> -----------------------------------------------------------
>
> Key: TEIID-3099
> URL: https://issues.jboss.org/browse/TEIID-3099
> Project: Teiid
> Issue Type: Bug
> Security Level: Public(Everyone can see)
> Components: Query Engine, Server
> Affects Versions: 8.7
> Environment: Windows (x64) and Mainframe z/OS (x64)
> Reporter: Mark Ackert
> Assignee: Steven Hawkins
> Labels: queryengine, rejectedexecutionexception, teiid-engine, threads
> Fix For: 8.7.1, 8.9
>
>
> Occasionally, when a standalone Teiid server is under high load from concurrent queries, a RejectedExecutionException is thrown. The relevant part of the stacktrace is below. I investigated the ThreadReuseExecutor source, and I believe the issue's cause is based around the sycnhronized(poolLock) code - see below the stack trace for info, and psuedo-code snippet with my analysis below the stacktrace.
> Caused by: java.util.concurrent.RejectedExecutionException: Task org.teiid.dqp.internal.process.ThreadReuseExecutor$3@c75a8114 rejected from org.teiid.dqp.internal.process.ThreadReuseExecutor$2@8b1166ec[Running, pool size = 128, active threads = 128, queued tasks = 0, completed tasks = 692637]
> at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048) [rt.jar:1.7.0]
> at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821) [rt.jar:1.7.0]
> at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372) [rt.jar:1.7.0]
> at org.teiid.dqp.internal.process.ThreadReuseExecutor.executeDirect(ThreadReuseExecutor.java:200) [teiid-engine-8.7.0.FinalCAFix-SNAPSHOT.jar:8.7.0.FinalCAFix-SNAPSHOT]
> at org.teiid.dqp.internal.process.ThreadReuseExecutor.execute(ThreadReuseExecutor.java:177) [teiid-engine-8.7.0.FinalCAFix-SNAPSHOT.jar:8.7.0.FinalCAFix-SNAPSHOT]
> In the below executeDirect, the race condition that appears plausible to me is: given "activeCount" is at the thread pool size limit and a single thread is finishing execution...Let activeCount be reduced by one in the tpe.execute runnable's synchronized block. The synchronized block exits, and goes to the warnWait/logging code - at this point a thread context switch occurs, and a new PrioritizedRunnable (one which isn't waiting on the poolLock at the beginning of the executeDirect method) comes through executeDirect and proceeds forward because "poolLock" has been released, "activeCount" is now sizeLimit-1. The tpe tries to execute a new Runnable wrapping this PrioritizedRunnable, but the previous thread which hasn't completed it's logging code yet is still present in the the threadpool, and as such we get a RejectedExecutionException due to too many threads trying to be executed in a fixed size thread pool.
> private void executeDirect(final PrioritizedRunnable command) {
> boolean atMaxThreads = false;
> synchronized (poolLock) {
> .... if activeCount!=max_limit; activeCount++
> }
> .......
> tpe.execute(.....
> finally {
> synchronized (poolLock) {
> .......
> activeCont--;
> }
> if (success) {
> ......some log code
> }
> }
--
This message was sent by Atlassian JIRA
(v6.3.1#6329)
11 years, 1 month
[JBoss JIRA] (TEIID-3090) Unexpected exception for correct SQL query
by Steven Hawkins (JIRA)
[ https://issues.jboss.org/browse/TEIID-3090?page=com.atlassian.jira.plugin... ]
Steven Hawkins resolved TEIID-3090.
-----------------------------------
Resolution: Won't Fix
> Unexpected exception for correct SQL query
> ------------------------------------------
>
> Key: TEIID-3090
> URL: https://issues.jboss.org/browse/TEIID-3090
> Project: Teiid
> Issue Type: Bug
> Security Level: Public(Everyone can see)
> Components: Misc. Connectors
> Affects Versions: 8.7
> Environment: OS: Fedora 20
> hardware: x86_64
> Reporter: Juraj Duráni
> Assignee: Steven Hawkins
> Attachments: exception-stack-trace, full-server.log, server.log
>
>
> Description of problem:
> Query ends with exception. Same query for MariaDB database returns correct result but Teiid throws an exception.
> Actual results:
> Query ends with exception - TEIID30504 Remote org.teiid.core.TeiidProcessingException: TEIID30504 Source: Unexpected exception while translating results: Error
> Expected results:
> No exception
> Additional info:
> excption stack trace and server log in attachment
--
This message was sent by Atlassian JIRA
(v6.3.1#6329)
11 years, 1 month
[JBoss JIRA] (TEIID-3036) Update CXF to current version (3.0.0)
by Ramesh Reddy (JIRA)
[ https://issues.jboss.org/browse/TEIID-3036?page=com.atlassian.jira.plugin... ]
Ramesh Reddy commented on TEIID-3036:
-------------------------------------
"org.jboss.modules" is compile time dependency and runtime dependency only when deployed in JBoss EAP. Embedded does not require it, and also that may bring in unwanted JBoss EAP jars. So, above is appropriate.
> Update CXF to current version (3.0.0)
> -------------------------------------
>
> Key: TEIID-3036
> URL: https://issues.jboss.org/browse/TEIID-3036
> Project: Teiid
> Issue Type: Feature Request
> Security Level: Public(Everyone can see)
> Components: Embedded
> Affects Versions: 8.8
> Reporter: Gary Gregory
> Assignee: Steven Hawkins
>
> In the same vein as TEIID-3030, we embed CXF and Teiid in our server. We use CXF 2.7.10 and are about to update to 3.0.0. At worse, we'll go to 2.7.11 as an interim step to 3.0.0.
> Teiid embedded delivers CXF 2.6.6 for web services support.
> It would be great if we could get Teiid to the latest and greatest from CXF so we can all live in the same space without being forced to deal with any incompatibilities or class loader hacks.
> Thank you,
> Gary
--
This message was sent by Atlassian JIRA
(v6.3.1#6329)
11 years, 1 month
[JBoss JIRA] (TEIID-3090) Unexpected exception for correct SQL query
by RH Bugzilla Integration (JIRA)
[ https://issues.jboss.org/browse/TEIID-3090?page=com.atlassian.jira.plugin... ]
RH Bugzilla Integration commented on TEIID-3090:
------------------------------------------------
Van Halbert <vhalbert(a)redhat.com> changed the Status of [bug 1131091|https://bugzilla.redhat.com/show_bug.cgi?id=1131091] from ASSIGNED to CLOSED
> Unexpected exception for correct SQL query
> ------------------------------------------
>
> Key: TEIID-3090
> URL: https://issues.jboss.org/browse/TEIID-3090
> Project: Teiid
> Issue Type: Bug
> Security Level: Public(Everyone can see)
> Components: Misc. Connectors
> Affects Versions: 8.7
> Environment: OS: Fedora 20
> hardware: x86_64
> Reporter: Juraj Duráni
> Assignee: Steven Hawkins
> Attachments: exception-stack-trace, full-server.log, server.log
>
>
> Description of problem:
> Query ends with exception. Same query for MariaDB database returns correct result but Teiid throws an exception.
> Actual results:
> Query ends with exception - TEIID30504 Remote org.teiid.core.TeiidProcessingException: TEIID30504 Source: Unexpected exception while translating results: Error
> Expected results:
> No exception
> Additional info:
> excption stack trace and server log in attachment
--
This message was sent by Atlassian JIRA
(v6.3.1#6329)
11 years, 1 month
[JBoss JIRA] (TEIID-3090) Unexpected exception for correct SQL query
by RH Bugzilla Integration (JIRA)
[ https://issues.jboss.org/browse/TEIID-3090?page=com.atlassian.jira.plugin... ]
RH Bugzilla Integration commented on TEIID-3090:
------------------------------------------------
Van Halbert <vhalbert(a)redhat.com> changed the Status of [bug 1131091|https://bugzilla.redhat.com/show_bug.cgi?id=1131091] from NEW to ASSIGNED
> Unexpected exception for correct SQL query
> ------------------------------------------
>
> Key: TEIID-3090
> URL: https://issues.jboss.org/browse/TEIID-3090
> Project: Teiid
> Issue Type: Bug
> Security Level: Public(Everyone can see)
> Components: Misc. Connectors
> Affects Versions: 8.7
> Environment: OS: Fedora 20
> hardware: x86_64
> Reporter: Juraj Duráni
> Assignee: Steven Hawkins
> Attachments: exception-stack-trace, full-server.log, server.log
>
>
> Description of problem:
> Query ends with exception. Same query for MariaDB database returns correct result but Teiid throws an exception.
> Actual results:
> Query ends with exception - TEIID30504 Remote org.teiid.core.TeiidProcessingException: TEIID30504 Source: Unexpected exception while translating results: Error
> Expected results:
> No exception
> Additional info:
> excption stack trace and server log in attachment
--
This message was sent by Atlassian JIRA
(v6.3.1#6329)
11 years, 1 month
[JBoss JIRA] (TEIID-3036) Update CXF to current version (3.0.0)
by Gary Gregory (JIRA)
[ https://issues.jboss.org/browse/TEIID-3036?page=com.atlassian.jira.plugin... ]
Gary Gregory edited comment on TEIID-3036 at 8/25/14 9:18 AM:
--------------------------------------------------------------
I probably tried something like that first a while back and it did not work which is why I went with depending on the embedded zip file with Ivy.
When I first integrated embedded Teiid 8.7 in our build, I also had to add the following dependency:
<dependency org="org.jboss.modules" name="jboss-modules" conf="<OUR OWN STUFF>" rev="1.3.3.Final" transitive="false" />
was (Author: gary.gregory):
I probably tried something like that first a while back and it did not work which is why I went with depending on the embedded zip file with Ivy.
When I first integrated embedded Teiid 8.7 in our build, I had to add the following dependency:
> Update CXF to current version (3.0.0)
> -------------------------------------
>
> Key: TEIID-3036
> URL: https://issues.jboss.org/browse/TEIID-3036
> Project: Teiid
> Issue Type: Feature Request
> Security Level: Public(Everyone can see)
> Components: Embedded
> Affects Versions: 8.8
> Reporter: Gary Gregory
> Assignee: Steven Hawkins
>
> In the same vein as TEIID-3030, we embed CXF and Teiid in our server. We use CXF 2.7.10 and are about to update to 3.0.0. At worse, we'll go to 2.7.11 as an interim step to 3.0.0.
> Teiid embedded delivers CXF 2.6.6 for web services support.
> It would be great if we could get Teiid to the latest and greatest from CXF so we can all live in the same space without being forced to deal with any incompatibilities or class loader hacks.
> Thank you,
> Gary
--
This message was sent by Atlassian JIRA
(v6.3.1#6329)
11 years, 1 month