[teiid-issues] [JBoss JIRA] (TEIID-3166) Allow allowDiskUse setting in MongoDB translator

[Ivan Chan (JIRA)]

    [ https://issues.jboss.org/browse/TEIID-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13066594#comment-13066594 ] 

Ivan Chan commented on TEIID-3166:
----------------------------------

I created another test case, but still bumped into error.

 

Here is my sql:

 

select "antiNucleus",

"eventFile",

"eventNumber",

"eventTime"

from "MongoDB_DS"."star2002"

order by "eventFile", "antiNucleus"

limit 900000001

 

And Teiid translates it to:

 

{"$project": {{ "c_0" : "$antiNucleus" , "c_1" : "$eventFile" , "c_2" : "$eventNumber" , "c_3

" : "$eventTime"}}}

{"$sort": {{ "c_1" : 1 , "c_0" : 1}}}

{"$skip": {0}}

{"$limit": {900000001}}

 

And I hit this error right away:

 

Caused by: com.mongodb.CommandFailureException: { "serverUsed" : "ec2-54-161-255-173.compute-1.amazonaws.com:27017" , "errmsg" : "exception: Sort exceeded memory limit of 104857600 bytes, but did not

opt in to external sorting. Aborting operation. Pass allowDiskUse:true to opt in." , "code" : 16820 , "ok" : 0.0}

        at com.mongodb.CommandResult.getException(CommandResult.java:76)

        at com.mongodb.CommandResult.throwOnError(CommandResult.java:131)

        at com.mongodb.DBCollectionImpl.aggregate(DBCollectionImpl.java:100)

        at com.mongodb.DBCollection.aggregate(DBCollection.java:1571)
- See more at: https://developer.jboss.org/message/928949?et=watches.email.thread#928949

> Allow allowDiskUse setting in MongoDB translator
> ------------------------------------------------
>
>                 Key: TEIID-3166
>                 URL: https://issues.jboss.org/browse/TEIID-3166
>             Project: Teiid
>          Issue Type: Enhancement
>          Components: Misc. Connectors
>            Reporter: Harrison Gentry
>            Assignee: Ramesh Reddy
>            Priority: Minor
>              Labels: CR1
>             Fix For: 8.9
>
>
> When querying a MongoDB, steps of computation are limited to 100MiB. Querying large databases can easily exceed this limit, so usually allowDiskUse:true is passed in the aggregate query:
> http://docs.mongodb.org/manual/reference/command/aggregate/
> In Teiid, however, there is currently no way to specify this with SQL.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)