[teiid-issues] [JBoss JIRA] Resolved: (TEIID-913) Refine buffer management
[
https://jira.jboss.org/jira/browse/TEIID-913?page=com.atlassian.jira.plug...
]
Steven Hawkins resolved TEIID-913.
----------------------------------
Resolution: Done
Changed the dominate buffering concepts to TupleBuffer and FileStore that are used for
tuples and xml documents. Deletion of file resources is handled automatically as part of
garbage collection. Updated the sort algorithm to use an incoming tuple stream but with
a limited in-memory sorting size.
Refine buffer management
------------------------
Key: TEIID-913
URL: https://jira.jboss.org/jira/browse/TEIID-913
Project: Teiid
Issue Type: Task
Components: Query Engine
Affects Versions: 7.0
Reporter: Steven Hawkins
Assignee: Steven Hawkins
Fix For: 7.0
The current buffermanagement scheme has several limitations that should be resolved:
1. We over use the buffermanager to create temporary results for sub-plans and sort
operations where batch streaming would suffice.
2. The blockedonmemory exception is inefficient for resolving resource conflicts.
3. Most of the buffers in the plan (batches stored on nodes and intermeiated node
results) are not accounted for in the active batches.
4. Outside of the initial sort phase of the multi-pass sort batch access is highly
ephemeral and is inherently limited by the number of process worker threads.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://jira.jboss.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira