<html>
<head>
<base href="https://docs.jboss.org/author">
<link rel="stylesheet" href="/author/s/en/2172/19/5/_/styles/combined.css?spaceKey=TEIID&forWysiwyg=true" type="text/css">
</head>
<body style="background: white;" bgcolor="white" class="email-body">
<div id="pageContent">
<div id="notificationFormat">
<div class="wiki-content">
<div class="email">
<h2><a href="https://docs.jboss.org/author/display/TEIID/Memory+Management">Memory Management</a></h2>
<h4>Page <b>edited</b> by <a href="https://docs.jboss.org/author/display/~kylin">Kylin Soong</a>
</h4>
<br/>
<h4>Changes (1)</h4>
<div id="page-diffs">
<table class="diff" cellpadding="0" cellspacing="0">
<tr><td class="diff-snipped" >...<br></td></tr>
<tr><td class="diff-unchanged" >*max-storage-object-size* (default 8288608 or 8MB) - The maximum size of a buffered managed object in bytes and represents the individual batch page size. If the _processor-batch-size_ is increased and/or you are dealing with extremely wide result sets (several hundred columns), then the default setting of 8MB for the _max-storage-object-size_ may be too low. The inline-lobs also account in this size if batch contains them. The sizing for _max-storage-object-size_ is in terms of serialized size, which will be much closer to the raw data size than the Java memory footprint estimation used for _max-reserved-kb_. _max-storage-object-size_ should not be set too large relative to _memory-buffer-space_ since it will reduce the performance of the memory buffer. The memory buffer supports only 1 concurrent writer for each _max-storage-object-size_ of the _memory-buffer-space_. Note that this value does not typically need to be adjusted. <br> <br></td></tr>
<tr><td class="diff-added-lines" style="background-color: #dfd;">{info} <br> <br>If "_TEIID30001 Max block number exceeded_" error exist in server log, increase the max-storage-object-size to support larger storage objects.&nbsp; Alternatively you could make the processor-batch-size smaller. <br> <br>{info} <br> <br> <br></td></tr>
<tr><td class="diff-unchanged" >*memory-buffer-space* (default \-1) - This controls the amount of on or off heap memory allocated as byte buffers for use by the Teiid buffer manager measured in megabytes. This setting defaults to \-1, which automatically determines a setting based upon whether it is on or off heap and the value for _max-reserve-kb_. <br> <br></td></tr>
<tr><td class="diff-snipped" >...<br></td></tr>
</table>
</div> <h4>Full Content</h4>
<div class="notificationGreySide">
<p>The <em>BufferManager</em> is responsible for tracking both memory and disk usage by Teiid. Configuring the <em>BufferManager</em> properly is one of the most important parts of ensuring high performance. In most instances though the default settings are sufficient as they will scale with the JVM and consider other properties such as the setting for max active plans. Execute following command on CLI to find all possible settings on <em>BufferManager</em>:</p>
<div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent">
<pre class="theme: Confluence; brush: java; gutter: false" style="font-size:12px; font-family: ConfluenceInstalledFont,monospace;">
/subsystem=teiid:read-resource
</pre>
</div></div>
<p>All the properties that start with "buffer-service" used to configure <em>BufferManager</em>. Shown below are the CLI write attribute commands to change <em>BufferManager's</em> settings (all show the default setting):</p>
<div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent">
<pre class="theme: Confluence; brush: java; gutter: false" style="font-size:12px; font-family: ConfluenceInstalledFont,monospace;">
/subsystem=teiid:write-attribute(name=buffer-service-use-disk,value=true)
/subsystem=teiid:write-attribute(name=buffer-service-encrypt-files,value=false)
/subsystem=teiid:write-attribute(name=buffer-service-processor-batch-size,value=256)
/subsystem=teiid:write-attribute(name=buffer-service-max-open-files,value=64)
/subsystem=teiid:write-attribute(name=buffer-service-max-file-size,value=2048)
/subsystem=teiid:write-attribute(name=buffer-service-max-processing-kb,value=-1)
/subsystem=teiid:write-attribute(name=buffer-service-max-reserve-kb,value=-1)
/subsystem=teiid:write-attribute(name=buffer-service-max-buffer-space,value=51200)
/subsystem=teiid:write-attribute(name=buffer-service-max-inline-lobs,value=true)
/subsystem=teiid:write-attribute(name=buffer-service-memory-buffer-space,value=-1)
/subsystem=teiid:write-attribute(name=buffer-service-max-storage-object-size,value=8388608)
/subsystem=teiid:write-attribute(name=buffer-service-memory-buffer-off-heap,value=false)
</pre>
</div></div>
<div class='panelMacro'><table class='infoMacro'><colgroup><col width='24'><col></colgroup><tr><td valign='top'><img src="/author/images/icons/emoticons/information.gif" width="16" height="16" align="absmiddle" alt="" border="0"></td><td>Note that it is not recommend that to change these properties until there is an understanding of the properties (elaborated below) and any potential issue that is being experienced.</td></tr></table></div>
<p>Some of <em>BufferManager's</em> properties are described below. Note that the performance tuning advice is highlighted in info boxes.</p>
<p><b>max-reserve-kb</b> (default -1) - setting determines the total size in kilobytes of batches that can be held by the <em>BufferManager</em> in memory. This number does not account for persistent batches held by soft (such as index pages) or weak references. The default value of -1 will auto-calculate a typical max based upon the max heap available to the VM. The auto-calculated value assumes a 64bit architecture and will limit buffer usage to 50% of the first gigabyte of memory beyond the first 300 megabytes (which are assumed for use by the AS and other Teiid purposes) and 75% of the memory beyond that.</p>
<div class='panelMacro'><table class='infoMacro'><colgroup><col width='24'><col></colgroup><tr><td valign='top'><img src="/author/images/icons/emoticons/information.gif" width="16" height="16" align="absmiddle" alt="" border="0"></td><td>With default settings and an 8GB VM size, then <em>max-reserve-kb</em> will at a max use: (((1024-300) * 0.5) + (7 * 1024 * 0.75)) = 5738 MB or 5875712 KB</td></tr></table></div>
<p>The <em>BufferManager</em> automatically triggers the use of a canonical value cache if enabled when more than 25% of the reserve is in use. This can dramatically cut the memory usage in situations where similar value sets are being read through Teiid, but does introduce a lookup cost. If you are processing small or highly similar datasets through Teiid, and wish to conserve memory, you should consider enabling <a href="/author/display/TEIID/System+Properties" title="System Properties">value caching</a>.</p>
<div class='panelMacro'><table class='noteMacro'><colgroup><col width='24'><col></colgroup><tr><td valign='top'><img src="/author/images/icons/emoticons/warning.gif" width="16" height="16" align="absmiddle" alt="" border="0"></td><td>Memory consumption can be significantly more or less than the nominal target depending upon actual column values and whether <a href="/author/display/TEIID/System+Properties" title="System Properties">value caching</a> is enabled. Large non built-in type objects can exceed their default size estimate. If an out of memory errors occur, then set a lower <em>max-reserve-kb</em> value. Also note that source lob values are held by memory references that are not cleared when a batch is persisted. With heavy lob usage you should ensure that buffers of other memory associated with lob references are appropriately sized.</td></tr></table></div>
<p><b>max-processing-kb</b> (default -1) - setting determines the total size in kilobytes of batches that can be guaranteed for use by <em>one</em> active plan and may be in addition to the memory held based on <em>max-reserve-kb</em>. Typical minimum memory required by Teiid when all the active plans are active is <em>#active-plans*max-processing-kb</em>. The default value of -1 will auto-calculate a typical max based upon the max heap available to the VM and max active plans. The auto-calculated value assumes a 64bit architecture and will limit processing batch usage to 10% of memory beyond the first 300 megabytes (which are assumed for use by the AS and other Teiid purposes).</p>
<div class='panelMacro'><table class='infoMacro'><colgroup><col width='24'><col></colgroup><tr><td valign='top'><img src="/author/images/icons/emoticons/information.gif" width="16" height="16" align="absmiddle" alt="" border="0"></td><td>With default settings including 20 active-plans and an 8GB VM size, then <em>max-processing-kb</em> will be: (((1024-300) * 0.1) + (7 * 1024 * 0.1))/20 = 789.2 MB/20 = 39.46 MB or 40407 KB per plan. This implies a range between 0 and 789 MB that may be reserved with roughly 40 MB per plan. You should be cautious in adjusting max-processing-kb on your own. Typically it will not need adjusted unless you are seeing situations where plans seem memory constrained with low performing large sorts.</td></tr></table></div>
<p><b>max-file-size</b> (default 2GB) - Each intermediate result buffer, temporary LOB, and temporary table is stored in its own set of buffer files, where an individual file is limited to <em>max-file-size</em> megabytes. Consider increasing the storage space available to all such files by increasing <em>max-buffer-space,</em> if your installation makes use of internal materialization, makes heavy use of SQL/XML, or processes large row counts.</p>
<p><b>processor-batch-size</b> (default 256) - Specifies the target row count of a batch of the query processor. A batch is used to represent both linear data stores, such as saved results, and temporary table pages. Teiid will adjust the processor-batch-size to a working size based upon an estimate of the data width of a row relative to a nominal expectation of 2KB. The base value can be doubled or halved up to three times depending upon the data width estimation. For example a single small fixed width (such as an integer) column batch will have a working size of <b>processor-batch-size * 8</b> rows. A batch with hundreds of variable width data (such as string) will have a working size of <b>processor-batch-size / 8</b> rows.</p>
<div class='panelMacro'><table class='infoMacro'><colgroup><col width='24'><col></colgroup><tr><td valign='top'><img src="/author/images/icons/emoticons/information.gif" width="16" height="16" align="absmiddle" alt="" border="0"></td><td>Additional considerations are needed if large VM sizes and/or datasets are being used. Teiid has a non-negligible amount of overhead per batch/table page on the order of 100-200 bytes. If you are dealing with datasets with billions of rows and you run into OutOfMemory issues, consider increasing the <em>processor-batch-size</em> to force the allocation of larger batches and table pages. A general guideline would be to double processor-batch-size for every doubling of the effective heap for Teiid beyond 4 GB - processor-batch-size = 512 for an 8 GB heap, processor-batch-size = 1024 for a 16 GB heap, etc.</td></tr></table></div>
<div class='panelMacro'><table class='infoMacro'><colgroup><col width='24'><col></colgroup><tr><td valign='top'><img src="/author/images/icons/emoticons/information.gif" width="16" height="16" align="absmiddle" alt="" border="0"></td><td>The Teiid engine uses batching to reduce the number of memory rows processed at a given time. The batch sizes may be adjusted to larger values as more clients will be accessing the Teiid server simultaneously.</td></tr></table></div>
<p><b>max-storage-object-size</b> (default 8288608 or 8MB) - The maximum size of a buffered managed object in bytes and represents the individual batch page size. If the <em>processor-batch-size</em> is increased and/or you are dealing with extremely wide result sets (several hundred columns), then the default setting of 8MB for the <em>max-storage-object-size</em> may be too low. The inline-lobs also account in this size if batch contains them. The sizing for <em>max-storage-object-size</em> is in terms of serialized size, which will be much closer to the raw data size than the Java memory footprint estimation used for <em>max-reserved-kb</em>. <em>max-storage-object-size</em> should not be set too large relative to <em>memory-buffer-space</em> since it will reduce the performance of the memory buffer. The memory buffer supports only 1 concurrent writer for each <em>max-storage-object-size</em> of the <em>memory-buffer-space</em>. Note that this value does not typically need to be adjusted.</p>
<div class='panelMacro'><table class='infoMacro'><colgroup><col width='24'><col></colgroup><tr><td valign='top'><img src="/author/images/icons/emoticons/information.gif" width="16" height="16" align="absmiddle" alt="" border="0"></td><td>If "<em>TEIID30001 Max block number exceeded</em>" error exist in server log, increase the max-storage-object-size to support larger storage objects. Alternatively you could make the processor-batch-size smaller.</td></tr></table></div>
<p><b>memory-buffer-space</b> (default -1) - This controls the amount of on or off heap memory allocated as byte buffers for use by the Teiid buffer manager measured in megabytes. This setting defaults to -1, which automatically determines a setting based upon whether it is on or off heap and the value for <em>max-reserve-kb</em>.</p>
<div class='panelMacro'><table class='infoMacro'><colgroup><col width='24'><col></colgroup><tr><td valign='top'><img src="/author/images/icons/emoticons/information.gif" width="16" height="16" align="absmiddle" alt="" border="0"></td><td>When left at the default setting the calculated memory buffer space will be approximately one quarter of the <em>max-reserve-kb</em> size. If the memory buffer is off heap and the <em>max-reserve-kb</em> is automatically calculated, then the memory buffer space will be subtracted out of the effective <em>max-reserve-kb</em> to keep the vm size consistent.</td></tr></table></div>
<p><b>memory-buffer-off-heap</b> (default false) - Take advantage of the <em>BufferManager</em> memory buffer to access system memory without allocating it to the heap. Setting <em>memory-buffer-off-heap</em> to "true" will allocate the Teiid memory buffer off heap. Depending on whether your installation is dedicated to Teiid and the amount of system memory available, this may be preferable to on-heap allocation. The primary benefit is additional memory usage for Teiid without additional garbage collection tuning. This becomes especially important in situations where more than 32GB of memory is desired for the VM. Note that when using off-heap allocation, the memory must still be available to the java process and that setting the value of <em>memory-buffer-space</em> too high may cause the VM to swap rather than reside in memory. With large off-heap buffer sizes (greater than several gigabytes) you may also need to adjust VM settings.</p>
<div class='panelMacro'><table class='infoMacro'><colgroup><col width='24'><col></colgroup><tr><td valign='top'><img src="/author/images/icons/emoticons/information.gif" width="16" height="16" align="absmiddle" alt="" border="0"></td><td><b>Sun VM</b><br />For Sun VMs the relevant VM settings are MaxDirectMemorySize and UseLargePages. For example adding:
<div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent">
<pre class="theme: Confluence; brush: java; gutter: false" style="font-size:12px; font-family: ConfluenceInstalledFont,monospace;">
-XX:MaxDirectMemorySize=12g -XX:+UseLargePages
</pre>
</div></div>
<p>to the VM process arguments would allow for an effective allocation of approximately an 11GB Teiid memory buffer (the <b>memory-buffer-space</b> setting) accounting for any additional direct memory that may be needed by the AS or applications running in the AS.</p></td></tr></table></div>
<h1><a name="MemoryManagement-DiskUsage"></a>Disk Usage</h1>
<p><b>max-buffer-space</b> (default -1) - For table page and result batches the buffer manager will have a limited number of files that are dedicated to a particular storage size. However, as mentioned in the installation, creation of Teiid lob values (for example through SQL/XML) will typically create one file per lob once the lob exceeds the allowable in memory size of 8KB. In heavy usage scenarios, consider pointing the buffer directory on a partition that is routinely defragmented. By default Teiid will use up to 50GB of disk space. This is tracked in terms of the number of bytes written by Teiid. For large data sets, you may need to increase the <em>max-buffer-space</em> setting.</p>
<h1><a name="MemoryManagement-Limitations"></a>Limitations</h1>
<p>It's also important to keep in mind that Teiid has memory and other hard limits which breaks down along several lines in terms of # of storage objects tracked, disk storage, streaming data size/row limits, etc.</p>
<ol>
<li>The buffer manager has a max addressable space of 16 terabytes - but due to fragmentation you'd expect that the max usable would be less. This is the maximum amount of storage available to Teiid for all temporary lobs, internal tables, intermediate results, etc.</li>
<li>The max size of an object (batch or table page) that can be serialized by the buffer manager is 32 GB - but you should not get near that (the default limit is 8 MB). A batch is set or rows that are flowing through Teiid engine.</li>
<li>Teiid temporary tables (also used for internal materialization) can only support 2^31-1 rows per table.</li>
</ol>
<p>However handling a source that has tera/petabytes of data doesn't by itself impact Teiid in any way. What matters is the processing operations that are being performed and/or how much of that data do we need to store on a temporary basis in Teiid. With a simple forward-only query, as long as the result row count is less than 2^31, Teiid be perfectly happy to return a petabyte of data.</p>
<h3><a name="MemoryManagement-OtherConsiderationsforSizing"></a>Other Considerations for Sizing</h3>
<p>Each batch/table page requires an in memory cache entry of approximately ~ 128 bytes - thus the total tracked max batches are limited by the heap and is also why we recommend to increase the processing batch size on larger memory or scenarios making use of large internal materializations. The actual batch/table itself is managed by buffer manager, which has layered memory buffer structure with spill over facility to disk.</p>
<p>Using internal materialization is based on the buffermanager. Buffermanager settings may need to be updated based upon the desired amount of internal materialization performed by deployed vdbs.</p>
</div>
<div id="commentsSection" class="wiki-content pageSection">
<div style="float: right;" class="grey">
<a href="https://docs.jboss.org/author/users/removespacenotification.action?spaceKey=TEIID">Stop watching space</a>
<span style="padding: 0px 5px;">|</span>
<a href="https://docs.jboss.org/author/users/editmyemailsettings.action">Change email notification preferences</a>
</div>
<a href="https://docs.jboss.org/author/display/TEIID/Memory+Management">View Online</a>
|
<a href="https://docs.jboss.org/author/pages/diffpagesbyversion.action?pageId=18646070&revisedVersion=29&originalVersion=28">View Changes</a>
|
<a href="https://docs.jboss.org/author/display/TEIID/Memory+Management?showComments=true&showCommentArea=true#addcomment">Add Comment</a>
</div>
</div>
</div>
</div>
</div>
</body>
</html>