It should be possible to increase heap space to overcome this problem. Of course, if a program wil start swapping, performance will go way down.<br><br>Dividing the rules file is the only way. But even a very simple script of Perl or similar should be able to divide your (IIRC) generated rules file.<br>
<br>-W<br><br><div class="gmail_quote">2010/4/3 miguel machado <span dir="ltr"><<a href="mailto:mls.machado@gmail.com">mls.machado@gmail.com</a>></span><br><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
<font size="2"><font face="verdana,sans-serif">hi there,</font></font><div><font size="2"><font face="verdana,sans-serif"><br></font></font></div><div><font face="verdana, sans-serif">So like i said, by pre-compiling the rules and loading them in the main system i was able to reduce a lot memory usage and i can get better results. However, now i've come across a different problem. I just added a fre more dozens of rules and the java program responsible for compiling the DRL file throws a java heap space error, something like an OutOfMemoryException.</font></div>
<div><font face="verdana, sans-serif"><br></font></div><div><font face="verdana, sans-serif">I've read somewhere that dividing the DRL into several files and loading e.g. 500 rules at a time might solve it. Is there another approach to this problem?</font></div>
<div><font face="verdana, sans-serif"><br></font></div><div><font face="verdana, sans-serif">thanks in advance,</font></div><div><font face="verdana, sans-serif">_ miguel</font></div>
<div><font face="verdana, sans-serif"><br></font></div><div><font size="2"><font face="verdana,sans-serif"><br></font></font><br><div class="gmail_quote">On Thu, Apr 1, 2010 at 6:12 PM, miguel machado <span dir="ltr"><<a href="mailto:mls.machado@gmail.com" target="_blank">mls.machado@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;"><font size="2"><font face="verdana,sans-serif">hi again,</font></font><div><font face="verdana, sans-serif"><br>
</font></div>
<div><div class="gmail_quote">2010/4/1 Edson Tirelli <span dir="ltr"><<a href="mailto:ed.tirelli@gmail.com" target="_blank">ed.tirelli@gmail.com</a>></span><div><br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;"><br> Hmm, let me complement Wolfgang's comment: <br><br>> After you have taken the compiled packages from the KB and
checked for errors, the KB has done his duty the KB ****MUST**** go :-)<br></blockquote><div><br></div></div><div>I agree! But i don't exactly know how to do so... i mean, i call this method which creates the KB from a DRL file and then the kbase and returns the ksession, the KB object declaration scope is just that exact method, and once it reaches 300MB+ in memory, it just stays there... the KB object is no longer in use (or is it?) but memory keeps high. </div>
<div><br></div><div>I've tried setting KB to "null" and then invoking the jvm garbage collector, but to no avail. I wish there was a simple way i could just destroy a particular object sigh</div><div>
<div> </div>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;"><br> The above emphasis is mine. KnowledgeBuilder is a higher level object designed to encapsulate the parsing+compilation steps of resources. It is **not** designed to be reused and doing so might create inconsistencies. The memory spike you see when using the kbuilder is due to the java compiler... </blockquote>
<div><br></div></div><div>I understand that, and i'll have that if i must, but the thing is it's not just a spike, it is prolonged throughout execution, it doesn't reduce afterwards.</div><div><div>
</div><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
Drools itself does not do anything fancy in there other than generate some code (quite inexpensive memory wise) and compile it using either JDT or JANINO (both quite expensive memory wise, when compared to the other steps). <br>
<br> So, I strongly discourage you keeping the KB around and as mentioned by Wolfgang, doing so might keep unnecessary objects in memory.<br></blockquote><div><br></div></div><div>Like i said earlier, it's not that i want to keep KB around, i just can't remove it.</div>
<div>
<div> </div><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;"><br> Also, just to clarify, deserializing a compiled package means the compiler will not be called (obviously, as everything is already compiled) and that is why it should save you memory.<br>
</blockquote><div><br></div></div><div>Thanks for clarifying that! I've tested with a separate application to build a compiled file and then load it in the main system and it really makes a difference! it's gone to <100MB wow! However, this was just a proof-of-concept, as i'm not sure how i could apply the same technique to the main standalone application. Do i really have to create a separate process/application just for building/compiling the rules, to make sure the compilation-object-junk doesn't stay in memory along with the rest?</div>
<div><br></div><div>Thanks for all the feedback and input so far.</div><div>_ miguel</div><font color="#888888"><div><br></div></font></div><div><br>-- <br>"To understand what is recursion you must first understand recursion"<br>
</div></div>
</blockquote></div><br><br clear="all"><br>-- <br>"To understand what is recursion you must first understand recursion"<br>
</div>
<br>_______________________________________________<br>
rules-users mailing list<br>
<a href="mailto:rules-users@lists.jboss.org">rules-users@lists.jboss.org</a><br>
<a href="https://lists.jboss.org/mailman/listinfo/rules-users" target="_blank">https://lists.jboss.org/mailman/listinfo/rules-users</a><br>
<br></blockquote></div><br>