Thanks, Amit, I'll give that approach a try.
A bit of additional information that seems like it might be related: I find that when I shut down the application server (Glassfish) in which this is running, or unload the EAR, I see a bunch of errors like this in the logs:
[#|2008-11-26T19:29:34.240+0000|WARNING|sun-appserver9.1|javax.enterprise.system.core.classloading|_ThreadID=18;_ThreadName=RMI TCP Connection(47)-172.20.10.129;_RequestID=ac0e52f1-a56e-438a-acb3-a66a93c0e19
f;|Input stream has been finalized or forced closed without being explicitly closed; stream instantiation reported in following stack trace
java.lang.Throwable
at com.sun.enterprise.loader.EJBClassLoader$SentinelInputStream.<init>(EJBClassLoader.java:1169)
at com.sun.enterprise.loader.EJBClassLoader$InternalJarURLConnection.getInputStream(EJBClassLoader.java:1262)
at java.net.URL.openStream(URL.java:1009)
at java.lang.ClassLoader.getResourceAsStream(ClassLoader.java:1161)
at com.sun.enterprise.loader.EJBClassLoader.getResourceAsStream(EJBClassLoader.java:799)
at org.drools.rule.PackageCompilationData$PackageClassLoader.getResourceAsStream(PackageCompilationData.java:384)
at org.drools.commons.jci.compilers.EclipseJavaCompiler$2.isPackage(EclipseJavaCompiler.java:280)
at org.drools.commons.jci.compilers.EclipseJavaCompiler$2.findType(EclipseJavaCompiler.java:222)
at org.drools.commons.jci.compilers.EclipseJavaCompiler$2.findType(EclipseJavaCompiler.java:204)
at org.eclipse.jdt.internal.compiler.lookup.LookupEnvironment.askForType(LookupEnvironment.java:97)
at org.eclipse.jdt.internal.compiler.lookup.UnresolvedReferenceBinding.resolve(UnresolvedReferenceBinding.java:43)
at org.eclipse.jdt.internal.compiler.lookup.BinaryTypeBinding.resolveType(BinaryTypeBinding.java:97)
at org.eclipse.jdt.internal.compiler.lookup.PackageBinding.getTypeOrPackage(PackageBinding.java:167)
at org.eclipse.jdt.internal.compiler.lookup.Scope.getPackage(Scope.java:2046)
at org.eclipse.jdt.internal.compiler.ast.QualifiedTypeReference.getTypeBinding(QualifiedTypeReference.java:69)
at org.eclipse.jdt.internal.compiler.ast.TypeReference.resolveType(TypeReference.java:130)
at org.eclipse.jdt.internal.compiler.lookup.SourceTypeBinding.resolveTypesFor(SourceTypeBinding.java:1358)
at org.eclipse.jdt.internal.compiler.lookup.SourceTypeBinding.methods(SourceTypeBinding.java:1099)
at org.eclipse.jdt.internal.compiler.lookup.SourceTypeBinding.faultInTypesForFieldsAndMethods(SourceTypeBinding.java:583)
at org.eclipse.jdt.internal.compiler.lookup.CompilationUnitScope.faultInTypes(CompilationUnitScope.java:428)
at org.eclipse.jdt.internal.compiler.Compiler.process(Compiler.java:589)
at org.eclipse.jdt.internal.compiler.Compiler.compile(Compiler.java:411)
at org.drools.commons.jci.compilers.EclipseJavaCompiler.compile(EclipseJavaCompiler.java:351)
at org.drools.commons.jci.compilers.AbstractJavaCompiler.compile(AbstractJavaCompiler.java:51)
at org.drools.rule.builder.dialect.java.JavaDialect.compileAll(JavaDialect.java:342)
at org.drools.compiler.DialectRegistry.compileAll(DialectRegistry.java:60)
at org.drools.compiler.PackageBuilder.addPackage(PackageBuilder.java:308)
at org.drools.compiler.PackageBuilder.addPackageFromDrl(PackageBuilder.java:167)
Why is the stream of the compiled class not being closed? Could this be related?
Thanks,
Kris
hi, I was facing similar issues some time back, though I was using a ruleflow and had >20000 fact objects evaluated daily. The problem I was facing was that the running time would get significantly slower day by day. The solution that fixed it was to use a statefulSession and call dispose() on the session once it is done. This made a single-run slower than before, but atleast fixed the problem of exponentially increasing the run-time after several days.
This might not necessarily be the ideal solution, so before you move to a StatefulSession and call session.dispose() after processing, you might want to try to increase the memory for the jvm, if is lower than the size of your facts, this might fix it.
It'd be useful to know if somebody has a better solution to Kris's problem.
Thanks,
- amOn Wed, Nov 26, 2008 at 9:35 AM, Kris Nuttycombe <kris.nuttycombe@gmail.com> wrote:
_______________________________________________Hi, all,
I'm encountering significant problems with running out of memory when executing a small ruleset (only 16 rules, < 100 facts). I've run jmap on the process (which has previously spawned multiple stateless sessions in parallel) and it looks like Drools, and specifically the Eclipse jdt compiler, is seriously eating up memory. The code calling the is fairly simple; one of the initial facts is an accumulator that I refer to later:
StatelessSession session = ruleBase.newStatelessSession();
session.execute(initialFact, accumulator);
accumulator.doSomething();
where ruleBase is a shared instance, and initialFact is a base fact that is expanded during rules processing. Is there something I should be doing to dispose the session after use to release the objects created by the drools compiler after use? I'm using a shared RuleBase, and I'm wondering whether it is somehow keeping references around. Are these sorts of object counts to be expected?
Thanks,
Kris104827 instances of class net.jxta.impl.document.LiteXMLElement$charRange Instance Counts for All Classes (excluding platform)
26806 instances of class net.jxta.impl.document.LiteXMLElement$tagRange
26733 instances of class org.eclipse.jdt.internal.compiler.lookup.MethodBinding
17366 instances of class [Lorg.eclipse.jdt.internal.compiler.lookup.TypeBinding;
12412 instances of class com.sun.enterprise.loader.EJBClassLoader$SentinelInputStream
10974 instances of class org.apache.commons.collections.SequencedHashMap$Entry
8683 instances of class org.eclipse.jdt.internal.compiler.codegen.CachedIndexEntry
7708 instances of class net.jxta.impl.document.LiteXMLElement
7450 instances of class org.hibernate.engine.CollectionKey
6836 instances of class org.netbeans.modules.schema2beans.AttrProp
6271 instances of class org.eclipse.jdt.internal.compiler.lookup.FieldBinding
5643 instances of class org.eclipse.jdt.internal.compiler.ast.MessageSend
4928 instances of class org.eclipse.jdt.internal.compiler.util.HashtableOfObject
4895 instances of class [Lorg.eclipse.jdt.internal.compiler.lookup.ReferenceBinding;
4546 instances of class org.eclipse.jdt.internal.compiler.lookup.LocalVariableBinding
4472 instances of class [Lorg.eclipse.jdt.internal.compiler.lookup.LocalVariableBinding;
4128 instances of class org.drools.rule.Pattern
3899 instances of class net.jxta.impl.id.UUID.UUID
3867 instances of class org.hibernate.engine.EntityEntry
3731 instances of class org.hibernate.collection.PersistentSet
3685 instances of class org.eclipse.jdt.internal.compiler.lookup.UnresolvedReferenceBinding
3360 instances of class org.drools.reteoo.SingleTupleSinkAdapter
3266 instances of class net.jxta.document.MimeMediaType
3264 instances of class org.drools.spi.PatternExtractor
3163 instances of class org.apache.axis.encoding.TypeMappingImpl$Pair
3137 instances of class org.hibernate.collection.PersistentBag
2881 instances of class org.eclipse.jdt.internal.compiler.lookup.MethodScope
2688 instances of class org.drools.base.ClassFieldExtractor
rules-users mailing list
rules-users@lists.jboss.org
https://lists.jboss.org/mailman/listinfo/rules-users
--
I'm worst at what I do best, and for this gift I feel blessed
-- Kurt Cobain
_______________________________________________
rules-users mailing list
rules-users@lists.jboss.org
https://lists.jboss.org/mailman/listinfo/rules-users