Hi Team, I think your help will be really helpfull for my situation, We are having 30k rules and we have converted those set of rules in to pkg files. 1. knowledgebase loading time takes upto 40 - 60 secs . Is this time ok ? 2. when we try to load 20 set of these 30k rules we are facing problems -

Any help would be helpfull . Note : Java heap space 2gb and permgen space is 512mb Thanks in Advance, M.Sundar -- View this message in context: http://drools.46999.n3.nabble.com/Reg-Handling-large-number-of-rules-tp40... Sent from the Drools: Developer (committer) mailing list mailing list archive at Nabble.com. _______________________________________________ rules-dev mailing list rules-dev(a)lists.jboss.org https://lists.jboss.org/mailman/listinfo/rules-dev

Thanks Laune for you reply , I meant 20 set as we need to have 20 x 30k rules to be loading in knowledgebase in our application. -----Original Message----- From: "laune [via Drools]" <[hidden email]> Sent: Tuesday, August 13, 2013 6:31pm To: "nmsundar" <[hidden email]> Subject: Re: Reg : Handling large number of rules On 13/08/2013, nmsundar <[hidden email]> wrote: > Hi Team, > > I think your help will be really helpfull for my situation, > > We are having 30k rules and we have converted those set of rules in to pkg > files. > > 1. knowledgebase loading time takes upto 40 - 60 secs . Is this time ok ? > 2. when we try to load 20 set of these 30k rules we are facing problems - What do you mean by "load 20 set"? Which problems? -W > Any help would be helpfull . > > Note : Java heap space 2gb and permgen space is 512mb > > Thanks in Advance, > M.Sundar > > > > -- > View this message in context: > http://drools.46999.n3.nabble.com/Reg-Handling-large-number-of-rules-tp40... > Sent from the Drools: Developer (committer) mailing list mailing list > archive at Nabble.com. > _______________________________________________ > rules-dev mailing list > [hidden email] > https://lists.jboss.org/mailman/listinfo/rules-dev > _______________________________________________ rules-dev mailing list [hidden email] https://lists.jboss.org/mailman/listinfo/rules-dev If you reply to this email, your message will be added to the discussion below: http://drools.46999.n3.nabble.com/Reg-Handling-large-number-of-rules-tp40... To unsubscribe from Reg : Handling large number of rules, click here. NAML View this message in context: Re: Reg : Handling large number of rules Sent from the Drools: Developer (committer) mailing list mailing list archive at Nabble.com. _______________________________________________ rules-dev mailing list rules-dev(a)lists.jboss.org https://lists.jboss.org/mailman/listinfo/rules-dev

On the current release, there isn't much you can do. But you could try using a profiler against 6.x, and look out for any bottlenecks. The rete builder code is fairly simple, so I'm not sure how much room for optimisation there is; but you never know what you might turn up. Probably the main gains would be from parallel rule addition, but that is a lot of work, and planned for the future - so won't help now. Always a good task for someone with some time :) You may be able to change your application to be more data driven, rather than encoding it all in the rules - this might help reduce the number of rules. Btw we are always looking for real world test cases, so maybe could submit your 600K rules as one? Mark On 13 Aug 2013, at 14:15, Mark Proctor <mproctor(a)codehaus.org&gt; wrote: > So you are loading 600K rules into one rule base, 30K rules at a time?? > > Mark > On 13 Aug 2013, at 14:10, nmsundar <sundar_m(a)solartis.net&gt; wrote: > >> Thanks Laune for you reply , >> >> I meant 20 set as we need to have 20 x 30k rules to be loading in knowledgebase in our application. >> >> >> >> -----Original Message----- >> From: "laune [via Drools]" <[hidden email]> >> Sent: Tuesday, August 13, 2013 6:31pm >> To: "nmsundar" <[hidden email]> >> Subject: Re: Reg : Handling large number of rules >> >> On 13/08/2013, nmsundar <[hidden email]> wrote: >> > Hi Team, >> > >> > I think your help will be really helpfull for my situation, >> > >> > We are having 30k rules and we have converted those set of rules in to pkg >> > files. >> > >> > 1. knowledgebase loading time takes upto 40 - 60 secs . Is this time ok ? >> > 2. when we try to load 20 set of these 30k rules we are facing problems - >> >> What do you mean by "load 20 set"? Which problems? >> -W >> >> >> >> > Any help would be helpfull . >> > >> > Note : Java heap space 2gb and permgen space is 512mb >> > >> > Thanks in Advance, >> > M.Sundar >> > >> > >> > >> > -- >> > View this message in context: >> > http://drools.46999.n3.nabble.com/Reg-Handling-large-number-of-rules-tp40... >> > Sent from the Drools: Developer (committer) mailing list mailing list >> > archive at Nabble.com. >> > _______________________________________________ >> > rules-dev mailing list >> > [hidden email] >> > https://lists.jboss.org/mailman/listinfo/rules-dev >> > >> _______________________________________________ >> rules-dev mailing list >> [hidden email] >> https://lists.jboss.org/mailman/listinfo/rules-dev >> >> >> If you reply to this email, your message will be added to the discussion below: >> http://drools.46999.n3.nabble.com/Reg-Handling-large-number-of-rules-tp40... >> To unsubscribe from Reg : Handling large number of rules, click here. >> NAML >> >> View this message in context: Re: Reg : Handling large number of rules >> Sent from the Drools: Developer (committer) mailing list mailing list archive at Nabble.com. >> _______________________________________________ >> rules-dev mailing list >> rules-dev(a)lists.jboss.org >> https://lists.jboss.org/mailman/listinfo/rules-dev >

On 13 Aug 2013, at 15:04, nmsundar <sundar_m(a)solartis.net&gt; wrote: > @Mark Proctor : > > Ok mark , I will move this to user list . > > what is the maximum number of rules kb can hold on it ? There is no maximum - it's what ever your memory and CPU can take. But largest we'd seen so far in real life was 250K for a medical system. Tbh if you are loading 600K rules in about 45seconds, that seems pretty reasonable to me. Some other commercial systems would not scale to that :) Actually thinking about this, we should be asking you to do a public testimony - "Drools scales to 600K rules for a real production system", let me know if you can :) If you do start profiling (which would be nice if you could) you can ask Qs about Drools internals here. Or on irc: http://www.jboss.org/drools/irc But further Qs on partitioning, or general "how to" or "What's recommended" Qs, should be continued on the USER list. Mark > > > > -- > View this message in context: http://drools.46999.n3.nabble.com/Reg-Handling-large-number-of-rules-tp40... > Sent from the Drools: Developer (committer) mailing list mailing list archive at Nabble.com. > _______________________________________________ > rules-dev mailing list > rules-dev(a)lists.jboss.org > https://lists.jboss.org/mailman/listinfo/rules-dev

@Mark: That's a bit hasty. OP reported "problems" when trying to do the 20 times 30k rules. And the loading time of 40 - 60 seconds was reported for a measly 30k rules.

-W On 13/08/2013, Mark Proctor <mproctor(a)codehaus.org&gt; wrote: > https://plus.google.com/103145805595719456130/posts/8cuDsNtURXE > > :) > > Mark > On 13 Aug 2013, at 15:13, Mark Proctor <mproctor(a)codehaus.org&gt; wrote: > >> >> On 13 Aug 2013, at 15:04, nmsundar <sundar_m(a)solartis.net&gt; wrote: >> >>> @Mark Proctor : >>> >>> Ok mark , I will move this to user list . >>> >>> what is the maximum number of rules kb can hold on it ? >> There is no maximum - it's what ever your memory and CPU can take. But >> largest we'd seen so far in real life was 250K for a medical system. >> >> Tbh if you are loading 600K rules in about 45seconds, that seems pretty >> reasonable to me. Some other commercial systems would not scale to that >> :) >> >> Actually thinking about this, we should be asking you to do a public >> testimony - "Drools scales to 600K rules for a real production system", >> let me know if you can :) >> >> If you do start profiling (which would be nice if you could) you can ask >> Qs about Drools internals here. Or on irc: >> http://www.jboss.org/drools/irc >> >> But further Qs on partitioning, or general "how to" or "What's >> recommended" Qs, should be continued on the USER list. >> >> Mark >> >>> >>> >>> >>> -- >>> View this message in context: >>> http://drools.46999.n3.nabble.com/Reg-Handling-large-number-of-rules-tp40... >>> Sent from the Drools: Developer (committer) mailing list mailing list >>> archive at Nabble.com. >>> _______________________________________________ >>> rules-dev mailing list >>> rules-dev(a)lists.jboss.org >>> https://lists.jboss.org/mailman/listinfo/rules-dev >> > > _______________________________________________ rules-dev mailing list rules-dev(a)lists.jboss.org https://lists.jboss.org/mailman/listinfo/rules-dev

@Mark : can you please do us a favor, It would be really helpful You stated in above reply as ("But largest we'd seen so far in real life was 250K for a medical system.") can I know what is the memory and cpu that holds on that number of rules.

Thanks in advance. -- View this message in context: http://drools.46999.n3.nabble.com/Reg-Handling-large-number-of-rules-tp40... Sent from the Drools: Developer (committer) mailing list mailing list archive at Nabble.com. _______________________________________________ rules-dev mailing list rules-dev(a)lists.jboss.org https://lists.jboss.org/mailman/listinfo/rules-dev