[rules-users] Rule processing for High volume input

[Greg Barton]

I'm assuming you'll be running each rule base in a separate thread simultaneously?  There are no dependencies between the rules in the five rule bases?  If so, that will work just fine.  

If your rules are simple enough you can use sequential mode.  It can speed up execution quite a bit. 

http://downloads.jboss.com/drools/docs/4.0.7.19894.GA/html_single/index.html#d0e1295

This could be used in conjunction with the simultaneous execution above.

Finally, you can get some multithreaded benefit in a single rule session if you're using drools 5 and turn on rule base partitioning.  As I understand it this works best when the rules have less join conditions in them. (i.e. mostly single object conditions, and less multi-object conditions.)

--- On Thu, 11/6/08, techy <techluver007 at gmail.com> wrote:

> From: techy <techluver007 at gmail.com>
> Subject: [rules-users] Rule processing for High volume input
> To: rules-users at lists.jboss.org
> Date: Thursday, November 6, 2008, 3:41 PM
> I have to run rules(1000 rules) against 20-30 million of
> record each day.
> I guess I would have memory issue If I insert all of
> records into working
> memory.
> 
> so I'm thinking to have multiple rule base instance and
> do batch processing
> as given below.so that I can avoid memory issue and quick
> rule processing
> 
> 
> a.Take  first 1 million records and distribute 1 millon
> across working
> memory of 5 rule base.
> b.fire rules in all 5 rule base
> c.clear working memory of all rule base
> d. take next 1 million record and start from step-a till I
> process all of
> the records.
> 
> 
> Please advise whether this is possible/recommended way or
> not.
> 
> thanks
> -- 
> View this message in context:
> http://www.nabble.com/Rule-processing-for-High-volume-input-tp20370272p20370272.html
> Sent from the drools - user mailing list archive at
> Nabble.com.
> 
> _______________________________________________
> rules-users mailing list
> rules-users at lists.jboss.org
> https://lists.jboss.org/mailman/listinfo/rules-users