[rules-users] Can Drools supply large Knowledge Base?

[WangRamon]

Thanks Thomas! The solutions you provided are great, can you give more explanation on your second point "Use accumulating facts and only keep the data you need in memory", thanks. CheersRamon
 From: TSwindells at nds.com
To: rules-users at lists.jboss.org
Date: Mon, 12 Dec 2011 09:24:14 +0000
Subject: Re: [rules-users] Can Drools supply large Knowledge Base?











I think you are mixing up terms which doesn¡¯t help.
I think you mean you may have 100GB of facts that will be in your distributed database. Unless you are planning to do some odd automatic rule generation you
 will have to write the rules by hand and so will only have a relatively small number of rules in your application ¨C this will easily fit in memory.
 
If 100GB is the size of the facts you have then clearly you can¡¯t hold them all in memory of a single machine. Drools is effectively a special in memory database,
 in order to perform its processing it needs the relevant data.
You basically have these options which of these will work depends on your use case and in reality you¡¯ll probably need to combine them:
1.      
Use partitioning, rather than having 1 set of 100 gb of data, have 10 sets of 10 gbs running on ten machines. Many times you
 may be able to partition by customer ID or some other natural value which may give you good enough results.
2.      
Use accumulating facts and only keep the data you need in memory, eg if you need to know how many orders a customer has made
 then don¡¯t keep all the orders in memory, just a simple object containing the total.
3.      
Don¡¯t use drools, depending on what you are doing it may be better just to use normal db queries to extract the data you need.
 It may be you get the query results, insert them into a new short lived session, fire the rules and then get the results of the drools processing.
 
Thomas
 



From: rules-users-bounces at lists.jboss.org [mailto:rules-users-bounces at lists.jboss.org]
On Behalf Of WangRamon

Sent: 12 December 2011 09:11

To: rules-users at lists.jboss.org

Subject: Re: [rules-users] Can Drools supply large Knowledge Base?


 

Hi Guys

 

I'm still confused about this question, let's say i may have a very large rule set, how can Drools support this case, will it load every rule into memory? Any idea? Thank you guys.

 

Cheers

Ramon

 




From: ramon_wang at hotmail.com

To: rules-users at lists.jboss.org

Date: Thu, 8 Dec 2011 11:59:21 +0800

Subject: [rules-users] Can Drools supply large Knowledge Base?

Hi All


 

I'm new to Drools, I will build a very large Knowledge Base, let's say it will be larger than 100GB, the files will be stored in a distribute database, so can Droools supply this large Knowledge Base? Any solution? Thank you very much. 


 

Cheers

Ramon



_______________________________________________ rules-users mailing list 
rules-users at lists.jboss.org 
https://lists.jboss.org/mailman/listinfo/rules-users









**************************************************************************************

This message is confidential and intended only for the addressee. If you have received this message in error, please immediately notify the postmaster at nds.com and delete it from your system as well as any copies. The content of e-mails as well as traffic data
 may be monitored by NDS for employment and security purposes. To protect the environment please do not print this e-mail unless necessary.



NDS Limited. Registered Office: One London Road, Staines, Middlesex, TW18 4EX, United Kingdom. A company registered in England and Wales. Registered no. 3080780. VAT no. GB 603 8808 40-00

**************************************************************************************





_______________________________________________
rules-users mailing list
rules-users at lists.jboss.org
https://lists.jboss.org/mailman/listinfo/rules-users 		 	   		  
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.jboss.org/pipermail/rules-users/attachments/20111212/d2ab0599/attachment.html