[JBoss JIRA] Created: (JBRULES-2685) Performance degradation from 5.0.1 to 5.1.0

[JBoss JIRA] (JGRP-1445) Null...

[JBoss JIRA] (AS7-4410) Add...

Greg Barton (JIRA)

Thursday, 2 September 2010 Thu, 2 Sep '10

10:16 p.m.

Performance degradation from 5.0.1 to 5.1.0 ------------------------------------------- Key: JBRULES-2685 URL: https://jira.jboss.org/browse/JBRULES-2685 Project: Drools Issue Type: Quality Risk Security Level: Public (Everyone can see) Components: drools-core Affects Versions: 5.1.0.FINAL Environment: OSX 1.6.2 Reporter: Greg Barton Assignee: Mark Proctor Priority: Minor Attachments: DroolsNested.tar.gz I've observed a sizable (25%) performance degradation between the 5.0.1 and 5.1.0 releases. I've attached a sample project that tests the performance of matching nested objects. (ANd compares direct reference matching and the performance pitfalls of "from," but that's beside the current point.) If you switch the pom.xml from using 5.0.1 to 5.1.0 for the drools dependencies you'll see 25% longer execution times on the tests. (mvn test) Here's the test output: 5.0.1 reference.drl Count: 2000 reference.drl Time: 267ms reference.drl Time per element: 0.1335ms BAR Duplicates: 780 FOO Duplicates: 880 reference.drl Count: 20000 reference.drl Time: 1249ms reference.drl Time per element: 0.06245ms BAR Duplicates: 7702 FOO Duplicates: 8040 from.drl Count: 200 from.drl Time: 1139ms from.drl Time per element: 5.695ms BAR Duplicates: 112 FOO Duplicates: 102 reference.drl Count: 200 reference.drl Time: 5ms reference.drl Time per element: 0.025ms BAR Duplicates: 86 FOO Duplicates: 60 5.1.0 reference.drl Count: 2000 reference.drl Time: 300ms reference.drl Time per element: 0.15ms BAR Duplicates: 788 FOO Duplicates: 820 reference.drl Count: 20000 reference.drl Time: 1564ms reference.drl Time per element: 0.0782ms BAR Duplicates: 8142 FOO Duplicates: 7960 from.drl Count: 200 from.drl Time: 3543ms from.drl Time per element: 17.715ms BAR Duplicates: 68 FOO Duplicates: 90 reference.drl Count: 200 reference.drl Time: 13ms reference.drl Time per element: 0.065ms BAR Duplicates: 84 FOO Duplicates: 74 On the most taxing test (20k objects) 5.0.1 took 1249ms while 5.1.0 took 1564ms, and for larger tests the effect is more pronounced. This is primarily a test of == on object references. -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: https://jira.jboss.org/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira

Show replies by date

Greg Barton (JIRA)

Thursday, 2 September Thu, 2 Sep

10:16 p.m.

New subject: [JBoss JIRA] Updated: (JBRULES-2685) Performance degradation from 5.0.1 to 5.1.0

[ https://jira.jboss.org/browse/JBRULES-2685?page=com.atlassian.jira.plugin... ] Greg Barton updated JBRULES-2685: --------------------------------- Attachment: DroolsNested.tar.gz Change drools version in the pom.xml to demonstrate performance difference.

...

Performance degradation from 5.0.1 to 5.1.0 ------------------------------------------- Key: JBRULES-2685 URL: https://jira.jboss.org/browse/JBRULES-2685 Project: Drools Issue Type: Quality Risk Security Level: Public(Everyone can see) Components: drools-core Affects Versions: 5.1.0.FINAL Environment: OSX 1.6.2 Reporter: Greg Barton Assignee: Mark Proctor Priority: Minor Attachments: DroolsNested.tar.gz I've observed a sizable (25%) performance degradation between the 5.0.1 and 5.1.0 releases. I've attached a sample project that tests the performance of matching nested objects. (ANd compares direct reference matching and the performance pitfalls of "from," but that's beside the current point.) If you switch the pom.xml from using 5.0.1 to 5.1.0 for the drools dependencies you'll see 25% longer execution times on the tests. (mvn test) Here's the test output: 5.0.1 reference.drl Count: 2000 reference.drl Time: 267ms reference.drl Time per element: 0.1335ms BAR Duplicates: 780 FOO Duplicates: 880 reference.drl Count: 20000 reference.drl Time: 1249ms reference.drl Time per element: 0.06245ms BAR Duplicates: 7702 FOO Duplicates: 8040 from.drl Count: 200 from.drl Time: 1139ms from.drl Time per element: 5.695ms BAR Duplicates: 112 FOO Duplicates: 102 reference.drl Count: 200 reference.drl Time: 5ms reference.drl Time per element: 0.025ms BAR Duplicates: 86 FOO Duplicates: 60 5.1.0 reference.drl Count: 2000 reference.drl Time: 300ms reference.drl Time per element: 0.15ms BAR Duplicates: 788 FOO Duplicates: 820 reference.drl Count: 20000 reference.drl Time: 1564ms reference.drl Time per element: 0.0782ms BAR Duplicates: 8142 FOO Duplicates: 7960 from.drl Count: 200 from.drl Time: 3543ms from.drl Time per element: 17.715ms BAR Duplicates: 68 FOO Duplicates: 90 reference.drl Count: 200 reference.drl Time: 13ms reference.drl Time per element: 0.065ms BAR Duplicates: 84 FOO Duplicates: 74 On the most taxing test (20k objects) 5.0.1 took 1249ms while 5.1.0 took 1564ms, and for larger tests the effect is more pronounced. This is primarily a test of == on object references.

-- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: https://jira.jboss.org/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira

Greg Barton (JIRA)

10:21 p.m.

New subject: [JBoss JIRA] Updated: (JBRULES-2685) Performance degradation from 5.0.1 to 5.1.0

[ https://jira.jboss.org/browse/JBRULES-2685?page=com.atlassian.jira.plugin... ] Greg Barton updated JBRULES-2685: --------------------------------- Environment: OSX 10.6.4 (was: OSX 1.6.2)

...

Performance degradation from 5.0.1 to 5.1.0 ------------------------------------------- Key: JBRULES-2685 URL: https://jira.jboss.org/browse/JBRULES-2685 Project: Drools Issue Type: Quality Risk Security Level: Public(Everyone can see) Components: drools-core Affects Versions: 5.1.0.FINAL Environment: OSX 10.6.4 Reporter: Greg Barton Assignee: Mark Proctor Priority: Minor Attachments: DroolsNested.tar.gz I've observed a sizable (25%) performance degradation between the 5.0.1 and 5.1.0 releases. I've attached a sample project that tests the performance of matching nested objects. (ANd compares direct reference matching and the performance pitfalls of "from," but that's beside the current point.) If you switch the pom.xml from using 5.0.1 to 5.1.0 for the drools dependencies you'll see 25% longer execution times on the tests. (mvn test) Here's the test output: 5.0.1 reference.drl Count: 2000 reference.drl Time: 267ms reference.drl Time per element: 0.1335ms BAR Duplicates: 780 FOO Duplicates: 880 reference.drl Count: 20000 reference.drl Time: 1249ms reference.drl Time per element: 0.06245ms BAR Duplicates: 7702 FOO Duplicates: 8040 from.drl Count: 200 from.drl Time: 1139ms from.drl Time per element: 5.695ms BAR Duplicates: 112 FOO Duplicates: 102 reference.drl Count: 200 reference.drl Time: 5ms reference.drl Time per element: 0.025ms BAR Duplicates: 86 FOO Duplicates: 60 5.1.0 reference.drl Count: 2000 reference.drl Time: 300ms reference.drl Time per element: 0.15ms BAR Duplicates: 788 FOO Duplicates: 820 reference.drl Count: 20000 reference.drl Time: 1564ms reference.drl Time per element: 0.0782ms BAR Duplicates: 8142 FOO Duplicates: 7960 from.drl Count: 200 from.drl Time: 3543ms from.drl Time per element: 17.715ms BAR Duplicates: 68 FOO Duplicates: 90 reference.drl Count: 200 reference.drl Time: 13ms reference.drl Time per element: 0.065ms BAR Duplicates: 84 FOO Duplicates: 74 On the most taxing test (20k objects) 5.0.1 took 1249ms while 5.1.0 took 1564ms, and for larger tests the effect is more pronounced. This is primarily a test of == on object references.

Mark Proctor (JIRA)

Tuesday, 17 May Tue, 17 May

10:12 p.m.

New subject: [JBoss JIRA] Assigned: (JBRULES-2685) Performance degradation from 5.0.1 to 5.1.0

[ https://issues.jboss.org/browse/JBRULES-2685?page=com.atlassian.jira.plug... ] Mark Proctor reassigned JBRULES-2685: ------------------------------------- Assignee: Geoffrey De Smet (was: Mark Proctor) Geofrey: Can you check if this perf regression has been fixed.

...

Performance degradation from 5.0.1 to 5.1.0 ------------------------------------------- Key: JBRULES-2685 URL: https://issues.jboss.org/browse/JBRULES-2685 Project: Drools Issue Type: Quality Risk Security Level: Public(Everyone can see) Components: drools-core Affects Versions: 5.1.0.FINAL Environment: OSX 10.6.4 Reporter: Greg Barton Assignee: Geoffrey De Smet Priority: Minor Fix For: 5.2.0.CR1 Attachments: DroolsNested.tar.gz I've observed a sizable (25%) performance degradation between the 5.0.1 and 5.1.0 releases. I've attached a sample project that tests the performance of matching nested objects. (ANd compares direct reference matching and the performance pitfalls of "from," but that's beside the current point.) If you switch the pom.xml from using 5.0.1 to 5.1.0 for the drools dependencies you'll see 25% longer execution times on the tests. (mvn test) Here's the test output: 5.0.1 reference.drl Count: 2000 reference.drl Time: 267ms reference.drl Time per element: 0.1335ms BAR Duplicates: 780 FOO Duplicates: 880 reference.drl Count: 20000 reference.drl Time: 1249ms reference.drl Time per element: 0.06245ms BAR Duplicates: 7702 FOO Duplicates: 8040 from.drl Count: 200 from.drl Time: 1139ms from.drl Time per element: 5.695ms BAR Duplicates: 112 FOO Duplicates: 102 reference.drl Count: 200 reference.drl Time: 5ms reference.drl Time per element: 0.025ms BAR Duplicates: 86 FOO Duplicates: 60 5.1.0 reference.drl Count: 2000 reference.drl Time: 300ms reference.drl Time per element: 0.15ms BAR Duplicates: 788 FOO Duplicates: 820 reference.drl Count: 20000 reference.drl Time: 1564ms reference.drl Time per element: 0.0782ms BAR Duplicates: 8142 FOO Duplicates: 7960 from.drl Count: 200 from.drl Time: 3543ms from.drl Time per element: 17.715ms BAR Duplicates: 68 FOO Duplicates: 90 reference.drl Count: 200 reference.drl Time: 13ms reference.drl Time per element: 0.065ms BAR Duplicates: 84 FOO Duplicates: 74 On the most taxing test (20k objects) 5.0.1 took 1249ms while 5.1.0 took 1564ms, and for larger tests the effect is more pronounced. This is primarily a test of == on object references.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Mark Proctor (JIRA)

10:12 p.m.

New subject: [JBoss JIRA] Updated: (JBRULES-2685) Performance degradation from 5.0.1 to 5.1.0

[ https://issues.jboss.org/browse/JBRULES-2685?page=com.atlassian.jira.plug... ] Mark Proctor updated JBRULES-2685: ---------------------------------- Fix Version/s: 5.2.0.CR1

...

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Geoffrey De Smet (JIRA)

Wednesday, 18 May Wed, 18 May

9:58 a.m.

New subject: [JBoss JIRA] Commented: (JBRULES-2685) Performance degradation from 5.0.1 to 5.1.0

[ https://issues.jboss.org/browse/JBRULES-2685?page=com.atlassian.jira.plug... ] Geoffrey De Smet commented on JBRULES-2685: ------------------------------------------- First runs indicate it's still there from the fromTest (not really the other 3), but the length of these test are so short (1-2 seconds) that it could be just the hotspot compiler kicking in or an early gc. I'll see if I can smear out the tests.

...

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Greg Barton (JIRA)

10:27 a.m.

New subject: [JBoss JIRA] Commented: (JBRULES-2685) Performance degradation from 5.0.1 to 5.1.0

[ https://issues.jboss.org/browse/JBRULES-2685?page=com.atlassian.jira.plug... ] Greg Barton commented on JBRULES-2685: -------------------------------------- Confirmed. With fromTest looks like it's still there with current 5.2.0-SNAPSHOT, and even more pronounced. Iterating through multiple calls to DroolsTest.go() inside each test "smears" it. Here's the best run out of 10 from each version, which tended to be near the end of the runs, as you'd expect from hotspot kicking in: 5.2.0-SNAPSHOT: from.drl Count: 200 from.drl Time: 793ms from.drl Time per element: 3.965ms BAR Duplicates: 72 FOO Duplicates: 78 reference.drl Count: 80000 reference.drl Time: 780ms reference.drl Time per element: 0.00975ms BAR Duplicates: 32198 FOO Duplicates: 32150 5.0.1: from.drl Count: 200 from.drl Time: 117ms from.drl Time per element: 0.585ms BAR Duplicates: 76 FOO Duplicates: 72 reference.drl Count: 80000 reference.drl Time: 1040ms reference.drl Time per element: 0.013ms BAR Duplicates: 31720 FOO Duplicates: 31840

...

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Geoffrey De Smet (JIRA)

10:29 a.m.

New subject: [JBoss JIRA] Commented: (JBRULES-2685) Performance degradation from 5.0.1 to 5.1.0

[ https://issues.jboss.org/browse/JBRULES-2685?page=com.atlassian.jira.plug... ] Geoffrey De Smet commented on JBRULES-2685: ------------------------------------------- It's still there More data, in ms: 5.0.1 => 5.3.0-SNAPSHOT (note that 5.1.1 is similar behaviour to 5.3.0) ref200: 1574 => 1197 (this includes warmup so ignore it) ref2000: 172 => 221 (too short, so ignore it) ref20000: 495 => 661 (too short, so ignore it) from200: 335 => 1780 hmm times 5 from500: 1250 => 15704 times 12 <===== Difference in BigO from1000: 5186 => 179218 times 34 <===== Difference in BigO

...

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Geoffrey De Smet (JIRA)

10:39 a.m.

New subject: [JBoss JIRA] Updated: (JBRULES-2685) Performance degradation from 5.0.1 to 5.1.0

[ https://issues.jboss.org/browse/JBRULES-2685?page=com.atlassian.jira.plug... ] Geoffrey De Smet updated JBRULES-2685: -------------------------------------- Attachment: (was: DroolsNested.tar.gz)

...

Performance degradation from 5.0.1 to 5.1.0 ------------------------------------------- Key: JBRULES-2685 URL: https://issues.jboss.org/browse/JBRULES-2685 Project: Drools Issue Type: Quality Risk Security Level: Public(Everyone can see) Components: drools-core Affects Versions: 5.1.0.FINAL Environment: OSX 10.6.4 Reporter: Greg Barton Assignee: Geoffrey De Smet Priority: Minor Fix For: 5.2.0.CR1 Attachments: DroolsNested2.zip I've observed a sizable (25%) performance degradation between the 5.0.1 and 5.1.0 releases. I've attached a sample project that tests the performance of matching nested objects. (ANd compares direct reference matching and the performance pitfalls of "from," but that's beside the current point.) If you switch the pom.xml from using 5.0.1 to 5.1.0 for the drools dependencies you'll see 25% longer execution times on the tests. (mvn test) Here's the test output: 5.0.1 reference.drl Count: 2000 reference.drl Time: 267ms reference.drl Time per element: 0.1335ms BAR Duplicates: 780 FOO Duplicates: 880 reference.drl Count: 20000 reference.drl Time: 1249ms reference.drl Time per element: 0.06245ms BAR Duplicates: 7702 FOO Duplicates: 8040 from.drl Count: 200 from.drl Time: 1139ms from.drl Time per element: 5.695ms BAR Duplicates: 112 FOO Duplicates: 102 reference.drl Count: 200 reference.drl Time: 5ms reference.drl Time per element: 0.025ms BAR Duplicates: 86 FOO Duplicates: 60 5.1.0 reference.drl Count: 2000 reference.drl Time: 300ms reference.drl Time per element: 0.15ms BAR Duplicates: 788 FOO Duplicates: 820 reference.drl Count: 20000 reference.drl Time: 1564ms reference.drl Time per element: 0.0782ms BAR Duplicates: 8142 FOO Duplicates: 7960 from.drl Count: 200 from.drl Time: 3543ms from.drl Time per element: 17.715ms BAR Duplicates: 68 FOO Duplicates: 90 reference.drl Count: 200 reference.drl Time: 13ms reference.drl Time per element: 0.065ms BAR Duplicates: 84 FOO Duplicates: 74 On the most taxing test (20k objects) 5.0.1 took 1249ms while 5.1.0 took 1564ms, and for larger tests the effect is more pronounced. This is primarily a test of == on object references.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Geoffrey De Smet (JIRA)

10:39 a.m.

New subject: [JBoss JIRA] Updated: (JBRULES-2685) Performance degradation from 5.0.1 to 5.1.0

[ https://issues.jboss.org/browse/JBRULES-2685?page=com.atlassian.jira.plug... ] Geoffrey De Smet updated JBRULES-2685: -------------------------------------- Attachment: DroolsNested2.zip

...

Performance degradation from 5.0.1 to 5.1.0 ------------------------------------------- Key: JBRULES-2685 URL: https://issues.jboss.org/browse/JBRULES-2685 Project: Drools Issue Type: Quality Risk Security Level: Public(Everyone can see) Components: drools-core Affects Versions: 5.1.0.FINAL Environment: OSX 10.6.4 Reporter: Greg Barton Assignee: Geoffrey De Smet Priority: Minor Fix For: 5.2.0.CR1 Attachments: DroolsNested2.zip I've observed a sizable (25%) performance degradation between the 5.0.1 and 5.1.0 releases. I've attached a sample project that tests the performance of matching nested objects. (ANd compares direct reference matching and the performance pitfalls of "from," but that's beside the current point.) If you switch the pom.xml from using 5.0.1 to 5.1.0 for the drools dependencies you'll see 25% longer execution times on the tests. (mvn test) Here's the test output: 5.0.1 reference.drl Count: 2000 reference.drl Time: 267ms reference.drl Time per element: 0.1335ms BAR Duplicates: 780 FOO Duplicates: 880 reference.drl Count: 20000 reference.drl Time: 1249ms reference.drl Time per element: 0.06245ms BAR Duplicates: 7702 FOO Duplicates: 8040 from.drl Count: 200 from.drl Time: 1139ms from.drl Time per element: 5.695ms BAR Duplicates: 112 FOO Duplicates: 102 reference.drl Count: 200 reference.drl Time: 5ms reference.drl Time per element: 0.025ms BAR Duplicates: 86 FOO Duplicates: 60 5.1.0 reference.drl Count: 2000 reference.drl Time: 300ms reference.drl Time per element: 0.15ms BAR Duplicates: 788 FOO Duplicates: 820 reference.drl Count: 20000 reference.drl Time: 1564ms reference.drl Time per element: 0.0782ms BAR Duplicates: 8142 FOO Duplicates: 7960 from.drl Count: 200 from.drl Time: 3543ms from.drl Time per element: 17.715ms BAR Duplicates: 68 FOO Duplicates: 90 reference.drl Count: 200 reference.drl Time: 13ms reference.drl Time per element: 0.065ms BAR Duplicates: 84 FOO Duplicates: 74 On the most taxing test (20k objects) 5.0.1 took 1249ms while 5.1.0 took 1564ms, and for larger tests the effect is more pronounced. This is primarily a test of == on object references.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Geoffrey De Smet (JIRA)

10:42 a.m.

New subject: [JBoss JIRA] Issue Comment Edited: (JBRULES-2685) Performance degradation from 5.0.1 to 5.1.0

[ https://issues.jboss.org/browse/JBRULES-2685?page=com.atlassian.jira.plug... ] Geoffrey De Smet edited comment on JBRULES-2685 at 5/18/11 11:41 AM: --------------------------------------------------------------------- It's still there More data, in ms: 5.0.1 => 5.3.0-SNAPSHOT (note that 5.1.1 is similar behaviour to 5.3.0) ref200: 1574 => 1197 (this includes warmup so ignore it) ref2000: 172 => 221 (too short, so ignore it) ref20000: 495 => 661 (too short, so ignore it) from200: 335 => 1780 which is times 5 from500: 1250 => 15704 which is times 12 <===== Difference in BigO ! from1000: 5186 => 179218 which is times 34 <===== Difference in BigO ! was (Author: ge0ffrey): It's still there More data, in ms: 5.0.1 => 5.3.0-SNAPSHOT (note that 5.1.1 is similar behaviour to 5.3.0) ref200: 1574 => 1197 (this includes warmup so ignore it) ref2000: 172 => 221 (too short, so ignore it) ref20000: 495 => 661 (too short, so ignore it) from200: 335 => 1780 hmm times 5 from500: 1250 => 15704 times 12 <===== Difference in BigO from1000: 5186 => 179218 times 34 <===== Difference in BigO

...

Performance degradation from 5.0.1 to 5.1.0 ------------------------------------------- Key: JBRULES-2685 URL: https://issues.jboss.org/browse/JBRULES-2685 Project: Drools Issue Type: Quality Risk Security Level: Public(Everyone can see) Components: drools-core Affects Versions: 5.1.0.FINAL Environment: OSX 10.6.4 Reporter: Greg Barton Assignee: Geoffrey De Smet Priority: Minor Fix For: 5.2.0.CR1 Attachments: DroolsNested2.zip I've observed a sizable (25%) performance degradation between the 5.0.1 and 5.1.0 releases. I've attached a sample project that tests the performance of matching nested objects. (ANd compares direct reference matching and the performance pitfalls of "from," but that's beside the current point.) If you switch the pom.xml from using 5.0.1 to 5.1.0 for the drools dependencies you'll see 25% longer execution times on the tests. (mvn test) Here's the test output: 5.0.1 reference.drl Count: 2000 reference.drl Time: 267ms reference.drl Time per element: 0.1335ms BAR Duplicates: 780 FOO Duplicates: 880 reference.drl Count: 20000 reference.drl Time: 1249ms reference.drl Time per element: 0.06245ms BAR Duplicates: 7702 FOO Duplicates: 8040 from.drl Count: 200 from.drl Time: 1139ms from.drl Time per element: 5.695ms BAR Duplicates: 112 FOO Duplicates: 102 reference.drl Count: 200 reference.drl Time: 5ms reference.drl Time per element: 0.025ms BAR Duplicates: 86 FOO Duplicates: 60 5.1.0 reference.drl Count: 2000 reference.drl Time: 300ms reference.drl Time per element: 0.15ms BAR Duplicates: 788 FOO Duplicates: 820 reference.drl Count: 20000 reference.drl Time: 1564ms reference.drl Time per element: 0.0782ms BAR Duplicates: 8142 FOO Duplicates: 7960 from.drl Count: 200 from.drl Time: 3543ms from.drl Time per element: 17.715ms BAR Duplicates: 68 FOO Duplicates: 90 reference.drl Count: 200 reference.drl Time: 13ms reference.drl Time per element: 0.065ms BAR Duplicates: 84 FOO Duplicates: 74 On the most taxing test (20k objects) 5.0.1 took 1249ms while 5.1.0 took 1564ms, and for larger tests the effect is more pronounced. This is primarily a test of == on object references.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Edson Tirelli (JIRA)

10:44 a.m.

New subject: [JBoss JIRA] Assigned: (JBRULES-2685) Performance degradation from 5.0.1 to 5.1.0

[ https://issues.jboss.org/browse/JBRULES-2685?page=com.atlassian.jira.plug... ] Edson Tirelli reassigned JBRULES-2685: -------------------------------------- Assignee: Edson Tirelli (was: Geoffrey De Smet)

...

Performance degradation from 5.0.1 to 5.1.0 ------------------------------------------- Key: JBRULES-2685 URL: https://issues.jboss.org/browse/JBRULES-2685 Project: Drools Issue Type: Quality Risk Security Level: Public(Everyone can see) Components: drools-core Affects Versions: 5.1.0.FINAL Environment: OSX 10.6.4 Reporter: Greg Barton Assignee: Edson Tirelli Priority: Minor Fix For: 5.2.0.CR1 Attachments: DroolsNested2.zip I've observed a sizable (25%) performance degradation between the 5.0.1 and 5.1.0 releases. I've attached a sample project that tests the performance of matching nested objects. (ANd compares direct reference matching and the performance pitfalls of "from," but that's beside the current point.) If you switch the pom.xml from using 5.0.1 to 5.1.0 for the drools dependencies you'll see 25% longer execution times on the tests. (mvn test) Here's the test output: 5.0.1 reference.drl Count: 2000 reference.drl Time: 267ms reference.drl Time per element: 0.1335ms BAR Duplicates: 780 FOO Duplicates: 880 reference.drl Count: 20000 reference.drl Time: 1249ms reference.drl Time per element: 0.06245ms BAR Duplicates: 7702 FOO Duplicates: 8040 from.drl Count: 200 from.drl Time: 1139ms from.drl Time per element: 5.695ms BAR Duplicates: 112 FOO Duplicates: 102 reference.drl Count: 200 reference.drl Time: 5ms reference.drl Time per element: 0.025ms BAR Duplicates: 86 FOO Duplicates: 60 5.1.0 reference.drl Count: 2000 reference.drl Time: 300ms reference.drl Time per element: 0.15ms BAR Duplicates: 788 FOO Duplicates: 820 reference.drl Count: 20000 reference.drl Time: 1564ms reference.drl Time per element: 0.0782ms BAR Duplicates: 8142 FOO Duplicates: 7960 from.drl Count: 200 from.drl Time: 3543ms from.drl Time per element: 17.715ms BAR Duplicates: 68 FOO Duplicates: 90 reference.drl Count: 200 reference.drl Time: 13ms reference.drl Time per element: 0.065ms BAR Duplicates: 84 FOO Duplicates: 74 On the most taxing test (20k objects) 5.0.1 took 1249ms while 5.1.0 took 1564ms, and for larger tests the effect is more pronounced. This is primarily a test of == on object references.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Geoffrey De Smet (JIRA)

10:50 a.m.

New subject: [JBoss JIRA] Commented: (JBRULES-2685) Performance degradation from 5.0.1 to 5.1.0

[ https://issues.jboss.org/browse/JBRULES-2685?page=com.atlassian.jira.plug... ] Geoffrey De Smet commented on JBRULES-2685: ------------------------------------------- The from test clearly shows a difference in scalability (a difference in BigO) Greg, tnx for finding and reporting it Handing over to Edson. To reproduce: open zip and run SimpleTest Then play around in the pom.xml with the uncommented lines in <dependencies>

...

Performance degradation from 5.0.1 to 5.1.0 ------------------------------------------- Key: JBRULES-2685 URL: https://issues.jboss.org/browse/JBRULES-2685 Project: Drools Issue Type: Quality Risk Security Level: Public(Everyone can see) Components: drools-core Affects Versions: 5.1.0.FINAL Environment: OSX 10.6.4 Reporter: Greg Barton Assignee: Edson Tirelli Priority: Minor Fix For: 5.2.0.CR1 Attachments: DroolsNested2.zip I've observed a sizable (25%) performance degradation between the 5.0.1 and 5.1.0 releases. I've attached a sample project that tests the performance of matching nested objects. (ANd compares direct reference matching and the performance pitfalls of "from," but that's beside the current point.) If you switch the pom.xml from using 5.0.1 to 5.1.0 for the drools dependencies you'll see 25% longer execution times on the tests. (mvn test) Here's the test output: 5.0.1 reference.drl Count: 2000 reference.drl Time: 267ms reference.drl Time per element: 0.1335ms BAR Duplicates: 780 FOO Duplicates: 880 reference.drl Count: 20000 reference.drl Time: 1249ms reference.drl Time per element: 0.06245ms BAR Duplicates: 7702 FOO Duplicates: 8040 from.drl Count: 200 from.drl Time: 1139ms from.drl Time per element: 5.695ms BAR Duplicates: 112 FOO Duplicates: 102 reference.drl Count: 200 reference.drl Time: 5ms reference.drl Time per element: 0.025ms BAR Duplicates: 86 FOO Duplicates: 60 5.1.0 reference.drl Count: 2000 reference.drl Time: 300ms reference.drl Time per element: 0.15ms BAR Duplicates: 788 FOO Duplicates: 820 reference.drl Count: 20000 reference.drl Time: 1564ms reference.drl Time per element: 0.0782ms BAR Duplicates: 8142 FOO Duplicates: 7960 from.drl Count: 200 from.drl Time: 3543ms from.drl Time per element: 17.715ms BAR Duplicates: 68 FOO Duplicates: 90 reference.drl Count: 200 reference.drl Time: 13ms reference.drl Time per element: 0.065ms BAR Duplicates: 84 FOO Duplicates: 74 On the most taxing test (20k objects) 5.0.1 took 1249ms while 5.1.0 took 1564ms, and for larger tests the effect is more pronounced. This is primarily a test of == on object references.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Mark Proctor (JIRA)

1:27 p.m.

New subject: [JBoss JIRA] Commented: (JBRULES-2685) Performance degradation from 5.0.1 to 5.1.0

[ https://issues.jboss.org/browse/JBRULES-2685?page=com.atlassian.jira.plug... ] Mark Proctor commented on JBRULES-2685: --------------------------------------- The good news is the "reference" drls are consistently faster on 5.2 by almost 40%, compared to 5.0.1, so that's a plus :) Compared to the 5.0.1 vs 5.1.0, where 5.0.1 was faster for both tests. I'm looking into "from" now.

...

Performance degradation from 5.0.1 to 5.1.0 ------------------------------------------- Key: JBRULES-2685 URL: https://issues.jboss.org/browse/JBRULES-2685 Project: Drools Issue Type: Quality Risk Security Level: Public(Everyone can see) Components: drools-core Affects Versions: 5.1.0.FINAL Environment: OSX 10.6.4 Reporter: Greg Barton Assignee: Edson Tirelli Priority: Minor Fix For: 5.2.0.CR1 Attachments: DroolsNested2.zip I've observed a sizable (25%) performance degradation between the 5.0.1 and 5.1.0 releases. I've attached a sample project that tests the performance of matching nested objects. (ANd compares direct reference matching and the performance pitfalls of "from," but that's beside the current point.) If you switch the pom.xml from using 5.0.1 to 5.1.0 for the drools dependencies you'll see 25% longer execution times on the tests. (mvn test) Here's the test output: 5.0.1 reference.drl Count: 2000 reference.drl Time: 267ms reference.drl Time per element: 0.1335ms BAR Duplicates: 780 FOO Duplicates: 880 reference.drl Count: 20000 reference.drl Time: 1249ms reference.drl Time per element: 0.06245ms BAR Duplicates: 7702 FOO Duplicates: 8040 from.drl Count: 200 from.drl Time: 1139ms from.drl Time per element: 5.695ms BAR Duplicates: 112 FOO Duplicates: 102 reference.drl Count: 200 reference.drl Time: 5ms reference.drl Time per element: 0.025ms BAR Duplicates: 86 FOO Duplicates: 60 5.1.0 reference.drl Count: 2000 reference.drl Time: 300ms reference.drl Time per element: 0.15ms BAR Duplicates: 788 FOO Duplicates: 820 reference.drl Count: 20000 reference.drl Time: 1564ms reference.drl Time per element: 0.0782ms BAR Duplicates: 8142 FOO Duplicates: 7960 from.drl Count: 200 from.drl Time: 3543ms from.drl Time per element: 17.715ms BAR Duplicates: 68 FOO Duplicates: 90 reference.drl Count: 200 reference.drl Time: 13ms reference.drl Time per element: 0.065ms BAR Duplicates: 84 FOO Duplicates: 74 On the most taxing test (20k objects) 5.0.1 took 1249ms while 5.1.0 took 1564ms, and for larger tests the effect is more pronounced. This is primarily a test of == on object references.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Mark Proctor (JIRA)

10:25 p.m.

New subject: [JBoss JIRA] Commented: (JBRULES-2685) Performance degradation from 5.0.1 to 5.1.0

[ https://issues.jboss.org/browse/JBRULES-2685?page=com.atlassian.jira.plug... ] Mark Proctor commented on JBRULES-2685: --------------------------------------- I've found the issue. The problem is 'from' in 5.1+ is more intellgient than in 5.0.1. In 5.0.1 each left propagation for retract or modify would throw away the right matchines and redo them again, there was no state managemetn. In 5.1+ we keep the resulting tuples in a Map and then when the 'from' is executed again we "diff" so we know what previously existed and what is new - this is necessary to keep intermediate results in situations like 'accumulate'. This level of state management has a cost. I might be able to alleviate it by changing the Map implementation from a LinkedHashMap to a custom one that uses the RightTuple as the Entry.

...

Performance degradation from 5.0.1 to 5.1.0 ------------------------------------------- Key: JBRULES-2685 URL: https://issues.jboss.org/browse/JBRULES-2685 Project: Drools Issue Type: Quality Risk Security Level: Public(Everyone can see) Components: drools-core Affects Versions: 5.1.0.FINAL Environment: OSX 10.6.4 Reporter: Greg Barton Assignee: Edson Tirelli Priority: Minor Fix For: 5.2.0.CR1 Attachments: DroolsNested2.zip I've observed a sizable (25%) performance degradation between the 5.0.1 and 5.1.0 releases. I've attached a sample project that tests the performance of matching nested objects. (ANd compares direct reference matching and the performance pitfalls of "from," but that's beside the current point.) If you switch the pom.xml from using 5.0.1 to 5.1.0 for the drools dependencies you'll see 25% longer execution times on the tests. (mvn test) Here's the test output: 5.0.1 reference.drl Count: 2000 reference.drl Time: 267ms reference.drl Time per element: 0.1335ms BAR Duplicates: 780 FOO Duplicates: 880 reference.drl Count: 20000 reference.drl Time: 1249ms reference.drl Time per element: 0.06245ms BAR Duplicates: 7702 FOO Duplicates: 8040 from.drl Count: 200 from.drl Time: 1139ms from.drl Time per element: 5.695ms BAR Duplicates: 112 FOO Duplicates: 102 reference.drl Count: 200 reference.drl Time: 5ms reference.drl Time per element: 0.025ms BAR Duplicates: 86 FOO Duplicates: 60 5.1.0 reference.drl Count: 2000 reference.drl Time: 300ms reference.drl Time per element: 0.15ms BAR Duplicates: 788 FOO Duplicates: 820 reference.drl Count: 20000 reference.drl Time: 1564ms reference.drl Time per element: 0.0782ms BAR Duplicates: 8142 FOO Duplicates: 7960 from.drl Count: 200 from.drl Time: 3543ms from.drl Time per element: 17.715ms BAR Duplicates: 68 FOO Duplicates: 90 reference.drl Count: 200 reference.drl Time: 13ms reference.drl Time per element: 0.065ms BAR Duplicates: 84 FOO Duplicates: 74 On the most taxing test (20k objects) 5.0.1 took 1249ms while 5.1.0 took 1564ms, and for larger tests the effect is more pronounced. This is primarily a test of == on object references.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Mark Proctor (JIRA)

10:25 p.m.

New subject: [JBoss JIRA] Commented: (JBRULES-2685) Performance degradation from 5.0.1 to 5.1.0

[ https://issues.jboss.org/browse/JBRULES-2685?page=com.atlassian.jira.plug... ] Mark Proctor commented on JBRULES-2685: --------------------------------------- obviously the other thing we can do is avoid creating the Map for the first returned result, only after we get a second result will we transition to a Map. This should help retain some level of performance for simpler use case that only return a single vlaue.

...

Performance degradation from 5.0.1 to 5.1.0 ------------------------------------------- Key: JBRULES-2685 URL: https://issues.jboss.org/browse/JBRULES-2685 Project: Drools Issue Type: Quality Risk Security Level: Public(Everyone can see) Components: drools-core Affects Versions: 5.1.0.FINAL Environment: OSX 10.6.4 Reporter: Greg Barton Assignee: Edson Tirelli Priority: Minor Fix For: 5.2.0.CR1 Attachments: DroolsNested2.zip I've observed a sizable (25%) performance degradation between the 5.0.1 and 5.1.0 releases. I've attached a sample project that tests the performance of matching nested objects. (ANd compares direct reference matching and the performance pitfalls of "from," but that's beside the current point.) If you switch the pom.xml from using 5.0.1 to 5.1.0 for the drools dependencies you'll see 25% longer execution times on the tests. (mvn test) Here's the test output: 5.0.1 reference.drl Count: 2000 reference.drl Time: 267ms reference.drl Time per element: 0.1335ms BAR Duplicates: 780 FOO Duplicates: 880 reference.drl Count: 20000 reference.drl Time: 1249ms reference.drl Time per element: 0.06245ms BAR Duplicates: 7702 FOO Duplicates: 8040 from.drl Count: 200 from.drl Time: 1139ms from.drl Time per element: 5.695ms BAR Duplicates: 112 FOO Duplicates: 102 reference.drl Count: 200 reference.drl Time: 5ms reference.drl Time per element: 0.025ms BAR Duplicates: 86 FOO Duplicates: 60 5.1.0 reference.drl Count: 2000 reference.drl Time: 300ms reference.drl Time per element: 0.15ms BAR Duplicates: 788 FOO Duplicates: 820 reference.drl Count: 20000 reference.drl Time: 1564ms reference.drl Time per element: 0.0782ms BAR Duplicates: 8142 FOO Duplicates: 7960 from.drl Count: 200 from.drl Time: 3543ms from.drl Time per element: 17.715ms BAR Duplicates: 68 FOO Duplicates: 90 reference.drl Count: 200 reference.drl Time: 13ms reference.drl Time per element: 0.065ms BAR Duplicates: 84 FOO Duplicates: 74 On the most taxing test (20k objects) 5.0.1 took 1249ms while 5.1.0 took 1564ms, and for larger tests the effect is more pronounced. This is primarily a test of == on object references.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Geoffrey De Smet (JIRA)

Thursday, 26 May Thu, 26 May

2:36 p.m.

New subject: [JBoss JIRA] Updated: (JBRULES-2685) Performance degradation from 5.0.1 to 5.1.0

[ https://issues.jboss.org/browse/JBRULES-2685?page=com.atlassian.jira.plug... ] Geoffrey De Smet updated JBRULES-2685: -------------------------------------- Fix Version/s: 5.2.0.CR2 (was: 5.2.0.CR1)

...

Performance degradation from 5.0.1 to 5.1.0 ------------------------------------------- Key: JBRULES-2685 URL: https://issues.jboss.org/browse/JBRULES-2685 Project: Drools Issue Type: Quality Risk Security Level: Public(Everyone can see) Components: drools-core Affects Versions: 5.1.0.FINAL Environment: OSX 10.6.4 Reporter: Greg Barton Assignee: Edson Tirelli Priority: Minor Fix For: 5.2.0.CR2 Attachments: DroolsNested2.zip I've observed a sizable (25%) performance degradation between the 5.0.1 and 5.1.0 releases. I've attached a sample project that tests the performance of matching nested objects. (ANd compares direct reference matching and the performance pitfalls of "from," but that's beside the current point.) If you switch the pom.xml from using 5.0.1 to 5.1.0 for the drools dependencies you'll see 25% longer execution times on the tests. (mvn test) Here's the test output: 5.0.1 reference.drl Count: 2000 reference.drl Time: 267ms reference.drl Time per element: 0.1335ms BAR Duplicates: 780 FOO Duplicates: 880 reference.drl Count: 20000 reference.drl Time: 1249ms reference.drl Time per element: 0.06245ms BAR Duplicates: 7702 FOO Duplicates: 8040 from.drl Count: 200 from.drl Time: 1139ms from.drl Time per element: 5.695ms BAR Duplicates: 112 FOO Duplicates: 102 reference.drl Count: 200 reference.drl Time: 5ms reference.drl Time per element: 0.025ms BAR Duplicates: 86 FOO Duplicates: 60 5.1.0 reference.drl Count: 2000 reference.drl Time: 300ms reference.drl Time per element: 0.15ms BAR Duplicates: 788 FOO Duplicates: 820 reference.drl Count: 20000 reference.drl Time: 1564ms reference.drl Time per element: 0.0782ms BAR Duplicates: 8142 FOO Duplicates: 7960 from.drl Count: 200 from.drl Time: 3543ms from.drl Time per element: 17.715ms BAR Duplicates: 68 FOO Duplicates: 90 reference.drl Count: 200 reference.drl Time: 13ms reference.drl Time per element: 0.065ms BAR Duplicates: 84 FOO Duplicates: 74 On the most taxing test (20k objects) 5.0.1 took 1249ms while 5.1.0 took 1564ms, and for larger tests the effect is more pronounced. This is primarily a test of == on object references.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Geoffrey De Smet (JIRA)

Thursday, 23 June Thu, 23 Jun

1 p.m.

New subject: [JBoss JIRA] Updated: (JBRULES-2685) Performance degradation from 5.0.1 to 5.1.0

...

Performance degradation from 5.0.1 to 5.1.0 ------------------------------------------- Key: JBRULES-2685 URL: https://issues.jboss.org/browse/JBRULES-2685 Project: Drools Issue Type: Quality Risk Security Level: Public(Everyone can see) Components: drools-core Affects Versions: 5.1.0.FINAL Environment: OSX 10.6.4 Reporter: Greg Barton Assignee: Edson Tirelli Priority: Minor Fix For: 5.3.0.Beta1 Attachments: DroolsNested2.zip I've observed a sizable (25%) performance degradation between the 5.0.1 and 5.1.0 releases. I've attached a sample project that tests the performance of matching nested objects. (ANd compares direct reference matching and the performance pitfalls of "from," but that's beside the current point.) If you switch the pom.xml from using 5.0.1 to 5.1.0 for the drools dependencies you'll see 25% longer execution times on the tests. (mvn test) Here's the test output: 5.0.1 reference.drl Count: 2000 reference.drl Time: 267ms reference.drl Time per element: 0.1335ms BAR Duplicates: 780 FOO Duplicates: 880 reference.drl Count: 20000 reference.drl Time: 1249ms reference.drl Time per element: 0.06245ms BAR Duplicates: 7702 FOO Duplicates: 8040 from.drl Count: 200 from.drl Time: 1139ms from.drl Time per element: 5.695ms BAR Duplicates: 112 FOO Duplicates: 102 reference.drl Count: 200 reference.drl Time: 5ms reference.drl Time per element: 0.025ms BAR Duplicates: 86 FOO Duplicates: 60 5.1.0 reference.drl Count: 2000 reference.drl Time: 300ms reference.drl Time per element: 0.15ms BAR Duplicates: 788 FOO Duplicates: 820 reference.drl Count: 20000 reference.drl Time: 1564ms reference.drl Time per element: 0.0782ms BAR Duplicates: 8142 FOO Duplicates: 7960 from.drl Count: 200 from.drl Time: 3543ms from.drl Time per element: 17.715ms BAR Duplicates: 68 FOO Duplicates: 90 reference.drl Count: 200 reference.drl Time: 13ms reference.drl Time per element: 0.065ms BAR Duplicates: 84 FOO Duplicates: 74 On the most taxing test (20k objects) 5.0.1 took 1249ms while 5.1.0 took 1564ms, and for larger tests the effect is more pronounced. This is primarily a test of == on object references.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Geoffrey De Smet (JIRA)

Tuesday, 9 August Tue, 9 Aug

6:42 a.m.

New subject: [JBoss JIRA] Updated: (JBRULES-2685) Performance degradation from 5.0.1 to 5.1.0

...

Performance degradation from 5.0.1 to 5.1.0 ------------------------------------------- Key: JBRULES-2685 URL: https://issues.jboss.org/browse/JBRULES-2685 Project: Drools Issue Type: Quality Risk Security Level: Public(Everyone can see) Components: drools-core Affects Versions: 5.1.0.FINAL Environment: OSX 10.6.4 Reporter: Greg Barton Assignee: Edson Tirelli Priority: Minor Fix For: 5.3.0.CR1 Attachments: DroolsNested2.zip I've observed a sizable (25%) performance degradation between the 5.0.1 and 5.1.0 releases. I've attached a sample project that tests the performance of matching nested objects. (ANd compares direct reference matching and the performance pitfalls of "from," but that's beside the current point.) If you switch the pom.xml from using 5.0.1 to 5.1.0 for the drools dependencies you'll see 25% longer execution times on the tests. (mvn test) Here's the test output: 5.0.1 reference.drl Count: 2000 reference.drl Time: 267ms reference.drl Time per element: 0.1335ms BAR Duplicates: 780 FOO Duplicates: 880 reference.drl Count: 20000 reference.drl Time: 1249ms reference.drl Time per element: 0.06245ms BAR Duplicates: 7702 FOO Duplicates: 8040 from.drl Count: 200 from.drl Time: 1139ms from.drl Time per element: 5.695ms BAR Duplicates: 112 FOO Duplicates: 102 reference.drl Count: 200 reference.drl Time: 5ms reference.drl Time per element: 0.025ms BAR Duplicates: 86 FOO Duplicates: 60 5.1.0 reference.drl Count: 2000 reference.drl Time: 300ms reference.drl Time per element: 0.15ms BAR Duplicates: 788 FOO Duplicates: 820 reference.drl Count: 20000 reference.drl Time: 1564ms reference.drl Time per element: 0.0782ms BAR Duplicates: 8142 FOO Duplicates: 7960 from.drl Count: 200 from.drl Time: 3543ms from.drl Time per element: 17.715ms BAR Duplicates: 68 FOO Duplicates: 90 reference.drl Count: 200 reference.drl Time: 13ms reference.drl Time per element: 0.065ms BAR Duplicates: 84 FOO Duplicates: 74 On the most taxing test (20k objects) 5.0.1 took 1249ms while 5.1.0 took 1564ms, and for larger tests the effect is more pronounced. This is primarily a test of == on object references.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Geoffrey De Smet (JIRA)

Sunday, 25 September Sun, 25 Sep

3:04 a.m.

New subject: [JBoss JIRA] Updated: (JBRULES-2685) Performance degradation from 5.0.1 to 5.1.0

...

Performance degradation from 5.0.1 to 5.1.0 ------------------------------------------- Key: JBRULES-2685 URL: https://issues.jboss.org/browse/JBRULES-2685 Project: Drools Issue Type: Quality Risk Security Level: Public(Everyone can see) Components: drools-core Affects Versions: 5.1.0.FINAL Environment: OSX 10.6.4 Reporter: Greg Barton Assignee: Edson Tirelli Priority: Minor Fix For: 5.3.0.Final Attachments: DroolsNested2.zip I've observed a sizable (25%) performance degradation between the 5.0.1 and 5.1.0 releases. I've attached a sample project that tests the performance of matching nested objects. (ANd compares direct reference matching and the performance pitfalls of "from," but that's beside the current point.) If you switch the pom.xml from using 5.0.1 to 5.1.0 for the drools dependencies you'll see 25% longer execution times on the tests. (mvn test) Here's the test output: 5.0.1 reference.drl Count: 2000 reference.drl Time: 267ms reference.drl Time per element: 0.1335ms BAR Duplicates: 780 FOO Duplicates: 880 reference.drl Count: 20000 reference.drl Time: 1249ms reference.drl Time per element: 0.06245ms BAR Duplicates: 7702 FOO Duplicates: 8040 from.drl Count: 200 from.drl Time: 1139ms from.drl Time per element: 5.695ms BAR Duplicates: 112 FOO Duplicates: 102 reference.drl Count: 200 reference.drl Time: 5ms reference.drl Time per element: 0.025ms BAR Duplicates: 86 FOO Duplicates: 60 5.1.0 reference.drl Count: 2000 reference.drl Time: 300ms reference.drl Time per element: 0.15ms BAR Duplicates: 788 FOO Duplicates: 820 reference.drl Count: 20000 reference.drl Time: 1564ms reference.drl Time per element: 0.0782ms BAR Duplicates: 8142 FOO Duplicates: 7960 from.drl Count: 200 from.drl Time: 3543ms from.drl Time per element: 17.715ms BAR Duplicates: 68 FOO Duplicates: 90 reference.drl Count: 200 reference.drl Time: 13ms reference.drl Time per element: 0.065ms BAR Duplicates: 84 FOO Duplicates: 74 On the most taxing test (20k objects) 5.0.1 took 1249ms while 5.1.0 took 1564ms, and for larger tests the effect is more pronounced. This is primarily a test of == on object references.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Geoffrey De Smet (Updated) (JIRA)

Friday, 21 October Fri, 21 Oct

10:02 a.m.

New subject: [JBoss JIRA] (JBRULES-2685) Performance degradation from 5.0.1 to 5.1.0

...

Performance degradation from 5.0.1 to 5.1.0 ------------------------------------------- Key: JBRULES-2685 URL: https://issues.jboss.org/browse/JBRULES-2685 Project: Drools Issue Type: Quality Risk Security Level: Public(Everyone can see) Components: drools-core Affects Versions: 5.1.0.FINAL Environment: OSX 10.6.4 Reporter: Greg Barton Assignee: Edson Tirelli Priority: Minor Fix For: 5.4.0.Beta1 Attachments: DroolsNested2.zip I've observed a sizable (25%) performance degradation between the 5.0.1 and 5.1.0 releases. I've attached a sample project that tests the performance of matching nested objects. (ANd compares direct reference matching and the performance pitfalls of "from," but that's beside the current point.) If you switch the pom.xml from using 5.0.1 to 5.1.0 for the drools dependencies you'll see 25% longer execution times on the tests. (mvn test) Here's the test output: 5.0.1 reference.drl Count: 2000 reference.drl Time: 267ms reference.drl Time per element: 0.1335ms BAR Duplicates: 780 FOO Duplicates: 880 reference.drl Count: 20000 reference.drl Time: 1249ms reference.drl Time per element: 0.06245ms BAR Duplicates: 7702 FOO Duplicates: 8040 from.drl Count: 200 from.drl Time: 1139ms from.drl Time per element: 5.695ms BAR Duplicates: 112 FOO Duplicates: 102 reference.drl Count: 200 reference.drl Time: 5ms reference.drl Time per element: 0.025ms BAR Duplicates: 86 FOO Duplicates: 60 5.1.0 reference.drl Count: 2000 reference.drl Time: 300ms reference.drl Time per element: 0.15ms BAR Duplicates: 788 FOO Duplicates: 820 reference.drl Count: 20000 reference.drl Time: 1564ms reference.drl Time per element: 0.0782ms BAR Duplicates: 8142 FOO Duplicates: 7960 from.drl Count: 200 from.drl Time: 3543ms from.drl Time per element: 17.715ms BAR Duplicates: 68 FOO Duplicates: 90 reference.drl Count: 200 reference.drl Time: 13ms reference.drl Time per element: 0.065ms BAR Duplicates: 84 FOO Duplicates: 74 On the most taxing test (20k objects) 5.0.1 took 1249ms while 5.1.0 took 1564ms, and for larger tests the effect is more pronounced. This is primarily a test of == on object references.

-- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jboss.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira

Geoffrey De Smet (Updated) (JIRA)

Tuesday, 20 December Tue, 20 Dec

4:15 a.m.

New subject: [JBoss JIRA] (JBRULES-2685) Performance degradation from 5.0.1 to 5.1.0

...

Performance degradation from 5.0.1 to 5.1.0 ------------------------------------------- Key: JBRULES-2685 URL: https://issues.jboss.org/browse/JBRULES-2685 Project: Drools Issue Type: Quality Risk Security Level: Public(Everyone can see) Components: drools-core Affects Versions: 5.1.0.FINAL Environment: OSX 10.6.4 Reporter: Greg Barton Assignee: Edson Tirelli Priority: Minor Fix For: 5.4.0.Beta2 Attachments: DroolsNested2.zip I've observed a sizable (25%) performance degradation between the 5.0.1 and 5.1.0 releases. I've attached a sample project that tests the performance of matching nested objects. (ANd compares direct reference matching and the performance pitfalls of "from," but that's beside the current point.) If you switch the pom.xml from using 5.0.1 to 5.1.0 for the drools dependencies you'll see 25% longer execution times on the tests. (mvn test) Here's the test output: 5.0.1 reference.drl Count: 2000 reference.drl Time: 267ms reference.drl Time per element: 0.1335ms BAR Duplicates: 780 FOO Duplicates: 880 reference.drl Count: 20000 reference.drl Time: 1249ms reference.drl Time per element: 0.06245ms BAR Duplicates: 7702 FOO Duplicates: 8040 from.drl Count: 200 from.drl Time: 1139ms from.drl Time per element: 5.695ms BAR Duplicates: 112 FOO Duplicates: 102 reference.drl Count: 200 reference.drl Time: 5ms reference.drl Time per element: 0.025ms BAR Duplicates: 86 FOO Duplicates: 60 5.1.0 reference.drl Count: 2000 reference.drl Time: 300ms reference.drl Time per element: 0.15ms BAR Duplicates: 788 FOO Duplicates: 820 reference.drl Count: 20000 reference.drl Time: 1564ms reference.drl Time per element: 0.0782ms BAR Duplicates: 8142 FOO Duplicates: 7960 from.drl Count: 200 from.drl Time: 3543ms from.drl Time per element: 17.715ms BAR Duplicates: 68 FOO Duplicates: 90 reference.drl Count: 200 reference.drl Time: 13ms reference.drl Time per element: 0.065ms BAR Duplicates: 84 FOO Duplicates: 74 On the most taxing test (20k objects) 5.0.1 took 1249ms while 5.1.0 took 1564ms, and for larger tests the effect is more pronounced. This is primarily a test of == on object references.

Geoffrey De Smet (JIRA)

Wednesday, 1 February Wed, 1 Feb

4:26 a.m.

New subject: [JBoss JIRA] (JBRULES-2685) Performance degradation from 5.0.1 to 5.1.0

...

Performance degradation from 5.0.1 to 5.1.0 ------------------------------------------- Key: JBRULES-2685 URL: https://issues.jboss.org/browse/JBRULES-2685 Project: Drools Issue Type: Quality Risk Security Level: Public(Everyone can see) Components: drools-core Affects Versions: 5.1.0.FINAL Environment: OSX 10.6.4 Reporter: Greg Barton Assignee: Edson Tirelli Priority: Minor Fix For: 5.4.0.Beta3 Attachments: DroolsNested2.zip I've observed a sizable (25%) performance degradation between the 5.0.1 and 5.1.0 releases. I've attached a sample project that tests the performance of matching nested objects. (ANd compares direct reference matching and the performance pitfalls of "from," but that's beside the current point.) If you switch the pom.xml from using 5.0.1 to 5.1.0 for the drools dependencies you'll see 25% longer execution times on the tests. (mvn test) Here's the test output: 5.0.1 reference.drl Count: 2000 reference.drl Time: 267ms reference.drl Time per element: 0.1335ms BAR Duplicates: 780 FOO Duplicates: 880 reference.drl Count: 20000 reference.drl Time: 1249ms reference.drl Time per element: 0.06245ms BAR Duplicates: 7702 FOO Duplicates: 8040 from.drl Count: 200 from.drl Time: 1139ms from.drl Time per element: 5.695ms BAR Duplicates: 112 FOO Duplicates: 102 reference.drl Count: 200 reference.drl Time: 5ms reference.drl Time per element: 0.025ms BAR Duplicates: 86 FOO Duplicates: 60 5.1.0 reference.drl Count: 2000 reference.drl Time: 300ms reference.drl Time per element: 0.15ms BAR Duplicates: 788 FOO Duplicates: 820 reference.drl Count: 20000 reference.drl Time: 1564ms reference.drl Time per element: 0.0782ms BAR Duplicates: 8142 FOO Duplicates: 7960 from.drl Count: 200 from.drl Time: 3543ms from.drl Time per element: 17.715ms BAR Duplicates: 68 FOO Duplicates: 90 reference.drl Count: 200 reference.drl Time: 13ms reference.drl Time per element: 0.065ms BAR Duplicates: 84 FOO Duplicates: 74 On the most taxing test (20k objects) 5.0.1 took 1249ms while 5.1.0 took 1564ms, and for larger tests the effect is more pronounced. This is primarily a test of == on object references.

Geoffrey De Smet (JIRA)

Thursday, 5 April Thu, 5 Apr

6:31 a.m.

New subject: [JBoss JIRA] (JBRULES-2685) Performance degradation from 5.0.1 to 5.1.0

[ https://issues.jboss.org/browse/JBRULES-2685?page=com.atlassian.jira.plug... ] Geoffrey De Smet resolved JBRULES-2685. --------------------------------------- Assignee: Mark Proctor (was: Edson Tirelli) Fix Version/s: 5.4.0.Beta2 (was: 5.4.0.CR1) Resolution: Done Mark's changes must have fixed it, because 5.4.0 does not suffer from the problem. {code}With drools 5.0.1: reference.drl Count: 2000 reference.drl Time: 142ms reference.drl Time per element: 0.071ms BAR Duplicates: 766 FOO Duplicates: 784 reference.drl Count: 20000 reference.drl Time: 795ms reference.drl Time per element: 0.03975ms BAR Duplicates: 7844 FOO Duplicates: 8262 from.drl Count: 200 from.drl Time: 429ms from.drl Time per element: 2.145ms BAR Duplicates: 90 FOO Duplicates: 68 With drools 5.4.0.Beta2: reference.drl Count: 2000 reference.drl Time: 221ms reference.drl Time per element: 0.1105ms BAR Duplicates: 800 FOO Duplicates: 758 reference.drl Count: 20000 reference.drl Time: 649ms reference.drl Time per element: 0.03245ms BAR Duplicates: 7946 FOO Duplicates: 7924 from.drl Count: 200 from.drl Time: 357ms from.drl Time per element: 1.785ms BAR Duplicates: 98 FOO Duplicates: 96 {code} 5.4 down scales a little worse (see 2000 instance on reference), but upscales better (see 20000 instance on reference and 200 on from).

...

Performance degradation from 5.0.1 to 5.1.0 ------------------------------------------- Key: JBRULES-2685 URL: https://issues.jboss.org/browse/JBRULES-2685 Project: Drools Issue Type: Quality Risk Security Level: Public(Everyone can see) Components: drools-core Affects Versions: 5.1.0.FINAL Environment: OSX 10.6.4 Reporter: Greg Barton Assignee: Mark Proctor Priority: Minor Fix For: 5.4.0.Beta2 Attachments: DroolsNested2.zip I've observed a sizable (25%) performance degradation between the 5.0.1 and 5.1.0 releases. I've attached a sample project that tests the performance of matching nested objects. (ANd compares direct reference matching and the performance pitfalls of "from," but that's beside the current point.) If you switch the pom.xml from using 5.0.1 to 5.1.0 for the drools dependencies you'll see 25% longer execution times on the tests. (mvn test) Here's the test output: 5.0.1 reference.drl Count: 2000 reference.drl Time: 267ms reference.drl Time per element: 0.1335ms BAR Duplicates: 780 FOO Duplicates: 880 reference.drl Count: 20000 reference.drl Time: 1249ms reference.drl Time per element: 0.06245ms BAR Duplicates: 7702 FOO Duplicates: 8040 from.drl Count: 200 from.drl Time: 1139ms from.drl Time per element: 5.695ms BAR Duplicates: 112 FOO Duplicates: 102 reference.drl Count: 200 reference.drl Time: 5ms reference.drl Time per element: 0.025ms BAR Duplicates: 86 FOO Duplicates: 60 5.1.0 reference.drl Count: 2000 reference.drl Time: 300ms reference.drl Time per element: 0.15ms BAR Duplicates: 788 FOO Duplicates: 820 reference.drl Count: 20000 reference.drl Time: 1564ms reference.drl Time per element: 0.0782ms BAR Duplicates: 8142 FOO Duplicates: 7960 from.drl Count: 200 from.drl Time: 3543ms from.drl Time per element: 17.715ms BAR Duplicates: 68 FOO Duplicates: 90 reference.drl Count: 200 reference.drl Time: 13ms reference.drl Time per element: 0.065ms BAR Duplicates: 84 FOO Duplicates: 74 On the most taxing test (20k objects) 5.0.1 took 1249ms while 5.1.0 took 1564ms, and for larger tests the effect is more pronounced. This is primarily a test of == on object references.

4442

days inactive

5022

days old

jboss-jira@lists.jboss.org

Manage subscription

23 comments

5 participants

tags (0)

participants (5)

Edson Tirelli (JIRA)
Geoffrey De Smet (JIRA)
Geoffrey De Smet (Updated) (JIRA)
Greg Barton (JIRA)
Mark Proctor (JIRA)

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

[JBoss JIRA] Created: (JBRULES-2685) Performance degradation from 5.0.1 to 5.1.0