[jboss-jira] [JBoss JIRA] (JBRULES-3592) Planner benchmark report: 2 SingleBenchmarks with the same Score should have the same ranking.

Geoffrey De Smet (JIRA) jira-events at lists.jboss.org
Wed Aug 1 08:11:07 EDT 2012


    [ https://issues.jboss.org/browse/JBRULES-3592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12709132#comment-12709132 ] 

Geoffrey De Smet commented on JBRULES-3592:
-------------------------------------------

This code suffers from the same problem:
  org.drools.planner.benchmark.core.DefaultPlannerBenchmark#determineSolverBenchmarkRanking
                
> Planner benchmark report: 2 SingleBenchmarks with the same Score should have the same ranking.
> ----------------------------------------------------------------------------------------------
>
>                 Key: JBRULES-3592
>                 URL: https://issues.jboss.org/browse/JBRULES-3592
>             Project: Drools
>          Issue Type: Bug
>      Security Level: Public(Everyone can see) 
>          Components: drools-planner
>            Reporter: Geoffrey De Smet
>            Priority: Minor
>              Labels: starter
>
> For example, if on problem P1, the solvers have these scores:
> S1:  -800
> S2:   -50
> S3:   -50
> S4:    -2
> S5: -9000
> Then the ranking should be:
> S1: 3
> S2: 1
> S3: 1 // Currently this gets ranking 2 which is wrong
> S4: 0
> S5: 4
> The offending code is isolated in this 1 method:
>   org.drools.planner.benchmark.core.ProblemBenchmark#determineSingleBenchmarkRanking

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jboss.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        


More information about the jboss-jira mailing list