[jboss-jira] [JBoss JIRA] (JBRULES-3491) Planner: benchmark ranking algorithms must be failure safe (score is null)

Planner: benchmark ranking algorithms must be failure safe (score is null) -------------------------------------------------------------------------- Key: JBRULES-3491 URL: https://issues.jboss.org/browse/JBRULES-3491 Project: Drools Issue Type: Bug Security Level: Public(Everyone can see) Components: drools-planner Reporter: Geoffrey De Smet Assignee: Geoffrey De Smet Fix For: 5.5.0.Beta1 Things that are problematic in the ranking code (all classes under org.drools.planner.benchmark.core.ranking): - score can be null, totalScore can be null, ... when there are failures - org.drools.planner.benchmark.core.ranking.TotalRankSolverBenchmarkRankingWeightFactory: Usage of SolverBenchmark.getScoreList() because some SolverBenchmark might have extra problem inputFiles. The question is, should the ranking first compare the failureCount? Yes, I think it should. What code should do that? the DefaultPlannerBenchmark, by default, or the rankers itself?