[infinispan-issues] [JBoss JIRA] (ISPN-8822) Major performance hit when running Spark jobs
Gustavo Fernandes (JIRA)
issues at jboss.org
Thu Feb 15 13:02:00 EST 2018
[ https://issues.jboss.org/browse/ISPN-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13534077#comment-13534077 ]
Gustavo Fernandes commented on ISPN-8822:
-----------------------------------------
Taking a single test from the suite and looking at the metrics at http://localhost:4040:
{{./sbt "test:run-main org.scalatest.tools.Runner -o -s org.infinispan.spark.suites.SQLSuite"}}
||Stage ID || Before ||After||
|60| 67 ms | 2s |
|62| 50 ms | 2s |
|64| 41 ms | 2s |
Curiously some other stages are faster, but the overall job time is 1 order slower
> Major performance hit when running Spark jobs
> ---------------------------------------------
>
> Key: ISPN-8822
> URL: https://issues.jboss.org/browse/ISPN-8822
> Project: Infinispan
> Issue Type: Bug
> Components: Hot Rod
> Affects Versions: 9.2.0.CR2
> Reporter: Gustavo Fernandes
> Priority: Critical
>
> When trying to upgrade the [Spark connector |https://github.com/infinispan/infinispan-spark/] to use Infinispan 9.2.0.CR2, the test suite runs about 10x slower.
--
This message was sent by Atlassian JIRA
(v7.5.0#75005)
More information about the infinispan-issues
mailing list