[infinispan-issues] [JBoss JIRA] (ISPN-8822) Major performance hit when running Spark jobs

Gustavo Fernandes (JIRA) issues at jboss.org
Thu Feb 15 13:02:00 EST 2018


    [ https://issues.jboss.org/browse/ISPN-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13534077#comment-13534077 ] 

Gustavo Fernandes commented on ISPN-8822:
-----------------------------------------

Taking a single test from the suite and looking at the metrics at http://localhost:4040:

{{./sbt "test:run-main org.scalatest.tools.Runner -o -s org.infinispan.spark.suites.SQLSuite"}}

||Stage ID || Before ||After||
|60| 67 ms | 2s |
|62| 50 ms | 2s |
|64| 41 ms | 2s |

Curiously some other stages are faster, but the overall job time is 1 order slower

> Major performance hit when running Spark jobs
> ---------------------------------------------
>
>                 Key: ISPN-8822
>                 URL: https://issues.jboss.org/browse/ISPN-8822
>             Project: Infinispan
>          Issue Type: Bug
>          Components: Hot Rod
>    Affects Versions: 9.2.0.CR2
>            Reporter: Gustavo Fernandes
>            Priority: Critical
>
> When trying to upgrade the [Spark connector |https://github.com/infinispan/infinispan-spark/] to use Infinispan 9.2.0.CR2, the test suite runs about 10x slower. 



--
This message was sent by Atlassian JIRA
(v7.5.0#75005)


More information about the infinispan-issues mailing list