[infinispan-issues] [JBoss JIRA] (ISPN-6086) Hadoop MapReduce task fails after the prefered ispn server stopped
Anna Manukyan (JIRA)
issues at jboss.org
Fri Feb 5 06:24:00 EST 2016
[ https://issues.jboss.org/browse/ISPN-6086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13159184#comment-13159184 ]
Anna Manukyan commented on ISPN-6086:
-------------------------------------
Hi Gustavo,
another update here:
the same issue appears in case when the data is read and write to infinispan server (2 node cluster):
reading from node1, writing result to node2.
While map/reduce execution the node2 is stopped. After map/reduce completion no result is available (in node1 corresponding cache). The stacktrace is attached.
You can find the test here:
https://github.com/andyuk1986/infinispan-hadoop/blob/JBQA-12612/core/src/test/java/org/infinispan/hadoop/FailoverHandlingTest.java#L188
> Hadoop MapReduce task fails after the prefered ispn server stopped
> -------------------------------------------------------------------
>
> Key: ISPN-6086
> URL: https://issues.jboss.org/browse/ISPN-6086
> Project: Infinispan
> Issue Type: Bug
> Components: Hadoop Integration
> Reporter: Anna Manukyan
> Assignee: Gustavo Fernandes
> Attachments: FailoverHandlingTest_WritingToInfinispan.log, FailoverTest_when_prefered_stopped.log
>
>
> I have added tests to the infinispan-hadoop testsuite testing the load balancing of mapreduce task in case if the input server which is specified as a parameter to Hadoop configuration is stopped.
> The test is performed on 4 node cluster. The data read is performed from Infinispan cache, the write is performed to HDFS.
> There are 200000 entries in the cache. As soon as the Hadoop Job is submitted for performing map/reduce task, the preferred server is stopped.
> As a result, the Hadoop Map/Reduce result map is empty.
> You can find the test execution log attached.
--
This message was sent by Atlassian JIRA
(v6.4.11#64026)
More information about the infinispan-issues
mailing list