[infinispan-issues] [JBoss JIRA] (ISPN-6087) Hadoop MapReduce task returns wrong results after one of the servers from the cluster is stopped
Anna Manukyan (JIRA)
issues at jboss.org
Thu Jan 21 07:08:00 EST 2016
[ https://issues.jboss.org/browse/ISPN-6087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Anna Manukyan updated ISPN-6087:
--------------------------------
Steps to Reproduce:
You can find the test here:
https://github.com/andyuk1986/infinispan-hadoop/blob/JBQA-12612/core/src/test/java/org/infinispan/hadoop/FailoverHandlingTest.java#L198
was:
You can find the test here:
https://github.com/andyuk1986/infinispan-hadoop/blob/JBQA-12612/core/src/test/java/org/infinispan/hadoop/FailoverHandlingTest.java
> Hadoop MapReduce task returns wrong results after one of the servers from the cluster is stopped
> -------------------------------------------------------------------------------------------------
>
> Key: ISPN-6087
> URL: https://issues.jboss.org/browse/ISPN-6087
> Project: Infinispan
> Issue Type: Bug
> Components: Hadoop Integration
> Reporter: Anna Manukyan
> Attachments: FailoverTest.log
>
>
> The test is performed on 4 node cluster. The data read is performed from Infinispan cache, the write is performed to HDFS.
> There are 200000 entries in the cache. As soon as the Hadoop Job is submitted for performing map/reduce task, one of the servers from the cluster is stopped.
> The MapReduce task performs calculation of word count.
> As a result, the Hadoop Map/Reduce result map contains wrong results, that is the number of the certain words found is greater than it is expected.
> The failure doesn't always happen. It depends on which stage was the mapreduce task when the server stopped.
> You can find the test execution log attached.
--
This message was sent by Atlassian JIRA
(v6.4.11#64026)
More information about the infinispan-issues
mailing list