[infinispan-issues] [JBoss JIRA] (ISPN-6087) Hadoop MapReduce task returns wrong results after one of the servers from the cluster is stopped

Anna Manukyan (JIRA) issues at jboss.org
Thu Jan 21 07:08:00 EST 2016


     [ https://issues.jboss.org/browse/ISPN-6087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Anna Manukyan updated ISPN-6087:
--------------------------------
    Steps to Reproduce: 
You can find the test here:
https://github.com/andyuk1986/infinispan-hadoop/blob/JBQA-12612/core/src/test/java/org/infinispan/hadoop/FailoverHandlingTest.java#L198

  was:
You can find the test here:
https://github.com/andyuk1986/infinispan-hadoop/blob/JBQA-12612/core/src/test/java/org/infinispan/hadoop/FailoverHandlingTest.java



> Hadoop MapReduce task returns wrong results after one of the servers from the cluster is stopped 
> -------------------------------------------------------------------------------------------------
>
>                 Key: ISPN-6087
>                 URL: https://issues.jboss.org/browse/ISPN-6087
>             Project: Infinispan
>          Issue Type: Bug
>          Components: Hadoop Integration
>            Reporter: Anna Manukyan
>         Attachments: FailoverTest.log
>
>
> The test is performed on 4 node cluster. The data read is performed from Infinispan cache, the write is performed to HDFS. 
> There are 200000 entries in the cache. As soon as the Hadoop Job is submitted for performing map/reduce task, one of the servers from the cluster is stopped. 
> The MapReduce task performs calculation of word count. 
> As a result, the Hadoop Map/Reduce result map contains wrong results, that is the number of the certain words found is greater than it is expected. 
> The failure doesn't always happen. It depends on which stage was the mapreduce task when the server stopped. 
> You can find the test execution log attached. 



--
This message was sent by Atlassian JIRA
(v6.4.11#64026)


More information about the infinispan-issues mailing list