[infinispan-issues] [JBoss JIRA] (ISPN-6087) Hadoop MapReduce task returns wrong results after one of the servers from the cluster is stopped

Anna Manukyan (JIRA) issues at jboss.org
Thu Jan 21 07:05:00 EST 2016


Anna Manukyan created ISPN-6087:
-----------------------------------

             Summary: Hadoop MapReduce task returns wrong results after one of the servers from the cluster is stopped 
                 Key: ISPN-6087
                 URL: https://issues.jboss.org/browse/ISPN-6087
             Project: Infinispan
          Issue Type: Bug
          Components: Hadoop Integration
            Reporter: Anna Manukyan
         Attachments: FailoverTest.log

The test is performed on 4 node cluster. The data read is performed from Infinispan cache, the write is performed to HDFS. 

There are 200000 entries in the cache. As soon as the Hadoop Job is submitted for performing map/reduce task, one of the servers from the cluster is stopped. 
The MapReduce task performs calculation of word count. 

As a result, the Hadoop Map/Reduce result map contains wrong results, that is the number of the certain words found is greater than it is expected. 
The failure doesn't always happen. It depends on which stage was the mapreduce task when the server stopped. 
You can find the test execution log attached. 



--
This message was sent by Atlassian JIRA
(v6.4.11#64026)


More information about the infinispan-issues mailing list