[JBoss JIRA] (ISPN-3321) NPE in MapReduceTask reduce phase
- First Post
- Replies
- Stats
-
Go to
- ----- 2025 -----
- January
- ----- 2024 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2023 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2022 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2021 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2020 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2019 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2018 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2017 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2016 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2015 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2014 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2013 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2012 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2011 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2010 -----
- December
- November
- October
- September
- August
- July
- June
- May
- April
- March
- February
- January
- ----- 2009 -----
- December
- November
- October
- September
- August
- July
- June
- May
[
https://issues.jboss.org/browse/ISPN-3321?page=com.atlassian.jira.plugin....
]
Dan Berindei commented on ISPN-3321:
------------------------------------
[~afield] I think the problem here is that the default intermediary cache configuration
has a {{lifespan}} and {{maxIdle}} of 120 seconds. The error appeared almost 3 minutes
after the map/reduce task started, so it's very likely that the entry inserted by the
mapper in the intermediary cache expired just as the reducer was trying to read it.
I don't think there is any reason to have expiry in the intermediary cache, so
I'll change the default configuration in CreateCacheCommand.
If a cache {{\_\_tmpMapReduce}} is defined, its configuration will be used instead of the
default configuration in CreateCacheCommand. So defining a cache {{\_\_tmpMapReduce}}
without any special settings is a good workaround in the meantime.
NPE in MapReduceTask reduce phase
---------------------------------
Key: ISPN-3321
URL: https://issues.jboss.org/browse/ISPN-3321
Project: Infinispan
Issue Type: Bug
Components: Distributed Execution and Map/Reduce
Affects Versions: 5.3.0.Final
Reporter: Alan Field
Assignee: Dan Berindei
Priority: Critical
Labels: jdg62GAblocker
Fix For: 6.0.0.CR1
During the execution of a MapReduce word count job with 6 nodes, the following NPE is
thrown:
11:19:37,870 ERROR [org.infinispan.remoting.InboundInvocationHandlerImpl]
(remote-thread-2) Exception executing command
java.lang.NullPointerException
at
org.infinispan.distexec.mapreduce.MapReduceManagerImpl.reduce(MapReduceManagerImpl.java:153)
at org.infinispan.commands.read.ReduceCommand.perform(ReduceCommand.java:88)
at
org.infinispan.remoting.InboundInvocationHandlerImpl.handleInternal(InboundInvocationHandlerImpl.java:122)
at
org.infinispan.remoting.InboundInvocationHandlerImpl.access$000(InboundInvocationHandlerImpl.java:68)
at
org.infinispan.remoting.InboundInvocationHandlerImpl$2.run(InboundInvocationHandlerImpl.java:194)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
The full log is here -
https://jenkins.mw.lab.eng.bos.redhat.com/hudson/user/afield@REDHAT.COM/m...
Looking at the code to see if I can figure out what happened.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
4111
days inactive
4111
days old
infinispan-issues@lists.jboss.org
0 comments
1 participants
tags (0)
participants (1)
-
Dan Berindei (JIRA)