[JBoss JIRA] (ISPN-3983) Remove some performance bottlenecks from ProtoStream
by Sanne Grinovero (JIRA)
[ https://issues.jboss.org/browse/ISPN-3983?page=com.atlassian.jira.plugin.... ]
Sanne Grinovero updated ISPN-3983:
----------------------------------
Labels: 6.3remotequeries (was: )
> Remove some performance bottlenecks from ProtoStream
> ----------------------------------------------------
>
> Key: ISPN-3983
> URL: https://issues.jboss.org/browse/ISPN-3983
> Project: Infinispan
> Issue Type: Bug
> Components: Remote Querying
> Affects Versions: 6.0.0.Final
> Reporter: Adrian Nistor
> Assignee: Adrian Nistor
> Labels: 6.3remotequeries
> Fix For: 7.0.0.Alpha1, 7.0.0.Final
>
>
> Profiling has shown that there are many HashMaps created in MessageContext to help field lookup by name.
> Normally this is a static piece of information that should be computed only once when a marshaller is registered and then it should become immutable and be reused.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
12 years, 1 month
[JBoss JIRA] (ISPN-4003) Test Map/Reduce in compatibility mode
by Mircea Markus (JIRA)
Mircea Markus created ISPN-4003:
-----------------------------------
Summary: Test Map/Reduce in compatibility mode
Key: ISPN-4003
URL: https://issues.jboss.org/browse/ISPN-4003
Project: Infinispan
Issue Type: Feature Request
Components: Distributed Execution and Map/Reduce
Reporter: Mircea Markus
Assignee: Dan Berindei
Once ISPN-4002 is in place, we need a test that:
- starts a cluster in compatibility mode
- populates cache A with Person objects (protobuf) through the java hotrod client
- on the server a Map/Reduce task is run on the Person cache, which filters out all the persons with a given name and, for each matching person, it outputs something like (personId, age) into a result cache (as per ISPN-4002)
- the client reads the result cache and validates that it is correct
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
12 years, 1 month
[JBoss JIRA] (ISPN-4002) Allow the reduce phase to store elements into an intermediate cache
by Mircea Markus (JIRA)
[ https://issues.jboss.org/browse/ISPN-4002?page=com.atlassian.jira.plugin.... ]
Mircea Markus updated ISPN-4002:
--------------------------------
Description:
In the situation in which the result of the Map/Reduce task is large, returning it to the originator does not work, as the originator would run OOM. In order to drop this limitation, would be good to:
- have a result cache
- put all the M/R entries into this result cache
It should be possible to specify this cache to the Map/Reduce task to be executed (cache name), as users might reuse the cache and configure it externally.
The caller will be notified once the data Map/Reduce is finished. We'd need a way for the user to get all the keys in this cache for further processing.
was:
In the situation in which the result of the Map/Reduce task is large, returning it to the originator does not work, as the originator would run OOM. In order to drop this limitation, would be good to:
- have a result cache
- put all the M/R entries into this result cache
The caller will be notified once the data Map/Reduce is finished. We'd need a way for the user to get all the keys in this cache for further processing.
> Allow the reduce phase to store elements into an intermediate cache
> --------------------------------------------------------------------
>
> Key: ISPN-4002
> URL: https://issues.jboss.org/browse/ISPN-4002
> Project: Infinispan
> Issue Type: Feature Request
> Components: Core, Distributed Execution and Map/Reduce
> Reporter: Mircea Markus
> Assignee: Vladimir Blagojevic
>
> In the situation in which the result of the Map/Reduce task is large, returning it to the originator does not work, as the originator would run OOM. In order to drop this limitation, would be good to:
> - have a result cache
> - put all the M/R entries into this result cache
> It should be possible to specify this cache to the Map/Reduce task to be executed (cache name), as users might reuse the cache and configure it externally.
>
> The caller will be notified once the data Map/Reduce is finished. We'd need a way for the user to get all the keys in this cache for further processing.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
12 years, 1 month
[JBoss JIRA] (ISPN-4002) Allow the reduce phase to store elements into an intermediate cache
by Mircea Markus (JIRA)
Mircea Markus created ISPN-4002:
-----------------------------------
Summary: Allow the reduce phase to store elements into an intermediate cache
Key: ISPN-4002
URL: https://issues.jboss.org/browse/ISPN-4002
Project: Infinispan
Issue Type: Feature Request
Components: Core, Distributed Execution and Map/Reduce
Reporter: Mircea Markus
Assignee: Dan Berindei
In the situation in which the result of the Map/Reduce task is large, returning it to the originator does not work, as the originator would run OOM. In order to drop this limitation, would be good to:
- have a result cache
- put all the M/R entries into this result cache
The caller will be notified once the data Map/Reduce is finished. We'd need a way for the user to get all the keys in this cache for further processing.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
12 years, 1 month
[JBoss JIRA] (ISPN-4002) Allow the reduce phase to store elements into an intermediate cache
by Mircea Markus (JIRA)
[ https://issues.jboss.org/browse/ISPN-4002?page=com.atlassian.jira.plugin.... ]
Mircea Markus updated ISPN-4002:
--------------------------------
Assignee: Vladimir Blagojevic (was: Dan Berindei)
> Allow the reduce phase to store elements into an intermediate cache
> --------------------------------------------------------------------
>
> Key: ISPN-4002
> URL: https://issues.jboss.org/browse/ISPN-4002
> Project: Infinispan
> Issue Type: Feature Request
> Components: Core, Distributed Execution and Map/Reduce
> Reporter: Mircea Markus
> Assignee: Vladimir Blagojevic
>
> In the situation in which the result of the Map/Reduce task is large, returning it to the originator does not work, as the originator would run OOM. In order to drop this limitation, would be good to:
> - have a result cache
> - put all the M/R entries into this result cache
> The caller will be notified once the data Map/Reduce is finished. We'd need a way for the user to get all the keys in this cache for further processing.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
12 years, 1 month