[infinispan-issues] [JBoss JIRA] (ISPN-1513) Enhance distributed executor framework to be more topology aware

David B (Commented) (JIRA) jira-events at lists.jboss.org
Fri Nov 11 10:06:45 EST 2011


    [ https://issues.jboss.org/browse/ISPN-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12642134#comment-12642134 ] 

David B commented on ISPN-1513:
-------------------------------

We'll be very interested in fail-over policies. Currently we having long running processes distributed across the cluster that when a node fails the remaining nodes need to pick up. We are implementing this via a work stealing algorithm that we execute when the cluster view changes. The typical map-reduce type use-cases don't really fit well when addressing long running processes (i,e. balancing work load across a cluster).
                
> Enhance distributed executor framework to be more topology aware
> ----------------------------------------------------------------
>
>                 Key: ISPN-1513
>                 URL: https://issues.jboss.org/browse/ISPN-1513
>             Project: Infinispan
>          Issue Type: Enhancement
>          Components: Distributed Cache
>    Affects Versions: 5.0.1.FINAL
>            Reporter: David B
>            Assignee: Vladimir Blagojevic
>            Priority: Minor
>             Fix For: 5.2.0.FINAL
>
>
> Our environment has 2 local infinispan/jgroups clusters with a jgroups relay cluster to handle geographic failover. Our sites are geographically distant over a WAN. Currently DistributedExecutorService's submitEverywhere() sends Callables to every node in both local clusters. We would rather have additional methods provided to DistributedExecutorService to constrain submission on Callables to the same/local site.
> Currently I have extended DefaultExecutorService with my own TopologyAwareExecutorService and added a submitSameSite() method using the TopologyAwareAddress.isSameSite(). I did need to patch DistributedRunnableFuture in DefaultExecutorService to mark it protected vs. private.
> This could be extended to also provide submitSameRack() & submitSameMachine() though currently we don't have a use case for that.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jboss.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        


More information about the infinispan-issues mailing list