6:34 p.m.
I am playing with the Infinispan 5.3 quick-start package to exercise my usage
of the Grouping API. As we know the quick start package is made up of
AbstractNode.java, Node0.java, Node1.java and Node2.java (plus a
util/listener).
My ambition is to demonstrate
1. that any Cache<K,V>.put("DIMENSION.xxx",v) will flow through my
Grouper
and "pin" that key in the Cache at @Node=0.
2. that any Cache<K,V>.put("POSITION.xxx",v) will flow through my
Grouper
and "pin" that key in the Cache at either @Node=1 or @Node=2 .
Here is my AbstractNode#createCacheManagerProgramatically() config:
private static EmbeddedCacheManager createCacheManagerProgramatically() {
return new DefaultCacheManager(
GlobalConfigurationBuilder.defaultClusteredBuilder()
.transport().addProperty("configurationFile", "jgroups.xml")
.build(),
new org.infinispan.configuration.cache.ConfigurationBuilder()
.clustering()
.cacheMode(CacheMode.DIST_SYNC)
.hash().numOwners(1).groups().enabled(Boolean.TRUE)
.addGrouper(new
com.jpmorgan.ct.lri.cs.ae.test.DimensionGrouper<String>())
.build()
);
}
And here is my Grouper<T> implementation
public class DimensionGrouper<T> implements Grouper<String> {
public String computeGroup(String key, String group) {
if (key.indexOf("DIMENSION.")==0) {
String groupPinned = "0";
System.out.println("Pinning Key=["+key+"]
@Node=["+groupPinned+"]");
//node= exactly 0
return groupPinned;
} else if (key.indexOf("POSITION.")==0) {
String groupPinned = ""+(1+ (int)(Math.random()*2));
System.out.println("Pinning Key=["+key+"]
@Node=["+groupPinned+"]");
//node= {1,2}
return groupPinned;
} else {
return null;
}
}
public Class<String> getKeyType() {
return String.class;
}
}
The "logic" is working correctly ... i.e. when from Node2.java I call
for (int i = 0; i < 10; i++) {
cacheDP.put("DIMENSION." + i, "DimensionValue." + i);
cacheDP.put("POSITION." + i, "PositionValue." + i);
}
My DimensionGrouper is returning "0" from computeGroup(). My question is
how in Infinispan can I map the computeGroup() return value to a physical
Node? I.e. How can I make it so that when computeGroup() returns "0", I
will *only* add that <K,V> entry to the Cache @Node 0?
--
View this message in context:
http://infinispan-developer-list.980875.n3.nabble.com/Re-How-to-get-Group...
Sent from the Infinispan Developer List mailing list archive at Nabble.com.
5:31 p.m.
New subject: How to get Grouper<T>#computeGroup(key) return value to map to physical Node?
Hmmm, one hacky way might be to hold on to the grouper instance passed in via
configuration, and once the cache manager has been started, set it in the grouper and use
to query either the address, or the physical address (via
EmbeddedCacheManager.getTransport…)?
On May 14, 2013, at 6:34 PM, cotton-ben <ben.cotton(a)ALUMNI.RUTGERS.EDU> wrote:
I am playing with the Infinispan 5.3 quick-start package to exercise
my usage
of the Grouping API. As we know the quick start package is made up of
AbstractNode.java, Node0.java, Node1.java and Node2.java (plus a
util/listener).
My ambition is to demonstrate
1. that any Cache<K,V>.put("DIMENSION.xxx",v) will flow through my
Grouper
and "pin" that key in the Cache at @Node=0.
2. that any Cache<K,V>.put("POSITION.xxx",v) will flow through my
Grouper
and "pin" that key in the Cache at either @Node=1 or @Node=2 .
Here is my AbstractNode#createCacheManagerProgramatically() config:
private static EmbeddedCacheManager createCacheManagerProgramatically() {
return new DefaultCacheManager(
GlobalConfigurationBuilder.defaultClusteredBuilder()
.transport().addProperty("configurationFile", "jgroups.xml")
.build(),
new org.infinispan.configuration.cache.ConfigurationBuilder()
.clustering()
.cacheMode(CacheMode.DIST_SYNC)
.hash().numOwners(1).groups().enabled(Boolean.TRUE)
.addGrouper(new
com.jpmorgan.ct.lri.cs.ae.test.DimensionGrouper<String>())
.build()
);
}
And here is my Grouper<T> implementation
public class DimensionGrouper<T> implements Grouper<String> {
public String computeGroup(String key, String group) {
if (key.indexOf("DIMENSION.")==0) {
String groupPinned = "0";
System.out.println("Pinning Key=["+key+"]
@Node=["+groupPinned+"]");
//node= exactly 0
return groupPinned;
} else if (key.indexOf("POSITION.")==0) {
String groupPinned = ""+(1+ (int)(Math.random()*2));
System.out.println("Pinning Key=["+key+"]
@Node=["+groupPinned+"]");
//node= {1,2}
return groupPinned;
} else {
return null;
}
}
public Class<String> getKeyType() {
return String.class;
}
}
The "logic" is working correctly ... i.e. when from Node2.java I call
for (int i = 0; i < 10; i++) {
cacheDP.put("DIMENSION." + i, "DimensionValue." + i);
cacheDP.put("POSITION." + i, "PositionValue." + i);
}
My DimensionGrouper is returning "0" from computeGroup(). My question is
how in Infinispan can I map the computeGroup() return value to a physical
Node? I.e. How can I make it so that when computeGroup() returns "0", I
will *only* add that <K,V> entry to the Cache @Node 0?
--
View this message in context:
http://infinispan-developer-list.980875.n3.nabble.com/Re-How-to-get-Group...
Sent from the Infinispan Developer List mailing list archive at Nabble.com.
_______________________________________________
infinispan-dev mailing list
infinispan-dev(a)lists.jboss.org
https://lists.jboss.org/mailman/listinfo/infinispan-dev
--
Galder Zamarreño
galder(a)redhat.com
twitter.com/galderz
Project Lead, Escalante
http://escalante.io
Engineer, Infinispan
http://infinispan.org
6:15 p.m.
New subject: How to get Grouper<T>#computeGroup(key) return value to map to physical Node?
I guess the grouper could use a KeyAffinityService (or something similar)
to generate a key local to each node and return that instead of "0" or
"1".
However, you won't have any guarantee that the keys will stay on the same
node if the cache topology changes (e.g. another node joins).
It used to be that the actual address of the node would (almost) always be
mapped to that node, but that was just an implementation detail, and it
never worked 100%.
Ben, do you think being able to pin a key "permanently" to a node would be
useful?
Cheers
Dan
On Tue, May 21, 2013 at 6:31 PM, Galder Zamarreño <galder(a)redhat.com> wrote:
Hmmm, one hacky way might be to hold on to the grouper instance
passed in
via configuration, and once the cache manager has been started, set it in
the grouper and use to query either the address, or the physical address
(via EmbeddedCacheManager.getTransport…)?
On May 14, 2013, at 6:34 PM, cotton-ben <ben.cotton(a)ALUMNI.RUTGERS.EDU>
wrote:
> I am playing with the Infinispan 5.3 quick-start package to exercise my
usage
> of the Grouping API. As we know the quick start package is made up of
> AbstractNode.java, Node0.java, Node1.java and Node2.java (plus a
> util/listener).
>
> My ambition is to demonstrate
>
> 1. that any Cache<K,V>.put("DIMENSION.xxx",v) will flow through my
Grouper
> and "pin" that key in the Cache at @Node=0.
> 2. that any Cache<K,V>.put("POSITION.xxx",v) will flow through my
Grouper
> and "pin" that key in the Cache at either @Node=1 or @Node=2 .
>
> Here is my AbstractNode#createCacheManagerProgramatically() config:
>
> private static EmbeddedCacheManager createCacheManagerProgramatically() {
> return new DefaultCacheManager(
>
GlobalConfigurationBuilder.defaultClusteredBuilder()
>
.transport().addProperty("configurationFile", "jgroups.xml")
> .build(),
> new
org.infinispan.configuration.cache.ConfigurationBuilder()
> .clustering()
> .cacheMode(CacheMode.DIST_SYNC)
>
.hash().numOwners(1).groups().enabled(Boolean.TRUE)
> .addGrouper(new
> com.jpmorgan.ct.lri.cs.ae.test.DimensionGrouper<String>())
> .build()
> );
> }
>
> And here is my Grouper<T> implementation
>
> public class DimensionGrouper<T> implements Grouper<String> {
> public String computeGroup(String key, String group) {
> if (key.indexOf("DIMENSION.")==0) {
> String groupPinned = "0";
> System.out.println("Pinning Key=["+key+"]
@Node=["+groupPinned+"]");
> //node= exactly 0
> return groupPinned;
> } else if (key.indexOf("POSITION.")==0) {
> String groupPinned = ""+(1+
(int)(Math.random()*2));
> System.out.println("Pinning Key=["+key+"]
@Node=["+groupPinned+"]");
> //node= {1,2}
> return groupPinned;
> } else {
> return null;
> }
> }
>
> public Class<String> getKeyType() {
> return String.class;
> }
>
> }
>
> The "logic" is working correctly ... i.e. when from Node2.java I call
>
> for (int i = 0; i < 10; i++) {
> cacheDP.put("DIMENSION." + i,
"DimensionValue." + i);
> cacheDP.put("POSITION." + i,
"PositionValue." + i);
>
> }
>
> My DimensionGrouper is returning "0" from computeGroup(). My question is
> how in Infinispan can I map the computeGroup() return value to a physical
> Node? I.e. How can I make it so that when computeGroup() returns "0", I
> will *only* add that <K,V> entry to the Cache @Node 0?
>
>
>
>
>
> --
> View this message in context:
http://infinispan-developer-list.980875.n3.nabble.com/Re-How-to-get-Group...
> Sent from the Infinispan Developer List mailing list archive at
Nabble.com.
> _______________________________________________
> infinispan-dev mailing list
> infinispan-dev(a)lists.jboss.org
> https://lists.jboss.org/mailman/listinfo/infinispan-dev
--
Galder Zamarreño
galder(a)redhat.com
twitter.com/galderz
Project Lead, Escalante
http://escalante.io
Engineer, Infinispan
http://infinispan.org
_______________________________________________
infinispan-dev mailing list
infinispan-dev(a)lists.jboss.org
https://lists.jboss.org/mailman/listinfo/infinispan-dev
6:26 p.m.
New subject: How to get Grouper<T>#computeGroup(key) return value to map to physical Node?
Ben, do you think being able to pin a key "permanently" to
a node would be
useful?
Indeed I do.
The ideal mechanism would be to merge both the ambitions of the
Grouper#computeGroup(key) API and KeyAffinityService API into a capability
that would allow me to render non-anonymous grouping that could (in its
implementation) pin a specific key at a specific node identity
(permanently).
--
View this message in context:
http://infinispan-developer-list.980875.n3.nabble.com/Re-How-to-get-Group...
Sent from the Infinispan Developer List mailing list archive at Nabble.com.
6:22 p.m.
New subject: How to get Grouper<T>#computeGroup(key) return value to map to physical Node?
Thanks for the response Galder. Interesting. I have been counseled by
Mircea to use the KeyAffiinityService API to do my physical key pinning @
specific node participants. However, the KeyAffinityService brings the risk
of not being able to allow my pinned keys to survive topology changes (i.e.
the physical key affinity may be lost). The Grouper#computeGroup(key)
technique *does* survive grid topology changes (but does not offer a
mechanism for physically pinning @ specific node identity -- i.e. Grouper
pins keys to nodes anonymously).
The ideal compromise (of course!) is to empower the user with a
non-anonymous Grouper#computeGroup(key) API capability ... where I can have
my key pinned @node=ID_CHOSEN_BY_ME *and* able to survive a topology change.
Still musing on these considerations. :-)
--
View this message in context:
http://infinispan-developer-list.980875.n3.nabble.com/Re-How-to-get-Group...
Sent from the Infinispan Developer List mailing list archive at Nabble.com.
4244
days inactive
4251
days old
infinispan-dev@lists.jboss.org
4 comments
3 participants
participants (3)
-
cotton-ben -
Dan Berindei -
Galder Zamarreño