[JBoss JIRA] (ISPN-3217) Rebalance doesn't store data into cache store
by Takayoshi Kimura (JIRA)
[ https://issues.jboss.org/browse/ISPN-3217?page=com.atlassian.jira.plugin.... ]
Takayoshi Kimura updated ISPN-3217:
-----------------------------------
Fix Version/s: 5.3.0.CR2
Affects Version/s: 5.3.0.CR1
> Rebalance doesn't store data into cache store
> ---------------------------------------------
>
> Key: ISPN-3217
> URL: https://issues.jboss.org/browse/ISPN-3217
> Project: Infinispan
> Issue Type: Bug
> Components: Core API
> Affects Versions: 5.2.4.Final, 5.2.5.Final, 5.2.6.Final, 5.3.0.CR1
> Reporter: Takayoshi Kimura
> Assignee: Mircea Markus
> Priority: Blocker
> Fix For: 5.2.7.Final, 5.3.0.CR2
>
> Attachments: ISPN-3217-logs.zip
>
>
> In DistCacheStoreInterceptor.skip():
> {noformat}
> private boolean skip(InvocationContext ctx, Object key, FlagAffectedCommand command) {
> return skip(ctx, command) || skipKey(key) || (isUsingLockDelegation && !cdl.localNodeIsPrimaryOwner(key) && (!cdl.localNodeIsOwner(key) || ctx.isOriginLocal()));
> }
> {noformat}
> The 3rd condition returns true on rebalance, so the data is not stored in the cache store.
> - The caller is org.infinispan.statetransfer.StateConsumerImpl.doApplyState
> - The iic is org.infinispan.context.SingleKeyNonTxInvocationContext
> - The example command is:
> {noformat}
> PutKeyValueCommand{key=ByteArrayKey{data=ByteArray{size=9, hashCode=cb62ce78, array=0x033e06666f6f3839..}}, value=CacheValue{data=ByteArray{size=6, array=0x033e03626172..}, version=4294968192}, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
11 years, 7 months
[JBoss JIRA] (ISPN-3217) Rebalance doesn't store data into cache store
by Takayoshi Kimura (JIRA)
[ https://issues.jboss.org/browse/ISPN-3217?page=com.atlassian.jira.plugin.... ]
Takayoshi Kimura edited comment on ISPN-3217 at 6/12/13 12:42 AM:
------------------------------------------------------------------
I tested this with JDG server, Attached logs, configs and h2 data. The data count is:
{noformat}
$ java -classpath ~/jdg610/modules/com/h2database/h2/main/h2-1.3.168-redhat-1.jar org.h2.tools.Shell -user sa -password sa -url "jdbc:h2:/tmp/node1" -sql 'select count(*) from "ispn_entry_default"'
COUNT(*)
10
(1 row, 1 ms)
{noformat}
{noformat}
$ java -classpath ~/jdg610/modules/com/h2database/h2/main/h2-1.3.168-redhat-1.jar org.h2.tools.Shell -user sa -password sa -url "jdbc:h2:/tmp/node2" -sql 'select count(*) from "ispn_entry_default"'
COUNT(*)
0
(1 row, 1 ms)
{noformat}
was (Author: tkimura):
Attached logs. The data count is:
$ java -classpath ~/jdg610/modules/com/h2database/h2/main/h2-1.3.168-redhat-1.jar org.h2.tools.Shell -user sa -password sa -url "jdbc:h2:/tmp/node1" -sql 'select count(*) from "ispn_entry_default"'
COUNT(*)
10
(1 row, 1 ms)
$ java -classpath ~/jdg610/modules/com/h2database/h2/main/h2-1.3.168-redhat-1.jar org.h2.tools.Shell -user sa -password sa -url "jdbc:h2:/tmp/node2" -sql 'select count(*) from "ispn_entry_default"'
COUNT(*)
0
(1 row, 1 ms)
> Rebalance doesn't store data into cache store
> ---------------------------------------------
>
> Key: ISPN-3217
> URL: https://issues.jboss.org/browse/ISPN-3217
> Project: Infinispan
> Issue Type: Bug
> Components: Core API
> Affects Versions: 5.2.4.Final, 5.2.5.Final, 5.2.6.Final
> Reporter: Takayoshi Kimura
> Assignee: Mircea Markus
> Priority: Blocker
> Fix For: 5.2.7.Final
>
> Attachments: ISPN-3217-logs.zip
>
>
> In DistCacheStoreInterceptor.skip():
> {noformat}
> private boolean skip(InvocationContext ctx, Object key, FlagAffectedCommand command) {
> return skip(ctx, command) || skipKey(key) || (isUsingLockDelegation && !cdl.localNodeIsPrimaryOwner(key) && (!cdl.localNodeIsOwner(key) || ctx.isOriginLocal()));
> }
> {noformat}
> The 3rd condition returns true on rebalance, so the data is not stored in the cache store.
> - The caller is org.infinispan.statetransfer.StateConsumerImpl.doApplyState
> - The iic is org.infinispan.context.SingleKeyNonTxInvocationContext
> - The example command is:
> {noformat}
> PutKeyValueCommand{key=ByteArrayKey{data=ByteArray{size=9, hashCode=cb62ce78, array=0x033e06666f6f3839..}}, value=CacheValue{data=ByteArray{size=6, array=0x033e03626172..}, version=4294968192}, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
11 years, 7 months
[JBoss JIRA] (ISPN-3217) Rebalance doesn't store data into cache store
by Takayoshi Kimura (JIRA)
[ https://issues.jboss.org/browse/ISPN-3217?page=com.atlassian.jira.plugin.... ]
Takayoshi Kimura updated ISPN-3217:
-----------------------------------
Attachment: ISPN-3217-logs.zip
Attached logs. The data count is:
$ java -classpath ~/jdg610/modules/com/h2database/h2/main/h2-1.3.168-redhat-1.jar org.h2.tools.Shell -user sa -password sa -url "jdbc:h2:/tmp/node1" -sql 'select count(*) from "ispn_entry_default"'
COUNT(*)
10
(1 row, 1 ms)
$ java -classpath ~/jdg610/modules/com/h2database/h2/main/h2-1.3.168-redhat-1.jar org.h2.tools.Shell -user sa -password sa -url "jdbc:h2:/tmp/node2" -sql 'select count(*) from "ispn_entry_default"'
COUNT(*)
0
(1 row, 1 ms)
> Rebalance doesn't store data into cache store
> ---------------------------------------------
>
> Key: ISPN-3217
> URL: https://issues.jboss.org/browse/ISPN-3217
> Project: Infinispan
> Issue Type: Bug
> Components: Core API
> Affects Versions: 5.2.4.Final, 5.2.5.Final, 5.2.6.Final
> Reporter: Takayoshi Kimura
> Assignee: Mircea Markus
> Priority: Blocker
> Fix For: 5.2.7.Final
>
> Attachments: ISPN-3217-logs.zip
>
>
> In DistCacheStoreInterceptor.skip():
> {noformat}
> private boolean skip(InvocationContext ctx, Object key, FlagAffectedCommand command) {
> return skip(ctx, command) || skipKey(key) || (isUsingLockDelegation && !cdl.localNodeIsPrimaryOwner(key) && (!cdl.localNodeIsOwner(key) || ctx.isOriginLocal()));
> }
> {noformat}
> The 3rd condition returns true on rebalance, so the data is not stored in the cache store.
> - The caller is org.infinispan.statetransfer.StateConsumerImpl.doApplyState
> - The iic is org.infinispan.context.SingleKeyNonTxInvocationContext
> - The example command is:
> {noformat}
> PutKeyValueCommand{key=ByteArrayKey{data=ByteArray{size=9, hashCode=cb62ce78, array=0x033e06666f6f3839..}}, value=CacheValue{data=ByteArray{size=6, array=0x033e03626172..}, version=4294968192}, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
11 years, 7 months
[JBoss JIRA] (ISPN-3217) Rebalance doesn't store data into cache store
by Takayoshi Kimura (JIRA)
Takayoshi Kimura created ISPN-3217:
--------------------------------------
Summary: Rebalance doesn't store data into cache store
Key: ISPN-3217
URL: https://issues.jboss.org/browse/ISPN-3217
Project: Infinispan
Issue Type: Bug
Components: Core API
Affects Versions: 5.2.6.Final, 5.2.5.Final, 5.2.4.Final
Reporter: Takayoshi Kimura
Assignee: Mircea Markus
Priority: Blocker
Fix For: 5.2.7.Final
In DistCacheStoreInterceptor.skip():
{noformat}
private boolean skip(InvocationContext ctx, Object key, FlagAffectedCommand command) {
return skip(ctx, command) || skipKey(key) || (isUsingLockDelegation && !cdl.localNodeIsPrimaryOwner(key) && (!cdl.localNodeIsOwner(key) || ctx.isOriginLocal()));
}
{noformat}
The 3rd condition returns true on rebalance, so the data is not stored in the cache store.
- The caller is org.infinispan.statetransfer.StateConsumerImpl.doApplyState
- The iic is org.infinispan.context.SingleKeyNonTxInvocationContext
- The example command is PutKeyValueCommand{key=ByteArrayKey{data=ByteArray{size=9, hashCode=cb62ce78, array=0x033e06666f6f3839..}}, value=CacheValue{data=ByteArray{size=6, array=0x033e03626172..}, version=4294968192}, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
11 years, 7 months
[JBoss JIRA] (ISPN-3217) Rebalance doesn't store data into cache store
by Takayoshi Kimura (JIRA)
[ https://issues.jboss.org/browse/ISPN-3217?page=com.atlassian.jira.plugin.... ]
Takayoshi Kimura updated ISPN-3217:
-----------------------------------
Description:
In DistCacheStoreInterceptor.skip():
{noformat}
private boolean skip(InvocationContext ctx, Object key, FlagAffectedCommand command) {
return skip(ctx, command) || skipKey(key) || (isUsingLockDelegation && !cdl.localNodeIsPrimaryOwner(key) && (!cdl.localNodeIsOwner(key) || ctx.isOriginLocal()));
}
{noformat}
The 3rd condition returns true on rebalance, so the data is not stored in the cache store.
- The caller is org.infinispan.statetransfer.StateConsumerImpl.doApplyState
- The iic is org.infinispan.context.SingleKeyNonTxInvocationContext
- The example command is:
{noformat}
PutKeyValueCommand{key=ByteArrayKey{data=ByteArray{size=9, hashCode=cb62ce78, array=0x033e06666f6f3839..}}, value=CacheValue{data=ByteArray{size=6, array=0x033e03626172..}, version=4294968192}, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}
{noformat}
was:
In DistCacheStoreInterceptor.skip():
{noformat}
private boolean skip(InvocationContext ctx, Object key, FlagAffectedCommand command) {
return skip(ctx, command) || skipKey(key) || (isUsingLockDelegation && !cdl.localNodeIsPrimaryOwner(key) && (!cdl.localNodeIsOwner(key) || ctx.isOriginLocal()));
}
{noformat}
The 3rd condition returns true on rebalance, so the data is not stored in the cache store.
- The caller is org.infinispan.statetransfer.StateConsumerImpl.doApplyState
- The iic is org.infinispan.context.SingleKeyNonTxInvocationContext
- The example command is PutKeyValueCommand{key=ByteArrayKey{data=ByteArray{size=9, hashCode=cb62ce78, array=0x033e06666f6f3839..}}, value=CacheValue{data=ByteArray{size=6, array=0x033e03626172..}, version=4294968192}, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}
> Rebalance doesn't store data into cache store
> ---------------------------------------------
>
> Key: ISPN-3217
> URL: https://issues.jboss.org/browse/ISPN-3217
> Project: Infinispan
> Issue Type: Bug
> Components: Core API
> Affects Versions: 5.2.4.Final, 5.2.5.Final, 5.2.6.Final
> Reporter: Takayoshi Kimura
> Assignee: Mircea Markus
> Priority: Blocker
> Fix For: 5.2.7.Final
>
>
> In DistCacheStoreInterceptor.skip():
> {noformat}
> private boolean skip(InvocationContext ctx, Object key, FlagAffectedCommand command) {
> return skip(ctx, command) || skipKey(key) || (isUsingLockDelegation && !cdl.localNodeIsPrimaryOwner(key) && (!cdl.localNodeIsOwner(key) || ctx.isOriginLocal()));
> }
> {noformat}
> The 3rd condition returns true on rebalance, so the data is not stored in the cache store.
> - The caller is org.infinispan.statetransfer.StateConsumerImpl.doApplyState
> - The iic is org.infinispan.context.SingleKeyNonTxInvocationContext
> - The example command is:
> {noformat}
> PutKeyValueCommand{key=ByteArrayKey{data=ByteArray{size=9, hashCode=cb62ce78, array=0x033e06666f6f3839..}}, value=CacheValue{data=ByteArray{size=6, array=0x033e03626172..}, version=4294968192}, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
11 years, 7 months
[JBoss JIRA] (ISPN-3144) Reduce memory consumption per cache entry
by Mircea Markus (JIRA)
[ https://issues.jboss.org/browse/ISPN-3144?page=com.atlassian.jira.plugin.... ]
Mircea Markus updated ISPN-3144:
--------------------------------
Status: Resolved (was: Pull Request Sent)
Resolution: Done
> Reduce memory consumption per cache entry
> -----------------------------------------
>
> Key: ISPN-3144
> URL: https://issues.jboss.org/browse/ISPN-3144
> Project: Infinispan
> Issue Type: Enhancement
> Reporter: Galder Zamarreño
> Assignee: Galder Zamarreño
> Fix For: 5.3.0.Final
>
>
> Basically, the difference between Hot Rod then (dc6708f) and now (6058358) is: 32 bytes, which is: new metadata object, a reference to it, and 2 unusued longs for immortal entries.
> With embedded metadata (~191 bytes per entry): https://dl.dropboxusercontent.com/u/6148072/with-embedded.png
> With versioned entries (~159 bytes per entry): https://dl.dropboxusercontent.com/u/6148072/with-versioned.png
> And there's more: we have internal cache entries that have a reference to internal cache values, per entry. This is useful for some cases (cache stores…etc), but this extra reference to the value, plus the value object itself, is 16 bytes (how useful is it really to have a separate value instance to keep just the value? Needs reassessing its usefulness...).
> So really, I think the minimum Hot Rod overhead we should aim for is ~143 bytes. If each server module could define what the ICE class (well, classes to cover all immortal, mortal…etc cases) to use, which is purely designed for their servers (i.e. hot rod just needs: value + version; memcached needs: value + version + flags), we could get to this level…
> You still want the metadata to be passed from the client, but for those specialised use cases in Infinispan, we could have a mapping between the metadata type and the type of ICEs created…
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
11 years, 7 months