[JBoss JIRA] (ISPN-10706) StateTransfer should complete segments as they are transferred.
by Will Burns (Jira)
[ https://issues.jboss.org/browse/ISPN-10706?page=com.atlassian.jira.plugin... ]
Will Burns updated ISPN-10706:
------------------------------
Description:
State Transfer today sends entries by a given set of segments it owns. This means it will not complete the transfer until all entries for all the given segments are complete. Instead we should be a bit smarter and complete segments as they are sent, since we can efficiently iterate over a given set of segments.
The main problematic part is if we don't have a segmented store and `fetchPersistentState` is enabled. In this case we would need to do the current behavior.
We also can then remove references in the CommitManager by segment, instead of retaining all keys for the given set of segments.
> StateTransfer should complete segments as they are transferred.
> ---------------------------------------------------------------
>
> Key: ISPN-10706
> URL: https://issues.jboss.org/browse/ISPN-10706
> Project: Infinispan
> Issue Type: Enhancement
> Reporter: Will Burns
> Priority: Major
>
> State Transfer today sends entries by a given set of segments it owns. This means it will not complete the transfer until all entries for all the given segments are complete. Instead we should be a bit smarter and complete segments as they are sent, since we can efficiently iterate over a given set of segments.
> The main problematic part is if we don't have a segmented store and `fetchPersistentState` is enabled. In this case we would need to do the current behavior.
> We also can then remove references in the CommitManager by segment, instead of retaining all keys for the given set of segments.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
6 years, 2 months
[JBoss JIRA] (ISPN-10702) Docs: AffinityIndexManager error
by Donald Naro (Jira)
Donald Naro created ISPN-10702:
----------------------------------
Summary: Docs: AffinityIndexManager error
Key: ISPN-10702
URL: https://issues.jboss.org/browse/ISPN-10702
Project: Infinispan
Issue Type: Enhancement
Components: Documentation-Core
Reporter: Donald Naro
Assignee: Donald Naro
code:xml}
<distributed-cache name="default"
key-partitioner="org.infinispan.distribution.ch.impl.AffinityPartitioner">
<indexing index="PRIMARY_OWNER">
<property name="default.indexmanager">
org.infinispan.query.affinity.AffinityIndexManager
</property>
<!-- optional: control the number of shards, the default is 4 -->
<property name="default.sharding_strategy.nbr_of_shards">10</property>
</indexing>
</distributed-cache>
{code}
{noformat}
|
| 282: <!---->
| 283: <distributed-cache name="cache8799v2"
| 284: key-partitioner="org.infinispan.distribution.ch.impl.AffinityPartitioner">
| ^^^^ 'key-partitioner' isn't an allowed attribute for the
| 'distributed-cache' element
|
| Attributes allowed here are:
| batching mode segments
| capacity-factor module start
| configuration name statistics
| jndi-name owners statistics-available
| l1-lifespan remote-timeout
|
| 285: <indexing index="PRIMARY_OWNER">
| 286: <property name="default.indexmanager">
| 287: org.infinispan.query.affinity.AffinityIndexManager
{noformat}
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
6 years, 2 months
[JBoss JIRA] (ISPN-10700) Unknown type error with binary storage and indexing
by Will Burns (Jira)
Will Burns created ISPN-10700:
---------------------------------
Summary: Unknown type error with binary storage and indexing
Key: ISPN-10700
URL: https://issues.jboss.org/browse/ISPN-10700
Project: Infinispan
Issue Type: Bug
Components: Indexing
Affects Versions: 10.0.0.CR2
Reporter: Will Burns
While adding tests for indexing with off heap, I also happened to add some with BINARY storage. And unfortunately the indexing code is not properly unwrapping the key when removing an index it appears. The stack trace is as the following:
{code}
java.util.concurrent.CompletionException: org.infinispan.commons.CacheException: java.io.IOException: Unknown type: 74
at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:331)
at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:346)
at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:632)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506)
at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088)
at org.infinispan.interceptors.impl.QueueAsyncInvocationStage.invokeQueuedHandlers(QueueAsyncInvocationStage.java:113)
at org.infinispan.interceptors.impl.QueueAsyncInvocationStage.accept(QueueAsyncInvocationStage.java:86)
at org.infinispan.interceptors.impl.QueueAsyncInvocationStage.accept(QueueAsyncInvocationStage.java:31)
at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859)
at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506)
at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2073)
at org.infinispan.util.concurrent.CompletionStages.lambda$continueOnExecutor$0(CompletionStages.java:158)
at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859)
at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837)
at java.base/java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:478)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: org.infinispan.commons.CacheException: java.io.IOException: Unknown type: 74
at org.infinispan.commons.dataconversion.BinaryEncoder.fromStorage(BinaryEncoder.java:39)
at org.infinispan.encoding.DataConversion.extractIndexable(DataConversion.java:226)
at org.infinispan.query.backend.QueryInterceptor.extractKey(QueryInterceptor.java:403)
at org.infinispan.query.backend.QueryInterceptor.keyToString(QueryInterceptor.java:411)
at org.infinispan.query.backend.QueryInterceptor.lambda$removeFromIndexes$4(QueryInterceptor.java:340)
at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
at java.base/java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:177)
at java.base/java.util.HashMap$KeySpliterator.forEachRemaining(HashMap.java:1603)
at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
at org.infinispan.query.backend.QueryInterceptor.removeFromIndexes(QueryInterceptor.java:341)
at org.infinispan.query.backend.QueryInterceptor.processChange(QueryInterceptor.java:442)
at org.infinispan.query.backend.QueryInterceptor.lambda$handleDataWriteCommand$0(QueryInterceptor.java:189)
at org.infinispan.interceptors.InvocationSuccessAction.apply(InvocationSuccessAction.java:22)
at org.infinispan.interceptors.impl.QueueAsyncInvocationStage.invokeQueuedHandlers(QueueAsyncInvocationStage.java:123)
... 13 more
Caused by: java.io.IOException: Unknown type: 74
at org.infinispan.marshall.core.GlobalMarshaller.readNonNullableObject(GlobalMarshaller.java:741)
at org.infinispan.marshall.core.GlobalMarshaller.readNullableObject(GlobalMarshaller.java:378)
at org.infinispan.marshall.core.GlobalMarshaller.objectFromObjectInput(GlobalMarshaller.java:212)
at org.infinispan.marshall.core.GlobalMarshaller.objectFromByteBuffer(GlobalMarshaller.java:208)
at org.infinispan.commons.dataconversion.BinaryEncoder.fromStorage(BinaryEncoder.java:37)
... 31 more
{code}
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
6 years, 2 months