November 2016 - infinispan-issues

[JBoss JIRA] (ISPN-6817) Remove MultiPojoVersionMarshallTest

by Pedro Ruivo (JIRA)

[ https://issues.jboss.org/browse/ISPN-6817?page=com.atlassian.jira.plugin.... ] Pedro Ruivo updated ISPN-6817: ------------------------------ Status: Resolved (was: Pull Request Sent) Resolution: Done > Remove MultiPojoVersionMarshallTest > ----------------------------------- > > Key: ISPN-6817 > URL: https://issues.jboss.org/browse/ISPN-6817 > Project: Infinispan > Issue Type: Task > Components: Test Suite - Core > Reporter: Tristan Tarrant > Assignee: Galder Zamarreño > Fix For: 9.0.0.Beta1, 9.0.0.Final > > > -We need to disable MultiPojoVersionMarshallTest because Javassist (as of 3.20.0-GA) doesn't work with JDK 9.- > There's no active work being done to support the use case shown by MultiPojoVersionMarshallTest. We should remove the test and instead write up a documentation section that shows how users could use externalizers to add multi version support. > So, this task contains a code part, and a documentation part. It should be resolve once both have been included. -- This message was sent by Atlassian JIRA (v7.2.3#72005)

8 years, 1 month

1
0
0 / 0

[JBoss JIRA] (ISPN-7219) Administration console - creating template from existing template fails in some cases

by Roman Macor (JIRA)

Roman Macor created ISPN-7219: --------------------------------- Summary: Administration console - creating template from existing template fails in some cases Key: ISPN-7219 URL: https://issues.jboss.org/browse/ISPN-7219 Project: Infinispan Issue Type: Bug Components: JMX, reporting and management Affects Versions: 9.0.0.Alpha4 Reporter: Roman Macor Assignee: Vladimir Blagojevic Click on cache container -> Configuration -> Templates -> create new template -> fill in template name: newTemplate, base configuration: persistent-file-store-write-behind (template with file store and write-behind configured) -> next -> create Result: Pop up with error message: {"WFLYCTL0062: Composite operation failed and was rolled back. Steps that failed:":{"Operation step-2":"WFLYCTL0216: Management resource '[\n (\"profile\" => \"clustered\"),\n (\"subsystem\" => \"datagrid-infinispan\"),\n (\"cache-container\" => \"clustered\"),\n (\"configurations\" => \"CONFIGURATIONS\"),\n (\"distributed-cache-configuration\" => \"new\"),\n (\"file-store\" => \"FILE_STORE\"),\n (\"write-behind\" => \"WRITE_BEHIND\")\n]' not found"}} The new template is created, but configuration is not copied. -- This message was sent by Atlassian JIRA (v7.2.3#72005)

8 years, 1 month

1
0
0 / 0

[JBoss JIRA] (ISPN-6817) Remove MultiPojoVersionMarshallTest

by Galder Zamarreño (JIRA)

[ https://issues.jboss.org/browse/ISPN-6817?page=com.atlassian.jira.plugin.... ] Galder Zamarreño updated ISPN-6817: ----------------------------------- Status: Open (was: New) > Remove MultiPojoVersionMarshallTest > ----------------------------------- > > Key: ISPN-6817 > URL: https://issues.jboss.org/browse/ISPN-6817 > Project: Infinispan > Issue Type: Task > Components: Test Suite - Core > Reporter: Tristan Tarrant > Assignee: Galder Zamarreño > Fix For: 9.0.0.Beta1, 9.0.0.Final > > > -We need to disable MultiPojoVersionMarshallTest because Javassist (as of 3.20.0-GA) doesn't work with JDK 9.- > There's no active work being done to support the use case shown by MultiPojoVersionMarshallTest. We should remove the test and instead write up a documentation section that shows how users could use externalizers to add multi version support. > So, this task contains a code part, and a documentation part. It should be resolve once both have been included. -- This message was sent by Atlassian JIRA (v7.2.3#72005)

8 years, 1 month

1
0
0 / 0

[JBoss JIRA] (ISPN-6817) Remove MultiPojoVersionMarshallTest

by Galder Zamarreño (JIRA)

[ https://issues.jboss.org/browse/ISPN-6817?page=com.atlassian.jira.plugin.... ] Galder Zamarreño updated ISPN-6817: ----------------------------------- Status: Pull Request Sent (was: Open) Git Pull Request: https://github.com/infinispan/infinispan/pull/4677 > Remove MultiPojoVersionMarshallTest > ----------------------------------- > > Key: ISPN-6817 > URL: https://issues.jboss.org/browse/ISPN-6817 > Project: Infinispan > Issue Type: Task > Components: Test Suite - Core > Reporter: Tristan Tarrant > Assignee: Galder Zamarreño > Fix For: 9.0.0.Beta1, 9.0.0.Final > > > -We need to disable MultiPojoVersionMarshallTest because Javassist (as of 3.20.0-GA) doesn't work with JDK 9.- > There's no active work being done to support the use case shown by MultiPojoVersionMarshallTest. We should remove the test and instead write up a documentation section that shows how users could use externalizers to add multi version support. > So, this task contains a code part, and a documentation part. It should be resolve once both have been included. -- This message was sent by Atlassian JIRA (v7.2.3#72005)

8 years, 1 month

1
0
0 / 0

[JBoss JIRA] (ISPN-6817) Remove MultiPojoVersionMarshallTest

by Galder Zamarreño (JIRA)

[ https://issues.jboss.org/browse/ISPN-6817?page=com.atlassian.jira.plugin.... ] Galder Zamarreño updated ISPN-6817: ----------------------------------- Fix Version/s: 9.0.0.Beta1 9.0.0.Final > Remove MultiPojoVersionMarshallTest > ----------------------------------- > > Key: ISPN-6817 > URL: https://issues.jboss.org/browse/ISPN-6817 > Project: Infinispan > Issue Type: Task > Components: Test Suite - Core > Reporter: Tristan Tarrant > Assignee: Galder Zamarreño > Fix For: 9.0.0.Beta1, 9.0.0.Final > > > -We need to disable MultiPojoVersionMarshallTest because Javassist (as of 3.20.0-GA) doesn't work with JDK 9.- > There's no active work being done to support the use case shown by MultiPojoVersionMarshallTest. We should remove the test and instead write up a documentation section that shows how users could use externalizers to add multi version support. > So, this task contains a code part, and a documentation part. It should be resolve once both have been included. -- This message was sent by Atlassian JIRA (v7.2.3#72005)

8 years, 1 month

1
0
0 / 0

[JBoss JIRA] (ISPN-6906) Reduce dependency on JBoss Marshalling

by Galder Zamarreño (JIRA)

[ https://issues.jboss.org/browse/ISPN-6906?page=com.atlassian.jira.plugin.... ] Galder Zamarreño updated ISPN-6906: ----------------------------------- Git Pull Request: https://github.com/infinispan/infinispan/pull/4620, https://github.com/infinispan/infinispan/pull/4648, https://github.com/infinispan/infinispan/pull/4627, https://github.com/infinispan/infinispan/pull/4676 (was: https://github.com/infinispan/infinispan/pull/4620, https://github.com/infinispan/infinispan/pull/4648, https://github.com/infinispan/infinispan/pull/4627) > Reduce dependency on JBoss Marshalling > -------------------------------------- > > Key: ISPN-6906 > URL: https://issues.jboss.org/browse/ISPN-6906 > Project: Infinispan > Issue Type: Sub-task > Reporter: Galder Zamarreño > Assignee: Galder Zamarreño > Fix For: 9.0.0.Final > > > Since its inception Infinispan has been using JBoss Marshalling to deal with all the marshalling needs. With some tweaking (e.g. hooking a custom ObjectTable instance), the JBoss Marshalling based Infinispan externalizer layer is able to produce tiny binary payloads but it has some problems partly due to JBoss Marshalling itself and partly due to our own implementation details: > JBoss Marshalling's objective has always been to try to produce a binary format that passes Java specification, but this is not a requirement for Infinispan. In fact, to reduce the payload size, Infinispan hooks at the ObjectTable level to produce minimal payload sizes. > On top of the mismatch problems mentioned above, JBoss Marshalling’s programming model is based around creating a marshaller, writing to it, and then finishing using it by discarding its context (same applies to unmarshalling). The problem here is two-fold: > * Both marshaller and unmarshaller are quite heavy objects, keeping context information such as references to instances appearing multiple times...etc, so constantly creating them is costly. So, to avoid wasting resources, we ended up adding thread locals that keep a number of marshaller/unmarshaller instances per thread (see ISPN-1815). These thread locals can potentially affect memory space (see user dev post). > * The second problem is the need to support reentrant marshalling calls when storing data in binary format. The need for reentrancy appears in situations like this: Imagine you have to marshall a PutKV command, so you start a marshaller and write some stuff. Then, you have store the key and value, but these are binary so they have to be transformed into binary format, so again a marshaller needs to be created and key/value information written, finish with the marshaller and then write the bytes in the command itself. So, there needs to be a way to start two marshallers without having finished the first one. This is the reason why the changes added in ISPN-1815 resulted in the thread local keeping a number of marshaller/unmarshaller instances rather than a single one. > Finally, for inter-node cluster communication and storing data in persistence layer, Infinispan is using JBoss Marshalling for both marshalling the types it knows about, e.g. internal data types, and types it does not know about, e.g. key and value types. This means that even if the marshaller is configurable, it’s not easy to switch to a different marshaller (see here for an example where we try to use a different marshaller). This problem is not present in Hot Rod Java clients since there JBoss Marshalling is purely used to marshall keys and values, so it’s very easy to test out a different marshaller. > With all this in mind, the following change recommendations can be made: > * For those types that we know about, marshall those manually in the most compact way possible. JBoss Marshalling codebase does a lot of these for encoding basic types (e.g. Strings, numbers)...etc, so we should be able to reuse them. > * Only rely on 3rd party marshalling libraries for types we don’t know about, e.g. key and value types (If these key/value types happen to be primitives, or primitive derivations (e.g. arrays), we should be able to optimise those too. So, you only rely on 3rd party marshalling libraries for custom unknown types.). The benefit here is the we decouple Infinispan from using JBoss Marshalling all over the place, making it easier to try different marshalling mechanisms. > * With JBoss Marshalling only used for unknown custom types, if the JBoss Marshalling marshaller implementation wants to use thread locals, that's fine, but then we effectively get rid of them except for custom types when JBoss Marshalling marshaller is used, plus we can switch/try different 3rd party marshallers which might be better suited. -- This message was sent by Atlassian JIRA (v7.2.3#72005)

8 years, 1 month

1
0
0 / 0

[JBoss JIRA] (ISPN-6817) Remove MultiPojoVersionMarshallTest

by Galder Zamarreño (JIRA)

[ https://issues.jboss.org/browse/ISPN-6817?page=com.atlassian.jira.plugin.... ] Galder Zamarreño updated ISPN-6817: ----------------------------------- Description: -We need to disable MultiPojoVersionMarshallTest because Javassist (as of 3.20.0-GA) doesn't work with JDK 9.- There's no active work being done to support the use case shown by MultiPojoVersionMarshallTest. We should remove the test and instead write up a documentation section that shows how users could use externalizers to add multi version support. So, this task contains a code part, and a documentation part. It should be resolve once both have been included. was:We need to disable MultiPojoVersionMarshallTest because Javassist (as of 3.20.0-GA) doesn't work with JDK 9. > Remove MultiPojoVersionMarshallTest > ----------------------------------- > > Key: ISPN-6817 > URL: https://issues.jboss.org/browse/ISPN-6817 > Project: Infinispan > Issue Type: Task > Components: Test Suite - Core > Reporter: Tristan Tarrant > Assignee: Galder Zamarreño > > -We need to disable MultiPojoVersionMarshallTest because Javassist (as of 3.20.0-GA) doesn't work with JDK 9.- > There's no active work being done to support the use case shown by MultiPojoVersionMarshallTest. We should remove the test and instead write up a documentation section that shows how users could use externalizers to add multi version support. > So, this task contains a code part, and a documentation part. It should be resolve once both have been included. -- This message was sent by Atlassian JIRA (v7.2.3#72005)

8 years, 1 month

1
0
0 / 0

[JBoss JIRA] (ISPN-6817) Remove MultiPojoVersionMarshallTest

by Galder Zamarreño (JIRA)

[ https://issues.jboss.org/browse/ISPN-6817?page=com.atlassian.jira.plugin.... ] Galder Zamarreño updated ISPN-6817: ----------------------------------- Summary: Remove MultiPojoVersionMarshallTest (was: Re-enable MultiPojoVersionMarshallTest once Javassist works with JDK 1.9) > Remove MultiPojoVersionMarshallTest > ----------------------------------- > > Key: ISPN-6817 > URL: https://issues.jboss.org/browse/ISPN-6817 > Project: Infinispan > Issue Type: Task > Components: Test Suite - Core > Reporter: Tristan Tarrant > Assignee: Galder Zamarreño > > We need to disable MultiPojoVersionMarshallTest because Javassist (as of 3.20.0-GA) doesn't work with JDK 9. -- This message was sent by Atlassian JIRA (v7.2.3#72005)

8 years, 1 month

1
0
0 / 0

[JBoss JIRA] (ISPN-7218) FIFO command does not wait for topology

by Pedro Ruivo (JIRA)

[ https://issues.jboss.org/browse/ISPN-7218?page=com.atlassian.jira.plugin.... ] Pedro Ruivo updated ISPN-7218: ------------------------------ Status: Open (was: New) > FIFO command does not wait for topology > --------------------------------------- > > Key: ISPN-7218 > URL: https://issues.jboss.org/browse/ISPN-7218 > Project: Infinispan > Issue Type: Bug > Components: Core > Reporter: Pedro Ruivo > Assignee: Pedro Ruivo > > FIFO order commands are handled in the deliver thread. > However, they don't wait in the {{future}} before checking if the node is a valid member (check code below) > {code:java} > switch (topologyMode) { > case WAIT_TOPOLOGY: > future = handler.getStateTransferLock().topologyFuture(waitTopology()); > break; > case WAIT_TX_DATA: > future = handler.getStateTransferLock().transactionDataFuture(waitTopology()); > break; > default: > break; > } > if (handler.isCommandSentBeforeFirstTopology(commandTopologyId)) { > return future == null ? CompletableFuture.completedFuture(CacheNotFoundResponse.INSTANCE) : > future.thenApply(nil -> CacheNotFoundResponse.INSTANCE); > } > {code} -- This message was sent by Atlassian JIRA (v7.2.3#72005)

8 years, 1 month

1
0
0 / 0

[JBoss JIRA] (ISPN-7218) FIFO command does not wait for topology

by Pedro Ruivo (JIRA)

[ https://issues.jboss.org/browse/ISPN-7218?page=com.atlassian.jira.plugin.... ] Pedro Ruivo updated ISPN-7218: ------------------------------ Status: Pull Request Sent (was: Open) Git Pull Request: https://github.com/infinispan/infinispan/pull/4675 > FIFO command does not wait for topology > --------------------------------------- > > Key: ISPN-7218 > URL: https://issues.jboss.org/browse/ISPN-7218 > Project: Infinispan > Issue Type: Bug > Components: Core > Reporter: Pedro Ruivo > Assignee: Pedro Ruivo > > FIFO order commands are handled in the deliver thread. > However, they don't wait in the {{future}} before checking if the node is a valid member (check code below) > {code:java} > switch (topologyMode) { > case WAIT_TOPOLOGY: > future = handler.getStateTransferLock().topologyFuture(waitTopology()); > break; > case WAIT_TX_DATA: > future = handler.getStateTransferLock().transactionDataFuture(waitTopology()); > break; > default: > break; > } > if (handler.isCommandSentBeforeFirstTopology(commandTopologyId)) { > return future == null ? CompletableFuture.completedFuture(CacheNotFoundResponse.INSTANCE) : > future.thenApply(nil -> CacheNotFoundResponse.INSTANCE); > } > {code} -- This message was sent by Atlassian JIRA (v7.2.3#72005)

8 years, 1 month

1
0
0 / 0

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

infinispan-issues November 2016