[JBoss JIRA] (ISPN-6675) Better configuration management for Kubernetes
by Sebastian Łaskawiec (JIRA)
[ https://issues.jboss.org/browse/ISPN-6675?page=com.atlassian.jira.plugin.... ]
Sebastian Łaskawiec edited comment on ISPN-6675 at 8/11/16 4:27 AM:
--------------------------------------------------------------------
POC with Configmaps:
# Spin a new OpenShift cluster with Infinispan app. Use [this blog post|http://blog.infinispan.org/2016/08/running-infinispan-cluster-on-ope...] for reference.
# Download the latest infinispan and store it somewhere on the disk
# Modify {{$ISPN_HOME/standalone/configuration/cloud.xml}}
# Create a ConfigMap based on {{$ISPN_HOME/standalone/configuration}} directory (unfortunately you can't mount ConfigMap as a single file - you need to mount it as a volume (directory)).
{code}
$ oc create configmap cloud-xml-3 --from-file=infinispan-server-9.0.0-SNAPSHOT/standalone/configuration
configmap "cloud-xml-3" created
{code}
# Mount the directory in the pods
{code}
$ oc edit dc/infinispan-server
.. Modify parts shown below ..
apiVersion: v1
kind: DeploymentConfig
metadata:
name: infinispan-server
namespace: myproject
selfLink: /oapi/v1/namespaces/myproject/deploymentconfigs/infinispan-server
uid: 09353e5f-5f98-11e6-b7f5-54ee751d46e3
resourceVersion: '10864'
generation: 6
creationTimestamp: '2016-08-11T07:48:47Z'
labels:
app: infinispan-server
annotations:
openshift.io/generated-by: OpenShiftNewApp
spec:
strategy:
type: Rolling
rollingParams:
updatePeriodSeconds: 1
intervalSeconds: 1
timeoutSeconds: 600
maxUnavailable: 25%
maxSurge: 25%
resources:
triggers:
-
type: ConfigChange
-
type: ImageChange
imageChangeParams:
automatic: true
containerNames:
- infinispan-server
from:
kind: ImageStreamTag
namespace: myproject
name: 'infinispan-server:latest'
lastTriggeredImage: 'jboss/infinispan-server@sha256:52b4fcb1530159176ceb81ea8d9638fa69b8403c8ca5ac8aea1cdbcb645beb9a'
replicas: 1
test: false
selector:
app: infinispan-server
deploymentconfig: infinispan-server
template:
metadata:
creationTimestamp: null
labels:
app: infinispan-server
deploymentconfig: infinispan-server
annotations:
openshift.io/container.infinispan-server.image.entrypoint: '["docker-entrypoint.sh"]'
openshift.io/generated-by: OpenShiftNewApp
spec:
(3) volumes:
-
name: config-volume
configMap:
name: cloud-xml-3
containers:
-
name: infinispan-server
image: 'jboss/infinispan-server@sha256:52b4fcb1530159176ceb81ea8d9638fa69b8403c8ca5ac8aea1cdbcb645beb9a'
ports:
-
containerPort: 8888
protocol: TCP
-
containerPort: 9990
protocol: TCP
-
containerPort: 11211
protocol: TCP
-
containerPort: 11222
protocol: TCP
-
containerPort: 57600
protocol: TCP
-
containerPort: 7600
protocol: TCP
-
containerPort: 8080
protocol: TCP
-
containerPort: 8181
protocol: TCP
resources:
(2) volumeMounts:
-
name: config-volume
mountPath: /opt/jboss/infinispan-server/standalone/configuration
terminationMessagePath: /dev/termination-log
imagePullPolicy: Always
restartPolicy: Always
terminationGracePeriodSeconds: 30
dnsPolicy: ClusterFirst
securityContext:
status:
latestVersion: 5
observedGeneration: 6
replicas: 1
updatedReplicas: 1
unavailableReplicas: 1
details:
message: 'caused by a config change'
causes:
-
type: ConfigChange
(1) - creates a volume based on a ConfigMap
(2) - mounts it in {{$ISPN_HOME/standalone/configuration}}
{code}
# Trigger the rolling upgrade (WARNING: This heavily relies on Kubernetes Rolling Updates so all Health/Readiness probes needs to be in place, otherwise data loss might occur)
was (Author: sebastian.laskawiec):
POC with Configmaps:
# Spin a new OpenShift cluster with Infinispan app. Use [this blog post|http://blog.infinispan.org/2016/08/running-infinispan-cluster-on-ope...] for reference.
# Download the latest infinispan and store it somewhere on the disk
# Modify {{$ISPN_HOME/standalone/configuration/cloud.xml}}
# Create a ConfigMap based on {{$ISPN_HOME/standalone/configuration}} directory (unfortunately you can't mount ConfigMap as a single file - you need to mount it as a volume (directory)).
{code}
$ oc create configmap cloud-xml-3 --from-file=infinispan-server-9.0.0-SNAPSHOT/standalone/configuration
configmap "cloud-xml-3" created
{code}
# Mount the directory in the pods
{code}
$ oc edit dc/infinispan-server
.. Modify parts shown below ..
apiVersion: v1
kind: DeploymentConfig
metadata:
name: infinispan-server
namespace: myproject
selfLink: /oapi/v1/namespaces/myproject/deploymentconfigs/infinispan-server
uid: 09353e5f-5f98-11e6-b7f5-54ee751d46e3
resourceVersion: '10864'
generation: 6
creationTimestamp: '2016-08-11T07:48:47Z'
labels:
app: infinispan-server
annotations:
openshift.io/generated-by: OpenShiftNewApp
spec:
strategy:
type: Rolling
rollingParams:
updatePeriodSeconds: 1
intervalSeconds: 1
timeoutSeconds: 600
maxUnavailable: 25%
maxSurge: 25%
resources:
triggers:
-
type: ConfigChange
-
type: ImageChange
imageChangeParams:
automatic: true
containerNames:
- infinispan-server
from:
kind: ImageStreamTag
namespace: myproject
name: 'infinispan-server:latest'
lastTriggeredImage: 'jboss/infinispan-server@sha256:52b4fcb1530159176ceb81ea8d9638fa69b8403c8ca5ac8aea1cdbcb645beb9a'
replicas: 1
test: false
selector:
app: infinispan-server
deploymentconfig: infinispan-server
template:
metadata:
creationTimestamp: null
labels:
app: infinispan-server
deploymentconfig: infinispan-server
annotations:
openshift.io/container.infinispan-server.image.entrypoint: '["docker-entrypoint.sh"]'
openshift.io/generated-by: OpenShiftNewApp
spec:
(3) volumes:
-
name: config-volume
configMap:
name: cloud-xml-2
containers:
-
name: infinispan-server
image: 'jboss/infinispan-server@sha256:52b4fcb1530159176ceb81ea8d9638fa69b8403c8ca5ac8aea1cdbcb645beb9a'
ports:
-
containerPort: 8888
protocol: TCP
-
containerPort: 9990
protocol: TCP
-
containerPort: 11211
protocol: TCP
-
containerPort: 11222
protocol: TCP
-
containerPort: 57600
protocol: TCP
-
containerPort: 7600
protocol: TCP
-
containerPort: 8080
protocol: TCP
-
containerPort: 8181
protocol: TCP
resources:
(2) volumeMounts:
-
name: config-volume
mountPath: /opt/jboss/infinispan-server/standalone/configuration
terminationMessagePath: /dev/termination-log
imagePullPolicy: Always
restartPolicy: Always
terminationGracePeriodSeconds: 30
dnsPolicy: ClusterFirst
securityContext:
status:
latestVersion: 5
observedGeneration: 6
replicas: 1
updatedReplicas: 1
unavailableReplicas: 1
details:
message: 'caused by a config change'
causes:
-
type: ConfigChange
(1) - creates a volume based on a ConfigMap
(2) - mounts it in {{$ISPN_HOME/standalone/configuration}}
{code}
# Trigger the rolling upgrade (WARNING: This heavily relies on Kubernetes Rolling Updates so all Health/Readiness probes needs to be in place, otherwise data loss might occur)
> Better configuration management for Kubernetes
> ----------------------------------------------
>
> Key: ISPN-6675
> URL: https://issues.jboss.org/browse/ISPN-6675
> Project: Infinispan
> Issue Type: Feature Request
> Components: Cloud Integrations
> Reporter: Sebastian Łaskawiec
> Assignee: Sebastian Łaskawiec
>
> Currently we either store the configuration in the Docker Image or use system properties to turn the things on/off. Both approaches do not scale.
> There are some other alternatives like [Kubernetes ConfigMap|http://kubernetes.io/docs/user-guide/configmap] which are worth exploring
--
This message was sent by Atlassian JIRA
(v6.4.11#64026)
9 years, 8 months
[JBoss JIRA] (ISPN-6675) Better configuration management for Kubernetes
by Sebastian Łaskawiec (JIRA)
[ https://issues.jboss.org/browse/ISPN-6675?page=com.atlassian.jira.plugin.... ]
Sebastian Łaskawiec commented on ISPN-6675:
-------------------------------------------
POC with Configmaps:
# Spin a new OpenShift cluster with Infinispan app. Use [this blog post|http://blog.infinispan.org/2016/08/running-infinispan-cluster-on-ope...] for reference.
# Download the latest infinispan and store it somewhere on the disk
# Modify {{$ISPN_HOME/standalone/configuration/cloud.xml}}
# Create a ConfigMap based on {{$ISPN_HOME/standalone/configuration}} directory (unfortunately you can't mount ConfigMap as a single file - you need to mount it as a volume (directory)).
{code}
$ oc create configmap cloud-xml-3 --from-file=infinispan-server-9.0.0-SNAPSHOT/standalone/configuration
configmap "cloud-xml-3" created
{code}
# Mount the directory in the pods
{code}
$ oc edit dc/infinispan-server
.. Modify parts shown below ..
apiVersion: v1
kind: DeploymentConfig
metadata:
name: infinispan-server
namespace: myproject
selfLink: /oapi/v1/namespaces/myproject/deploymentconfigs/infinispan-server
uid: 09353e5f-5f98-11e6-b7f5-54ee751d46e3
resourceVersion: '10864'
generation: 6
creationTimestamp: '2016-08-11T07:48:47Z'
labels:
app: infinispan-server
annotations:
openshift.io/generated-by: OpenShiftNewApp
spec:
strategy:
type: Rolling
rollingParams:
updatePeriodSeconds: 1
intervalSeconds: 1
timeoutSeconds: 600
maxUnavailable: 25%
maxSurge: 25%
resources:
triggers:
-
type: ConfigChange
-
type: ImageChange
imageChangeParams:
automatic: true
containerNames:
- infinispan-server
from:
kind: ImageStreamTag
namespace: myproject
name: 'infinispan-server:latest'
lastTriggeredImage: 'jboss/infinispan-server@sha256:52b4fcb1530159176ceb81ea8d9638fa69b8403c8ca5ac8aea1cdbcb645beb9a'
replicas: 1
test: false
selector:
app: infinispan-server
deploymentconfig: infinispan-server
template:
metadata:
creationTimestamp: null
labels:
app: infinispan-server
deploymentconfig: infinispan-server
annotations:
openshift.io/container.infinispan-server.image.entrypoint: '["docker-entrypoint.sh"]'
openshift.io/generated-by: OpenShiftNewApp
spec:
(3) volumes:
-
name: config-volume
configMap:
name: cloud-xml-2
containers:
-
name: infinispan-server
image: 'jboss/infinispan-server@sha256:52b4fcb1530159176ceb81ea8d9638fa69b8403c8ca5ac8aea1cdbcb645beb9a'
ports:
-
containerPort: 8888
protocol: TCP
-
containerPort: 9990
protocol: TCP
-
containerPort: 11211
protocol: TCP
-
containerPort: 11222
protocol: TCP
-
containerPort: 57600
protocol: TCP
-
containerPort: 7600
protocol: TCP
-
containerPort: 8080
protocol: TCP
-
containerPort: 8181
protocol: TCP
resources:
(2) volumeMounts:
-
name: config-volume
mountPath: /opt/jboss/infinispan-server/standalone/configuration
terminationMessagePath: /dev/termination-log
imagePullPolicy: Always
restartPolicy: Always
terminationGracePeriodSeconds: 30
dnsPolicy: ClusterFirst
securityContext:
status:
latestVersion: 5
observedGeneration: 6
replicas: 1
updatedReplicas: 1
unavailableReplicas: 1
details:
message: 'caused by a config change'
causes:
-
type: ConfigChange
(1) - creates a volume based on a ConfigMap
(2) - mounts it in {{$ISPN_HOME/standalone/configuration}}
{code}
# Trigger the rolling upgrade (WARNING: This heavily relies on Kubernetes Rolling Updates so all Health/Readiness probes needs to be in place, otherwise data loss might occur)
> Better configuration management for Kubernetes
> ----------------------------------------------
>
> Key: ISPN-6675
> URL: https://issues.jboss.org/browse/ISPN-6675
> Project: Infinispan
> Issue Type: Feature Request
> Components: Cloud Integrations
> Reporter: Sebastian Łaskawiec
> Assignee: Sebastian Łaskawiec
>
> Currently we either store the configuration in the Docker Image or use system properties to turn the things on/off. Both approaches do not scale.
> There are some other alternatives like [Kubernetes ConfigMap|http://kubernetes.io/docs/user-guide/configmap] which are worth exploring
--
This message was sent by Atlassian JIRA
(v6.4.11#64026)
9 years, 8 months
[JBoss JIRA] (ISPN-6614) [8.2.x] JCacheConfigurationPropertiesFileTest.testPropertiesConfiguration always fails
by Dan Berindei (JIRA)
[ https://issues.jboss.org/browse/ISPN-6614?page=com.atlassian.jira.plugin.... ]
Dan Berindei updated ISPN-6614:
-------------------------------
Status: Resolved (was: Pull Request Sent)
Resolution: Done
> [8.2.x] JCacheConfigurationPropertiesFileTest.testPropertiesConfiguration always fails
> ---------------------------------------------------------------------------------------
>
> Key: ISPN-6614
> URL: https://issues.jboss.org/browse/ISPN-6614
> Project: Infinispan
> Issue Type: Bug
> Components: Test Suite - Core
> Affects Versions: 8.2.1.Final
> Reporter: Dan Berindei
> Assignee: Tristan Tarrant
> Labels: testsuite_stability
> Fix For: 8.2.4.Final
>
>
> Class {{SomeCustomConsistentHashV2}} appears to be missing on the 8.2.x branch:
> {noformat}
> org.infinispan.commons.CacheConfigurationException: Unable to instantiate class org.infinispan.client.hotrod.SomeCustomConsistentHashV2
> at org.infinispan.commons.util.Util.loadClass(Util.java:103)
> at org.infinispan.client.hotrod.configuration.ConfigurationBuilder.consistentHashImpl(ConfigurationBuilder.java:171)
> at org.infinispan.client.hotrod.configuration.ConfigurationBuilder.withProperties(ConfigurationBuilder.java:291)
> at org.infinispan.jcache.remote.JCacheManager.getConfigurationBuilder(JCacheManager.java:60)
> at org.infinispan.jcache.remote.JCacheManager.<init>(JCacheManager.java:38)
> at org.infinispan.jcache.remote.JCachingProvider.createCacheManager(JCachingProvider.java:37)
> at org.infinispan.jcache.AbstractJCachingProvider.getCacheManager(AbstractJCachingProvider.java:67)
> at org.infinispan.jcache.AbstractJCachingProvider.getCacheManager(AbstractJCachingProvider.java:80)
> at org.infinispan.jcache.remote.JCacheConfigurationPropertiesFileTest.testPropertiesConfiguration(JCacheConfigurationPropertiesFileTest.java:24)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.11#64026)
9 years, 8 months
[JBoss JIRA] (ISPN-6906) Reduce dependency on JBoss Marshalling
by Galder Zamarreño (JIRA)
[ https://issues.jboss.org/browse/ISPN-6906?page=com.atlassian.jira.plugin.... ]
Galder Zamarreño commented on ISPN-6906:
----------------------------------------
Progress can be followed in [this branch|https://github.com/galderz/infinispan/tree/t_6906].
> Reduce dependency on JBoss Marshalling
> --------------------------------------
>
> Key: ISPN-6906
> URL: https://issues.jboss.org/browse/ISPN-6906
> Project: Infinispan
> Issue Type: Sub-task
> Reporter: Galder Zamarreño
> Assignee: Galder Zamarreño
> Fix For: 9.0.0.Final
>
>
> Since its inception Infinispan has been using JBoss Marshalling to deal with all the marshalling needs. With some tweaking (e.g. hooking a custom ObjectTable instance), the JBoss Marshalling based Infinispan externalizer layer is able to produce tiny binary payloads but it has some problems partly due to JBoss Marshalling itself and partly due to our own implementation details:
> JBoss Marshalling's objective has always been to try to produce a binary format that passes Java specification, but this is not a requirement for Infinispan. In fact, to reduce the payload size, Infinispan hooks at the ObjectTable level to produce minimal payload sizes.
> On top of the mismatch problems mentioned above, JBoss Marshalling’s programming model is based around creating a marshaller, writing to it, and then finishing using it by discarding its context (same applies to unmarshalling). The problem here is two-fold:
> * Both marshaller and unmarshaller are quite heavy objects, keeping context information such as references to instances appearing multiple times...etc, so constantly creating them is costly. So, to avoid wasting resources, we ended up adding thread locals that keep a number of marshaller/unmarshaller instances per thread (see ISPN-1815). These thread locals can potentially affect memory space (see user dev post).
> * The second problem is the need to support reentrant marshalling calls when storing data in binary format. The need for reentrancy appears in situations like this: Imagine you have to marshall a PutKV command, so you start a marshaller and write some stuff. Then, you have store the key and value, but these are binary so they have to be transformed into binary format, so again a marshaller needs to be created and key/value information written, finish with the marshaller and then write the bytes in the command itself. So, there needs to be a way to start two marshallers without having finished the first one. This is the reason why the changes added in ISPN-1815 resulted in the thread local keeping a number of marshaller/unmarshaller instances rather than a single one.
> Finally, for inter-node cluster communication and storing data in persistence layer, Infinispan is using JBoss Marshalling for both marshalling the types it knows about, e.g. internal data types, and types it does not know about, e.g. key and value types. This means that even if the marshaller is configurable, it’s not easy to switch to a different marshaller (see here for an example where we try to use a different marshaller). This problem is not present in Hot Rod Java clients since there JBoss Marshalling is purely used to marshall keys and values, so it’s very easy to test out a different marshaller.
> With all this in mind, the following change recommendations can be made:
> * For those types that we know about, marshall those manually in the most compact way possible. JBoss Marshalling codebase does a lot of these for encoding basic types (e.g. Strings, numbers)...etc, so we should be able to reuse them.
> * Only rely on 3rd party marshalling libraries for types we don’t know about, e.g. key and value types (If these key/value types happen to be primitives, or primitive derivations (e.g. arrays), we should be able to optimise those too. So, you only rely on 3rd party marshalling libraries for custom unknown types.). The benefit here is the we decouple Infinispan from using JBoss Marshalling all over the place, making it easier to try different marshalling mechanisms.
> * With JBoss Marshalling only used for unknown custom types, if the JBoss Marshalling marshaller implementation wants to use thread locals, that's fine, but then we effectively get rid of them except for custom types when JBoss Marshalling marshaller is used, plus we can switch/try different 3rd party marshallers which might be better suited.
--
This message was sent by Atlassian JIRA
(v6.4.11#64026)
9 years, 8 months
[JBoss JIRA] (ISPN-6906) Reduce dependency on JBoss Marshalling
by Galder Zamarreño (JIRA)
[ https://issues.jboss.org/browse/ISPN-6906?page=com.atlassian.jira.plugin.... ]
Work on ISPN-6906 started by Galder Zamarreño.
----------------------------------------------
> Reduce dependency on JBoss Marshalling
> --------------------------------------
>
> Key: ISPN-6906
> URL: https://issues.jboss.org/browse/ISPN-6906
> Project: Infinispan
> Issue Type: Sub-task
> Reporter: Galder Zamarreño
> Assignee: Galder Zamarreño
> Fix For: 9.0.0.Final
>
>
> Since its inception Infinispan has been using JBoss Marshalling to deal with all the marshalling needs. With some tweaking (e.g. hooking a custom ObjectTable instance), the JBoss Marshalling based Infinispan externalizer layer is able to produce tiny binary payloads but it has some problems partly due to JBoss Marshalling itself and partly due to our own implementation details:
> JBoss Marshalling's objective has always been to try to produce a binary format that passes Java specification, but this is not a requirement for Infinispan. In fact, to reduce the payload size, Infinispan hooks at the ObjectTable level to produce minimal payload sizes.
> On top of the mismatch problems mentioned above, JBoss Marshalling’s programming model is based around creating a marshaller, writing to it, and then finishing using it by discarding its context (same applies to unmarshalling). The problem here is two-fold:
> * Both marshaller and unmarshaller are quite heavy objects, keeping context information such as references to instances appearing multiple times...etc, so constantly creating them is costly. So, to avoid wasting resources, we ended up adding thread locals that keep a number of marshaller/unmarshaller instances per thread (see ISPN-1815). These thread locals can potentially affect memory space (see user dev post).
> * The second problem is the need to support reentrant marshalling calls when storing data in binary format. The need for reentrancy appears in situations like this: Imagine you have to marshall a PutKV command, so you start a marshaller and write some stuff. Then, you have store the key and value, but these are binary so they have to be transformed into binary format, so again a marshaller needs to be created and key/value information written, finish with the marshaller and then write the bytes in the command itself. So, there needs to be a way to start two marshallers without having finished the first one. This is the reason why the changes added in ISPN-1815 resulted in the thread local keeping a number of marshaller/unmarshaller instances rather than a single one.
> Finally, for inter-node cluster communication and storing data in persistence layer, Infinispan is using JBoss Marshalling for both marshalling the types it knows about, e.g. internal data types, and types it does not know about, e.g. key and value types. This means that even if the marshaller is configurable, it’s not easy to switch to a different marshaller (see here for an example where we try to use a different marshaller). This problem is not present in Hot Rod Java clients since there JBoss Marshalling is purely used to marshall keys and values, so it’s very easy to test out a different marshaller.
> With all this in mind, the following change recommendations can be made:
> * For those types that we know about, marshall those manually in the most compact way possible. JBoss Marshalling codebase does a lot of these for encoding basic types (e.g. Strings, numbers)...etc, so we should be able to reuse them.
> * Only rely on 3rd party marshalling libraries for types we don’t know about, e.g. key and value types (If these key/value types happen to be primitives, or primitive derivations (e.g. arrays), we should be able to optimise those too. So, you only rely on 3rd party marshalling libraries for custom unknown types.). The benefit here is the we decouple Infinispan from using JBoss Marshalling all over the place, making it easier to try different marshalling mechanisms.
> * With JBoss Marshalling only used for unknown custom types, if the JBoss Marshalling marshaller implementation wants to use thread locals, that's fine, but then we effectively get rid of them except for custom types when JBoss Marshalling marshaller is used, plus we can switch/try different 3rd party marshallers which might be better suited.
--
This message was sent by Atlassian JIRA
(v6.4.11#64026)
9 years, 8 months
[JBoss JIRA] (ISPN-6906) Reduce dependency on JBoss Marshalling
by Galder Zamarreño (JIRA)
[ https://issues.jboss.org/browse/ISPN-6906?page=com.atlassian.jira.plugin.... ]
Galder Zamarreño updated ISPN-6906:
-----------------------------------
Status: Open (was: New)
> Reduce dependency on JBoss Marshalling
> --------------------------------------
>
> Key: ISPN-6906
> URL: https://issues.jboss.org/browse/ISPN-6906
> Project: Infinispan
> Issue Type: Sub-task
> Reporter: Galder Zamarreño
> Assignee: Galder Zamarreño
> Fix For: 9.0.0.Final
>
>
> Since its inception Infinispan has been using JBoss Marshalling to deal with all the marshalling needs. With some tweaking (e.g. hooking a custom ObjectTable instance), the JBoss Marshalling based Infinispan externalizer layer is able to produce tiny binary payloads but it has some problems partly due to JBoss Marshalling itself and partly due to our own implementation details:
> JBoss Marshalling's objective has always been to try to produce a binary format that passes Java specification, but this is not a requirement for Infinispan. In fact, to reduce the payload size, Infinispan hooks at the ObjectTable level to produce minimal payload sizes.
> On top of the mismatch problems mentioned above, JBoss Marshalling’s programming model is based around creating a marshaller, writing to it, and then finishing using it by discarding its context (same applies to unmarshalling). The problem here is two-fold:
> * Both marshaller and unmarshaller are quite heavy objects, keeping context information such as references to instances appearing multiple times...etc, so constantly creating them is costly. So, to avoid wasting resources, we ended up adding thread locals that keep a number of marshaller/unmarshaller instances per thread (see ISPN-1815). These thread locals can potentially affect memory space (see user dev post).
> * The second problem is the need to support reentrant marshalling calls when storing data in binary format. The need for reentrancy appears in situations like this: Imagine you have to marshall a PutKV command, so you start a marshaller and write some stuff. Then, you have store the key and value, but these are binary so they have to be transformed into binary format, so again a marshaller needs to be created and key/value information written, finish with the marshaller and then write the bytes in the command itself. So, there needs to be a way to start two marshallers without having finished the first one. This is the reason why the changes added in ISPN-1815 resulted in the thread local keeping a number of marshaller/unmarshaller instances rather than a single one.
> Finally, for inter-node cluster communication and storing data in persistence layer, Infinispan is using JBoss Marshalling for both marshalling the types it knows about, e.g. internal data types, and types it does not know about, e.g. key and value types. This means that even if the marshaller is configurable, it’s not easy to switch to a different marshaller (see here for an example where we try to use a different marshaller). This problem is not present in Hot Rod Java clients since there JBoss Marshalling is purely used to marshall keys and values, so it’s very easy to test out a different marshaller.
> With all this in mind, the following change recommendations can be made:
> * For those types that we know about, marshall those manually in the most compact way possible. JBoss Marshalling codebase does a lot of these for encoding basic types (e.g. Strings, numbers)...etc, so we should be able to reuse them.
> * Only rely on 3rd party marshalling libraries for types we don’t know about, e.g. key and value types (If these key/value types happen to be primitives, or primitive derivations (e.g. arrays), we should be able to optimise those too. So, you only rely on 3rd party marshalling libraries for custom unknown types.). The benefit here is the we decouple Infinispan from using JBoss Marshalling all over the place, making it easier to try different marshalling mechanisms.
> * With JBoss Marshalling only used for unknown custom types, if the JBoss Marshalling marshaller implementation wants to use thread locals, that's fine, but then we effectively get rid of them except for custom types when JBoss Marshalling marshaller is used, plus we can switch/try different 3rd party marshallers which might be better suited.
--
This message was sent by Atlassian JIRA
(v6.4.11#64026)
9 years, 8 months