[JBoss JIRA] (ISPN-2625) Verify Cross-site transfer performace
by Radim Vansa (JIRA)
Radim Vansa created ISPN-2625:
---------------------------------
Summary: Verify Cross-site transfer performace
Key: ISPN-2625
URL: https://issues.jboss.org/browse/ISPN-2625
Project: Infinispan
Issue Type: Task
Components: Cross-Site Replication
Affects Versions: 5.2.0.Beta5
Reporter: Radim Vansa
Assignee: Mircea Markus
Attachments: jgroups-lon-nyc-sfo-belaban.xml, jgroups-site.xml, lon-tx-optimistic-xs-to-nyc-async.xml, nyc-tx-optimistic-xs-from-lon.xml
The performance of asynchronous cross-site transfer is questionable. In QA lab we got 2x-4x slower reads (GET) than in no-XS scenario and write (PUT) performance equivalent to those of synchronous XS. While the code cannot be reliably profiled with instrumentation, trace logs also radically slow down the test we have not identified any particular bug that should cause this issue.
Therefore, I'd like to ask someone from the core developers to try to reproduce such test results and provide his test description together with achieved results.
We have used three-node cluster in distributed mode with optimistic transactions, replicating to another three-node cluster with the same configuration. Physically the nodes were in the same cluster without any delay element. The logical clusters used different multicast addresses in their JGroups configuration.
Each node started 10 threads which issued PUT/GET requests in a loop with 1:4 ratio. Each request was wrapped in single transaction. The test was benchmarking the average duration of each operation during 10 minute period preceded by 3 minute warmup with identical configuration but not accounted into performance results.
JGroups configurations as well as Infinispan configuration will be enclosed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
12 years, 1 month
[JBoss JIRA] (ISPN-2625) Verify Cross-site transfer performace
by Radim Vansa (JIRA)
[ https://issues.jboss.org/browse/ISPN-2625?page=com.atlassian.jira.plugin.... ]
Radim Vansa updated ISPN-2625:
------------------------------
Attachment: jgroups-lon-nyc-sfo-belaban.xml
jgroups-site.xml
lon-tx-optimistic-xs-to-nyc-async.xml
nyc-tx-optimistic-xs-from-lon.xml
> Verify Cross-site transfer performace
> -------------------------------------
>
> Key: ISPN-2625
> URL: https://issues.jboss.org/browse/ISPN-2625
> Project: Infinispan
> Issue Type: Task
> Components: Cross-Site Replication
> Affects Versions: 5.2.0.Beta5
> Reporter: Radim Vansa
> Assignee: Mircea Markus
> Attachments: jgroups-lon-nyc-sfo-belaban.xml, jgroups-site.xml, lon-tx-optimistic-xs-to-nyc-async.xml, nyc-tx-optimistic-xs-from-lon.xml
>
>
> The performance of asynchronous cross-site transfer is questionable. In QA lab we got 2x-4x slower reads (GET) than in no-XS scenario and write (PUT) performance equivalent to those of synchronous XS. While the code cannot be reliably profiled with instrumentation, trace logs also radically slow down the test we have not identified any particular bug that should cause this issue.
> Therefore, I'd like to ask someone from the core developers to try to reproduce such test results and provide his test description together with achieved results.
> We have used three-node cluster in distributed mode with optimistic transactions, replicating to another three-node cluster with the same configuration. Physically the nodes were in the same cluster without any delay element. The logical clusters used different multicast addresses in their JGroups configuration.
> Each node started 10 threads which issued PUT/GET requests in a loop with 1:4 ratio. Each request was wrapped in single transaction. The test was benchmarking the average duration of each operation during 10 minute period preceded by 3 minute warmup with identical configuration but not accounted into performance results.
> JGroups configurations as well as Infinispan configuration will be enclosed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
12 years, 1 month
[JBoss JIRA] (ISPN-2564) Send distributed tasks to cache members rather than the entire cluster
by Dan Berindei (JIRA)
[ https://issues.jboss.org/browse/ISPN-2564?page=com.atlassian.jira.plugin.... ]
Dan Berindei updated ISPN-2564:
-------------------------------
Status: Resolved (was: Pull Request Sent)
Fix Version/s: 5.2.0.Beta6
(was: 5.2.0.Final)
(was: 5.2.0.CR1)
Resolution: Done
Integrated.
Vladimir, could you link here the issue for the other places where we should use RpcManager.getMembers() instead of Transport.getMembers()?
> Send distributed tasks to cache members rather than the entire cluster
> ----------------------------------------------------------------------
>
> Key: ISPN-2564
> URL: https://issues.jboss.org/browse/ISPN-2564
> Project: Infinispan
> Issue Type: Bug
> Components: Core API
> Affects Versions: 5.2.0.Beta4
> Reporter: Vladimir Blagojevic
> Assignee: Vladimir Blagojevic
> Fix For: 5.2.0.Beta6
>
>
> Currently our codebase relies on the cache views to be equal to entire cluster, however, this might not be the case due to asymmetric cluster; certain cache instances running only on particular Infinispan nodes. We have to make sure that cache views, if needed are scoped properly to particular cache rather than entire cluster
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
12 years, 1 month
[JBoss JIRA] (ISPN-2550) NoSuchElementException in Hot Rod Encoder
by RH Bugzilla Integration (JIRA)
[ https://issues.jboss.org/browse/ISPN-2550?page=com.atlassian.jira.plugin.... ]
RH Bugzilla Integration updated ISPN-2550:
------------------------------------------
Bugzilla References: https://bugzilla.redhat.com/show_bug.cgi?id=886565 (was: https://bugzilla.redhat.com/show_bug.cgi?id=875151, https://bugzilla.redhat.com/show_bug.cgi?id=886565)
> NoSuchElementException in Hot Rod Encoder
> -----------------------------------------
>
> Key: ISPN-2550
> URL: https://issues.jboss.org/browse/ISPN-2550
> Project: Infinispan
> Issue Type: Bug
> Components: Remote protocols
> Affects Versions: 5.2.0.Beta4
> Reporter: Michal Linhard
> Assignee: Galder Zamarreño
> Priority: Blocker
> Fix For: 5.2.0.Beta6
>
>
> Tomas noticed this a while ago in a specific functional test:
> https://bugzilla.redhat.com/show_bug.cgi?id=875151
> I'm creating a more general JIRA, cause I'm having this in resilience test.
> What I found by quick debug, is that here:
> https://github.com/infinispan/infinispan/blob/master/server/hotrod/src/ma...
> {code}
> for (segmentIdx <- 0 until numSegments) {
> val denormalizedSegmentHashIds = allDenormalizedHashIds(segmentIdx)
> val segmentOwners = ch.locateOwnersForSegment(segmentIdx)
> for (ownerIdx <- 0 until segmentOwners.length) {
> val address = segmentOwners(ownerIdx % segmentOwners.size)
> val serverAddress = members(address)
> val hashId = denormalizedSegmentHashIds(ownerIdx)
> log.tracef("Writing hash id %d for %s:%s", hashId, serverAddress.host, serverAddress.port)
> writeString(serverAddress.host, buf)
> writeUnsignedShort(serverAddress.port, buf)
> buf.writeInt(hashId)
> }
> }
> {code}
> we're trying to obtain serverAddress for nonexistent address and NoSuchElementException is not handled properly.
> It hapens after I kill a node in a resilience test and the exception appears when querying for the node in the members cache.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
12 years, 1 month
[JBoss JIRA] (ISPN-2550) NoSuchElementException in Hot Rod Encoder
by RH Bugzilla Integration (JIRA)
[ https://issues.jboss.org/browse/ISPN-2550?page=com.atlassian.jira.plugin.... ]
RH Bugzilla Integration updated ISPN-2550:
------------------------------------------
Bugzilla References: https://bugzilla.redhat.com/show_bug.cgi?id=875151, https://bugzilla.redhat.com/show_bug.cgi?id=886565 (was: https://bugzilla.redhat.com/show_bug.cgi?id=875151)
> NoSuchElementException in Hot Rod Encoder
> -----------------------------------------
>
> Key: ISPN-2550
> URL: https://issues.jboss.org/browse/ISPN-2550
> Project: Infinispan
> Issue Type: Bug
> Components: Remote protocols
> Affects Versions: 5.2.0.Beta4
> Reporter: Michal Linhard
> Assignee: Galder Zamarreño
> Priority: Blocker
> Fix For: 5.2.0.Beta6
>
>
> Tomas noticed this a while ago in a specific functional test:
> https://bugzilla.redhat.com/show_bug.cgi?id=875151
> I'm creating a more general JIRA, cause I'm having this in resilience test.
> What I found by quick debug, is that here:
> https://github.com/infinispan/infinispan/blob/master/server/hotrod/src/ma...
> {code}
> for (segmentIdx <- 0 until numSegments) {
> val denormalizedSegmentHashIds = allDenormalizedHashIds(segmentIdx)
> val segmentOwners = ch.locateOwnersForSegment(segmentIdx)
> for (ownerIdx <- 0 until segmentOwners.length) {
> val address = segmentOwners(ownerIdx % segmentOwners.size)
> val serverAddress = members(address)
> val hashId = denormalizedSegmentHashIds(ownerIdx)
> log.tracef("Writing hash id %d for %s:%s", hashId, serverAddress.host, serverAddress.port)
> writeString(serverAddress.host, buf)
> writeUnsignedShort(serverAddress.port, buf)
> buf.writeInt(hashId)
> }
> }
> {code}
> we're trying to obtain serverAddress for nonexistent address and NoSuchElementException is not handled properly.
> It hapens after I kill a node in a resilience test and the exception appears when querying for the node in the members cache.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
12 years, 1 month