[JBoss JIRA] Created: (ISPN-1015) Optimize HotRod client to match Memcached performance

[JBoss JIRA] Created: (ISPN-1235)...

[JBoss JIRA] Created: (ISPN-303)...

Dan Berindei (JIRA)

Wednesday, 30 March 2011 Wed, 30 Mar '11

10:43 a.m.

Optimize HotRod client to match Memcached performance ----------------------------------------------------- Key: ISPN-1015 URL: https://issues.jboss.org/browse/ISPN-1015 Project: Infinispan Issue Type: Task Reporter: Dan Berindei Assignee: Dan Berindei Load tests show the HotRod protocol performing worse than the Memcached client. Since the HotRod protocol should be easier to parse and we also have the extra topology information, this is quite surprising. We have analyzed the servers and seem to perform about the same, so we need to optimize the client. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Show replies by date

Galder Zamarreño (JIRA)

Thursday, 31 March Thu, 31 Mar

2:06 a.m.

New subject: [JBoss JIRA] Resolved: (ISPN-1015) Optimize HotRod client to match Memcached performance

[ https://issues.jboss.org/browse/ISPN-1015?page=com.atlassian.jira.plugin.... ] Galder Zamarreño resolved ISPN-1015. ------------------------------------ Fix Version/s: 4.2.2.BETA1 5.0.0.BETA1 Resolution: Done

...

Optimize HotRod client to match Memcached performance ----------------------------------------------------- Key: ISPN-1015 URL: https://issues.jboss.org/browse/ISPN-1015 Project: Infinispan Issue Type: Task Reporter: Dan Berindei Assignee: Dan Berindei Fix For: 4.2.2.BETA1, 5.0.0.BETA1 Load tests show the HotRod protocol performing worse than the Memcached client. Since the HotRod protocol should be easier to parse and we also have the extra topology information, this is quite surprising. We have analyzed the servers and seem to perform about the same, so we need to optimize the client.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Galder Zamarreño (JIRA)

2:06 a.m.

New subject: [JBoss JIRA] Updated: (ISPN-1015) Optimize HotRod client to match Memcached performance

[ https://issues.jboss.org/browse/ISPN-1015?page=com.atlassian.jira.plugin.... ] Galder Zamarreño updated ISPN-1015: ----------------------------------- Git Pull Request: https://github.com/infinispan/infinispan/pull/222 Dan, make sure you link the pull request.

...

Optimize HotRod client to match Memcached performance ----------------------------------------------------- Key: ISPN-1015 URL: https://issues.jboss.org/browse/ISPN-1015 Project: Infinispan Issue Type: Task Reporter: Dan Berindei Assignee: Dan Berindei Fix For: 4.2.2.BETA1, 5.0.0.BETA1 Load tests show the HotRod protocol performing worse than the Memcached client. Since the HotRod protocol should be easier to parse and we also have the extra topology information, this is quite surprising. We have analyzed the servers and seem to perform about the same, so we need to optimize the client.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Dan Berindei (JIRA)

2:19 a.m.

New subject: [JBoss JIRA] Commented: (ISPN-1015) Optimize HotRod client to match Memcached performance

[ https://issues.jboss.org/browse/ISPN-1015?page=com.atlassian.jira.plugin.... ] Dan Berindei commented on ISPN-1015: ------------------------------------ I wasn't sure if we should close the task or keep it open for further work, but I guess we've reached the target in the subject... Eliminated some hotspots in the HotRod client: * There were a lot of security manager calls in GenericJBossMarshaller and in TcpTransport, as Thread.setContextClassLoader() and Socket.getOutputStream() both require privileges. * In ConsistentHashV1, a trace debug message was built even when the trace log level was disabled. There is some potential for further optimizations, like reusing the byte buffer for serialization, but this already makes the HotRod client perform better than the Memcached client.

...

Optimize HotRod client to match Memcached performance ----------------------------------------------------- Key: ISPN-1015 URL: https://issues.jboss.org/browse/ISPN-1015 Project: Infinispan Issue Type: Task Reporter: Dan Berindei Assignee: Dan Berindei Fix For: 4.2.2.BETA1, 5.0.0.BETA1 Load tests show the HotRod protocol performing worse than the Memcached client. Since the HotRod protocol should be easier to parse and we also have the extra topology information, this is quite surprising. We have analyzed the servers and seem to perform about the same, so we need to optimize the client.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Galder Zamarreño (JIRA)

2:51 a.m.

New subject: [JBoss JIRA] Commented: (ISPN-1015) Optimize HotRod client to match Memcached performance

[ https://issues.jboss.org/browse/ISPN-1015?page=com.atlassian.jira.plugin.... ] Galder Zamarreño commented on ISPN-1015: ---------------------------------------- You can keep it open if you want, no problems with me, but make sure you list the optimisations as you submit pulls for them. You could also create subtasks for each optimisation you apply. Btw, when testing this optimisations, it'd be interesting to quantify improvement if possible and make sure you test one optimisation at the time :)

...

Optimize HotRod client to match Memcached performance ----------------------------------------------------- Key: ISPN-1015 URL: https://issues.jboss.org/browse/ISPN-1015 Project: Infinispan Issue Type: Task Reporter: Dan Berindei Assignee: Dan Berindei Fix For: 4.2.2.BETA1, 5.0.0.BETA1 Load tests show the HotRod protocol performing worse than the Memcached client. Since the HotRod protocol should be easier to parse and we also have the extra topology information, this is quite surprising. We have analyzed the servers and seem to perform about the same, so we need to optimize the client.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Dan Berindei (JIRA)

Friday, 8 April Fri, 8 Apr

7:50 a.m.

New subject: [JBoss JIRA] Reopened: (ISPN-1015) Optimize HotRod client to match Memcached performance

[ https://issues.jboss.org/browse/ISPN-1015?page=com.atlassian.jira.plugin.... ] Dan Berindei reopened ISPN-1015: -------------------------------- After the latest tests the HotRod client is still slower than Memcached, reopening.

...

Optimize HotRod client to match Memcached performance ----------------------------------------------------- Key: ISPN-1015 URL: https://issues.jboss.org/browse/ISPN-1015 Project: Infinispan Issue Type: Task Reporter: Dan Berindei Assignee: Dan Berindei Fix For: 4.2.2.BETA1, 5.0.0.BETA1 Load tests show the HotRod protocol performing worse than the Memcached client. Since the HotRod protocol should be easier to parse and we also have the extra topology information, this is quite surprising. We have analyzed the servers and seem to perform about the same, so we need to optimize the client.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Manik Surtani (JIRA)

Monday, 25 April Mon, 25 Apr

noon

New subject: [JBoss JIRA] Updated: (ISPN-1015) Optimize HotRod client to match Memcached performance

[ https://issues.jboss.org/browse/ISPN-1015?page=com.atlassian.jira.plugin.... ] Manik Surtani updated ISPN-1015: -------------------------------- Fix Version/s: 4.2.2.FINAL 5.0.0.FINAL

...

Optimize HotRod client to match Memcached performance ----------------------------------------------------- Key: ISPN-1015 URL: https://issues.jboss.org/browse/ISPN-1015 Project: Infinispan Issue Type: Task Reporter: Dan Berindei Assignee: Dan Berindei Fix For: 4.2.2.BETA1, 4.2.2.FINAL, 5.0.0.BETA1, 5.0.0.FINAL Load tests show the HotRod protocol performing worse than the Memcached client. Since the HotRod protocol should be easier to parse and we also have the extra topology information, this is quite surprising. We have analyzed the servers and seem to perform about the same, so we need to optimize the client.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Dan Berindei (JIRA)

Tuesday, 26 April Tue, 26 Apr

4:28 a.m.

New subject: [JBoss JIRA] Work started: (ISPN-1015) Optimize HotRod client to match Memcached performance

[ https://issues.jboss.org/browse/ISPN-1015?page=com.atlassian.jira.plugin.... ] Work on ISPN-1015 started by Dan Berindei.

...

Optimize HotRod client to match Memcached performance ----------------------------------------------------- Key: ISPN-1015 URL: https://issues.jboss.org/browse/ISPN-1015 Project: Infinispan Issue Type: Task Reporter: Dan Berindei Assignee: Dan Berindei Fix For: 4.2.2.BETA1, 4.2.2.FINAL, 5.0.0.BETA1, 5.0.0.FINAL Load tests show the HotRod protocol performing worse than the Memcached client. Since the HotRod protocol should be easier to parse and we also have the extra topology information, this is quite surprising. We have analyzed the servers and seem to perform about the same, so we need to optimize the client.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Dan Berindei (JIRA)

4:30 a.m.

New subject: [JBoss JIRA] Commented: (ISPN-1015) Optimize HotRod client to match Memcached performance

[ https://issues.jboss.org/browse/ISPN-1015?page=com.atlassian.jira.plugin.... ] Dan Berindei commented on ISPN-1015: ------------------------------------ I added a new pull request, https://github.com/infinispan/infinispan/pull/271 Should still keep the issue open, there should be some more optimizations coming. I changed lots of things (although it seems the only ones with a significant impact were client-side buffering and server-side the number of worker threads): I found a few other places where we were building the trace/debug message even if the debug level was set to info or higher. I changed this on the "happy" flows, even though none of them looks like a performance hotspot. Improved ConsistentHashPerfTest, now it reports standard deviation, average abs deviation and median abs deviation. Changed PreInvocationContext to stop allocating new EnumSets. Made some fields in AbstractConsistentHash non-volatile. Added SKIP_CACHE_LOAD flag when the client doesn't need the return value in the hotrod server. Use BufferedOutputStream to coalesce socket writes in as few packets as possible. Also use BufferedInputStream to reduce calls into the network stack. Use a specialized ClassResolver to avoid looking at the context class loader completely if serialization doesn't require it. I changed the default number of worker threads for the Infinispan servers to 20 * number of processors. The setting for the number of master threads wasn't really doing anything so I removed it. Added VNodesCHPerfTest to test the TopologyAwareConsistentHash with virtual nodes.

...

Optimize HotRod client to match Memcached performance ----------------------------------------------------- Key: ISPN-1015 URL: https://issues.jboss.org/browse/ISPN-1015 Project: Infinispan Issue Type: Task Reporter: Dan Berindei Assignee: Dan Berindei Fix For: 4.2.2.BETA1, 4.2.2.FINAL, 5.0.0.BETA1, 5.0.0.FINAL Load tests show the HotRod protocol performing worse than the Memcached client. Since the HotRod protocol should be easier to parse and we also have the extra topology information, this is quite surprising. We have analyzed the servers and seem to perform about the same, so we need to optimize the client.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Galder Zamarreño (JIRA)

Thursday, 28 April Thu, 28 Apr

3:39 a.m.

New subject: [JBoss JIRA] Updated: (ISPN-1015) Optimize HotRod client to match Memcached performance

...

Optimize HotRod client to match Memcached performance ----------------------------------------------------- Key: ISPN-1015 URL: https://issues.jboss.org/browse/ISPN-1015 Project: Infinispan Issue Type: Task Reporter: Dan Berindei Assignee: Dan Berindei Fix For: 4.2.2.FINAL, 5.0.0.FINAL Load tests show the HotRod protocol performing worse than the Memcached client. Since the HotRod protocol should be easier to parse and we also have the extra topology information, this is quite surprising. We have analyzed the servers and seem to perform about the same, so we need to optimize the client.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Manik Surtani (JIRA)

Thursday, 30 June Thu, 30 Jun

12:45 p.m.

New subject: [JBoss JIRA] Updated: (ISPN-1015) Optimize HotRod client to match Memcached performance

[ https://issues.jboss.org/browse/ISPN-1015?page=com.atlassian.jira.plugin.... ] Manik Surtani updated ISPN-1015: -------------------------------- Fix Version/s: 5.1.0.BETA1 5.1.0.Final (was: 5.0.0.FINAL) (was: 4.2.2.FINAL) Git Pull Request: https://github.com/infinispan/infinispan/pull/222 (was: https://github.com/infinispan/infinispan/pull/222)

...

Optimize HotRod client to match Memcached performance ----------------------------------------------------- Key: ISPN-1015 URL: https://issues.jboss.org/browse/ISPN-1015 Project: Infinispan Issue Type: Task Reporter: Dan Berindei Assignee: Dan Berindei Fix For: 5.1.0.BETA1, 5.1.0.Final Load tests show the HotRod protocol performing worse than the Memcached client. Since the HotRod protocol should be easier to parse and we also have the extra topology information, this is quite surprising. We have analyzed the servers and seem to perform about the same, so we need to optimize the client.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Galder Zamarreño (Updated) (JIRA)

Tuesday, 4 October Tue, 4 Oct

7:34 a.m.

New subject: [JBoss JIRA] (ISPN-1015) Optimize HotRod client to match Memcached performance

[ https://issues.jboss.org/browse/ISPN-1015?page=com.atlassian.jira.plugin.... ] Galder Zamarreño updated ISPN-1015: ----------------------------------- Fix Version/s: 5.1.0.BETA2 (was: 5.1.0.BETA1)

...

Optimize HotRod client to match Memcached performance ----------------------------------------------------- Key: ISPN-1015 URL: https://issues.jboss.org/browse/ISPN-1015 Project: Infinispan Issue Type: Task Reporter: Dan Berindei Assignee: Dan Berindei Fix For: 5.1.0.BETA2, 5.1.0.FINAL Load tests show the HotRod protocol performing worse than the Memcached client. Since the HotRod protocol should be easier to parse and we also have the extra topology information, this is quite surprising. We have analyzed the servers and seem to perform about the same, so we need to optimize the client.

-- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jboss.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira

Galder Zamarreño (Updated) (JIRA)

Wednesday, 19 October Wed, 19 Oct

1:24 a.m.

New subject: [JBoss JIRA] (ISPN-1015) Optimize HotRod client to match Memcached performance

[ https://issues.jboss.org/browse/ISPN-1015?page=com.atlassian.jira.plugin.... ] Galder Zamarreño updated ISPN-1015: ----------------------------------- Fix Version/s: 5.1.0.BETA3 (was: 5.1.0.BETA2)

...

Optimize HotRod client to match Memcached performance ----------------------------------------------------- Key: ISPN-1015 URL: https://issues.jboss.org/browse/ISPN-1015 Project: Infinispan Issue Type: Task Reporter: Dan Berindei Assignee: Dan Berindei Fix For: 5.1.0.BETA3, 5.1.0.FINAL Load tests show the HotRod protocol performing worse than the Memcached client. Since the HotRod protocol should be easier to parse and we also have the extra topology information, this is quite surprising. We have analyzed the servers and seem to perform about the same, so we need to optimize the client.

Galder Zamarreño (Updated) (JIRA)

Thursday, 27 October Thu, 27 Oct

8:19 a.m.

New subject: [JBoss JIRA] (ISPN-1015) Optimize HotRod client to match Memcached performance

[ https://issues.jboss.org/browse/ISPN-1015?page=com.atlassian.jira.plugin.... ] Galder Zamarreño updated ISPN-1015: ----------------------------------- Fix Version/s: 5.1.0.BETA4 (was: 5.1.0.BETA3)

...

Optimize HotRod client to match Memcached performance ----------------------------------------------------- Key: ISPN-1015 URL: https://issues.jboss.org/browse/ISPN-1015 Project: Infinispan Issue Type: Task Reporter: Dan Berindei Assignee: Dan Berindei Fix For: 5.1.0.BETA4, 5.1.0.FINAL Load tests show the HotRod protocol performing worse than the Memcached client. Since the HotRod protocol should be easier to parse and we also have the extra topology information, this is quite surprising. We have analyzed the servers and seem to perform about the same, so we need to optimize the client.

Galder Zamarreño (Updated) (JIRA)

Wednesday, 9 November Wed, 9 Nov

11:48 a.m.

New subject: [JBoss JIRA] (ISPN-1015) Optimize HotRod client to match Memcached performance

[ https://issues.jboss.org/browse/ISPN-1015?page=com.atlassian.jira.plugin.... ] Galder Zamarreño updated ISPN-1015: ----------------------------------- Fix Version/s: 5.1.0.BETA5 (was: 5.1.0.BETA4)

...

Optimize HotRod client to match Memcached performance ----------------------------------------------------- Key: ISPN-1015 URL: https://issues.jboss.org/browse/ISPN-1015 Project: Infinispan Issue Type: Task Reporter: Dan Berindei Assignee: Dan Berindei Fix For: 5.1.0.BETA5, 5.1.0.FINAL Load tests show the HotRod protocol performing worse than the Memcached client. Since the HotRod protocol should be easier to parse and we also have the extra topology information, this is quite surprising. We have analyzed the servers and seem to perform about the same, so we need to optimize the client.

Galder Zamarreño (Updated) (JIRA)

Tuesday, 22 November Tue, 22 Nov

2:27 a.m.

New subject: [JBoss JIRA] (ISPN-1015) Optimize HotRod client to match Memcached performance

[ https://issues.jboss.org/browse/ISPN-1015?page=com.atlassian.jira.plugin.... ] Galder Zamarreño updated ISPN-1015: ----------------------------------- Fix Version/s: 5.1.0.CR1 (was: 5.1.0.BETA5)

...

Optimize HotRod client to match Memcached performance ----------------------------------------------------- Key: ISPN-1015 URL: https://issues.jboss.org/browse/ISPN-1015 Project: Infinispan Issue Type: Task Reporter: Dan Berindei Assignee: Dan Berindei Fix For: 5.1.0.CR1, 5.1.0.FINAL Load tests show the HotRod protocol performing worse than the Memcached client. Since the HotRod protocol should be easier to parse and we also have the extra topology information, this is quite surprising. We have analyzed the servers and seem to perform about the same, so we need to optimize the client.

Galder Zamarreño (Assigned) (JIRA)

5:21 a.m.

New subject: [JBoss JIRA] (ISPN-1015) Optimize HotRod client to match Memcached performance

[ https://issues.jboss.org/browse/ISPN-1015?page=com.atlassian.jira.plugin.... ] Galder Zamarreño reassigned ISPN-1015: -------------------------------------- Assignee: Galder Zamarreño (was: Dan Berindei)

...

Optimize HotRod client to match Memcached performance ----------------------------------------------------- Key: ISPN-1015 URL: https://issues.jboss.org/browse/ISPN-1015 Project: Infinispan Issue Type: Task Reporter: Dan Berindei Assignee: Galder Zamarreño Fix For: 5.1.0.CR1, 5.1.0.FINAL Load tests show the HotRod protocol performing worse than the Memcached client. Since the HotRod protocol should be easier to parse and we also have the extra topology information, this is quite surprising. We have analyzed the servers and seem to perform about the same, so we need to optimize the client.

Galder Zamarreño (Work stopped) (JIRA)

5:21 a.m.

New subject: [JBoss JIRA] (ISPN-1015) Optimize HotRod client to match Memcached performance

[ https://issues.jboss.org/browse/ISPN-1015?page=com.atlassian.jira.plugin.... ] Work on ISPN-1015 stopped by Galder Zamarreño.

...

Optimize HotRod client to match Memcached performance ----------------------------------------------------- Key: ISPN-1015 URL: https://issues.jboss.org/browse/ISPN-1015 Project: Infinispan Issue Type: Task Reporter: Dan Berindei Assignee: Galder Zamarreño Fix For: 5.1.0.CR1, 5.1.0.FINAL Load tests show the HotRod protocol performing worse than the Memcached client. Since the HotRod protocol should be easier to parse and we also have the extra topology information, this is quite surprising. We have analyzed the servers and seem to perform about the same, so we need to optimize the client.

Galder Zamarreño (Updated) (JIRA)

Tuesday, 6 December Tue, 6 Dec

5:57 a.m.

New subject: [JBoss JIRA] (ISPN-1015) Optimize HotRod client to match Memcached performance

[ https://issues.jboss.org/browse/ISPN-1015?page=com.atlassian.jira.plugin.... ] Galder Zamarreño updated ISPN-1015: ----------------------------------- Fix Version/s: (was: 5.1.0.CR1) Git Pull Request: https://github.com/infinispan/infinispan/pull/222 (was: https://github.com/infinispan/infinispan/pull/222)

...

Optimize HotRod client to match Memcached performance ----------------------------------------------------- Key: ISPN-1015 URL: https://issues.jboss.org/browse/ISPN-1015 Project: Infinispan Issue Type: Task Reporter: Dan Berindei Assignee: Galder Zamarreño Fix For: 5.1.0.FINAL Load tests show the HotRod protocol performing worse than the Memcached client. Since the HotRod protocol should be easier to parse and we also have the extra topology information, this is quite surprising. We have analyzed the servers and seem to perform about the same, so we need to optimize the client.

Galder Zamarreño (Updated) (JIRA)

Monday, 9 January Mon, 9 Jan

5:33 a.m.

New subject: [JBoss JIRA] (ISPN-1015) Optimize HotRod client to match Memcached performance

[ https://issues.jboss.org/browse/ISPN-1015?page=com.atlassian.jira.plugin.... ] Galder Zamarreño updated ISPN-1015: ----------------------------------- Fix Version/s: 5.2.0.FINAL (was: 5.1.0.FINAL) Git Pull Request: https://github.com/infinispan/infinispan/pull/222 (was: https://github.com/infinispan/infinispan/pull/222) I don't expect more work to be done on this in the 5.1 timeframe.

...

Optimize HotRod client to match Memcached performance ----------------------------------------------------- Key: ISPN-1015 URL: https://issues.jboss.org/browse/ISPN-1015 Project: Infinispan Issue Type: Task Reporter: Dan Berindei Assignee: Galder Zamarreño Fix For: 5.2.0.FINAL Load tests show the HotRod protocol performing worse than the Memcached client. Since the HotRod protocol should be easier to parse and we also have the extra topology information, this is quite surprising. We have analyzed the servers and seem to perform about the same, so we need to optimize the client.

Galder Zamarreño (JIRA)

Wednesday, 25 July Wed, 25 Jul

6:35 a.m.

New subject: [JBoss JIRA] (ISPN-1015) Optimize HotRod client to match Memcached performance

...

Optimize HotRod client to match Memcached performance ----------------------------------------------------- Key: ISPN-1015 URL: https://issues.jboss.org/browse/ISPN-1015 Project: Infinispan Issue Type: Task Reporter: Dan Berindei Assignee: Galder Zamarreño Fix For: 5.1.5.FINAL Load tests show the HotRod protocol performing worse than the Memcached client. Since the HotRod protocol should be easier to parse and we also have the extra topology information, this is quite surprising. We have analyzed the servers and seem to perform about the same, so we need to optimize the client.

4532

days inactive

5015

days old

infinispan-issues@lists.jboss.org

Manage subscription

20 comments

6 participants

tags (0)

participants (6)

Dan Berindei (JIRA)
Galder Zamarreño (Assigned) (JIRA)
Galder Zamarreño (JIRA)
Galder Zamarreño (Updated) (JIRA)
Galder Zamarreño (Work stopped) (JIRA)
Manik Surtani (JIRA)

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

[JBoss JIRA] Created: (ISPN-1015) Optimize HotRod client to match Memcached performance