On 24/10/12 03:33 PM, Nicolas Filotto wrote: Could you please retry with this jar? I tested it quickly with the updated jar, and it seems to be much closer to the 1.14 results in my test when dealing with 500 pages. I will let Nick comment if it fixes the issues he was seeing with import/export of sites. On Mon, Oct 22, 2012 at 2:51 PM, Nick Scavelli <nscavell(a)redhat.com&gt;wrote: > > Here are results of some quick tests I ran on Friday using PostgreSQL. > Note this is total time spent saving session after 500 pages, not time > spent indexing. > > 1.15: 112.916s, 113.433s, 110.835s > > 1.14: 69.711s, 81.118s, 81.680s > > For 400 pages (only ran this test once) > 1.15: 61.503s > 1.14: 57.856s > > And the less pages the more closely 1.15 seems to perform close to 1.14. > This is a very low sample size, and my tests might not best paint an > accurate picture, but it does seem that 1.14 consistently out performs > 1.15. So take it as you will. I'm also curious what performance is like if > I would save the session after every page, instead of one large commit of > 500 pages. > > - Nick > >

Using both v1 and v2 I get errors in postgres. Full stacktrace here http://pastebin.com/BFAMW85M On 10/25/2012 08:43 AM, Nicolas Filotto wrote: > Here is the latest version > http://dl.dropbox.com/u/20836627/exo.jcr.component.core-1.15.0-CR2-SNAPSH... > > On Wed, Oct 24, 2012 at 9:57 PM, Matt Wringe <mwringe(a)redhat.com > <mailto:mwringe@redhat.com>> wrote: > > On 24/10/12 03:33 PM, Nicolas Filotto wrote: >> Could you please retry with this jar? > > I tested it quickly with the updated jar, and it seems to be much > closer to the 1.14 results in my test when dealing with 500 > pages. I will let Nick comment if it fixes the issues he was > seeing with import/export of sites. > > >> >> On Mon, Oct 22, 2012 at 2:51 PM, Nick Scavelli >> <nscavell(a)redhat.com <mailto:nscavell@redhat.com>> wrote: >> >> >> Here are results of some quick tests I ran on Friday using >> PostgreSQL. Note this is total time spent saving session >> after 500 pages, not time spent indexing. >> >> 1.15: 112.916s, 113.433s, 110.835s >> >> 1.14: 69.711s, 81.118s, 81.680s >> >> For 400 pages (only ran this test once) >> 1.15: 61.503s >> 1.14: 57.856s >> >> And the less pages the more closely 1.15 seems to perform >> close to 1.14. This is a very low sample size, and my tests >> might not best paint an accurate picture, but it does seem >> that 1.14 consistently out performs 1.15. So take it as you >> will. I'm also curious what performance is like if I would >> save the session after every page, instead of one large >> commit of 500 pages. >> >> - Nick >> >

Same for me with mysql when I was about to try initialization of manyPages in portal with upgraded jcr core. Log is here: http://pastebin.com/yqTXEbs5 Michal ----- Original Message ----- > From: "Matt Wringe" <mwringe(a)redhat.com&gt; > To: "Nick Scavelli" <nscavell(a)redhat.com&gt; > Cc: "gatein-dev" <gatein-dev(a)lists.jboss.org&gt; > Sent: Thursday, October 25, 2012 10:12:20 PM > Subject: Re: [gatein-dev] Performance degradation between JCR 1.14 and 1.15? > > same with mysql > > On Thu 25 Oct 2012 04:05:52 PM EDT, Nick Scavelli wrote: > > Using both v1 and v2 I get errors in postgres. Full stacktrace here > > http://pastebin.com/BFAMW85M > > > > On 10/25/2012 08:43 AM, Nicolas Filotto wrote: > >> Here is the latest version > >> http://dl.dropbox.com/u/20836627/exo.jcr.component.core-1.15.0-CR2-SNAPSH... > >> > >> On Wed, Oct 24, 2012 at 9:57 PM, Matt Wringe <mwringe(a)redhat.com > >> <mailto:mwringe@redhat.com>> wrote: > >> > >> On 24/10/12 03:33 PM, Nicolas Filotto wrote: > >>> Could you please retry with this jar? > >> > >> I tested it quickly with the updated jar, and it seems to be > >> much > >> closer to the 1.14 results in my test when dealing with 500 > >> pages. I will let Nick comment if it fixes the issues he was > >> seeing with import/export of sites. > >> > >> > >>> > >>> On Mon, Oct 22, 2012 at 2:51 PM, Nick Scavelli > >>> <nscavell(a)redhat.com <mailto:nscavell@redhat.com>> wrote: > >>> > >>> > >>> Here are results of some quick tests I ran on Friday > >>> using > >>> PostgreSQL. Note this is total time spent saving session > >>> after 500 pages, not time spent indexing. > >>> > >>> 1.15: 112.916s, 113.433s, 110.835s > >>> > >>> 1.14: 69.711s, 81.118s, 81.680s > >>> > >>> For 400 pages (only ran this test once) > >>> 1.15: 61.503s > >>> 1.14: 57.856s > >>> > >>> And the less pages the more closely 1.15 seems to perform > >>> close to 1.14. This is a very low sample size, and my > >>> tests > >>> might not best paint an accurate picture, but it does > >>> seem > >>> that 1.14 consistently out performs 1.15. So take it as > >>> you > >>> will. I'm also curious what performance is like if I > >>> would > >>> save the session after every page, instead of one large > >>> commit of 500 pages. > >>> > >>> - Nick > >>> > >> > > > _______________________________________________ > gatein-dev mailing list > gatein-dev(a)lists.jboss.org > https://lists.jboss.org/mailman/listinfo/gatein-dev > _______________________________________________ gatein-dev mailing list gatein-dev(a)lists.jboss.org https://lists.jboss.org/mailman/listinfo/gatein-dev

Some quick tests suggest there seems to be some improvement however the difference between 1.14 and 1.15 is still there. And it still seems to be the time that is spent in lucene updating the index (IndexWriter#addDocument). With the new jar it seems to indicate a little less time is being spent here, but no where close to the time spent in JCR1.14. On 10/26/2012 11:31 AM, Nicolas Filotto wrote: My mistake jcr.core is not enough you need core.database too, you can get the latest versions from here http://repository.exoplatform.org/content/groups/public/org/exoplatform/j... and here http://repository.exoplatform.org/content/groups/public/org/exoplatform/c... On Fri, Oct 26, 2012 at 7:37 AM, Michal Vanco <mvanco(a)redhat.com&gt; wrote: > Same for me with mysql when I was about to try initialization of > manyPages in portal with upgraded jcr core. Log is here: > http://pastebin.com/yqTXEbs5 > > Michal > > ----- Original Message ----- > > From: "Matt Wringe" <mwringe(a)redhat.com&gt; > > To: "Nick Scavelli" <nscavell(a)redhat.com&gt; > > Cc: "gatein-dev" <gatein-dev(a)lists.jboss.org&gt; > > Sent: Thursday, October 25, 2012 10:12:20 PM > > Subject: Re: [gatein-dev] Performance degradation between JCR 1.14 and > 1.15? > > > > same with mysql > > > > On Thu 25 Oct 2012 04:05:52 PM EDT, Nick Scavelli wrote: > > > Using both v1 and v2 I get errors in postgres. Full stacktrace here > > > http://pastebin.com/BFAMW85M > > > > > > On 10/25/2012 08:43 AM, Nicolas Filotto wrote: > > >> Here is the latest version > > >> > http://dl.dropbox.com/u/20836627/exo.jcr.component.core-1.15.0-CR2-SNAPSH... > > >> > > >> On Wed, Oct 24, 2012 at 9:57 PM, Matt Wringe <mwringe(a)redhat.com > > >> <mailto:mwringe@redhat.com>> wrote: > > >> > > >> On 24/10/12 03:33 PM, Nicolas Filotto wrote: > > >>> Could you please retry with this jar? > > >> > > >> I tested it quickly with the updated jar, and it seems to be > > >> much > > >> closer to the 1.14 results in my test when dealing with 500 > > >> pages. I will let Nick comment if it fixes the issues he was > > >> seeing with import/export of sites. > > >> > > >> > > >>> > > >>> On Mon, Oct 22, 2012 at 2:51 PM, Nick Scavelli > > >>> <nscavell(a)redhat.com <mailto:nscavell@redhat.com>> wrote: > > >>> > > >>> > > >>> Here are results of some quick tests I ran on Friday > > >>> using > > >>> PostgreSQL. Note this is total time spent saving session > > >>> after 500 pages, not time spent indexing. > > >>> > > >>> 1.15: 112.916s, 113.433s, 110.835s > > >>> > > >>> 1.14: 69.711s, 81.118s, 81.680s > > >>> > > >>> For 400 pages (only ran this test once) > > >>> 1.15: 61.503s > > >>> 1.14: 57.856s > > >>> > > >>> And the less pages the more closely 1.15 seems to perform > > >>> close to 1.14. This is a very low sample size, and my > > >>> tests > > >>> might not best paint an accurate picture, but it does > > >>> seem > > >>> that 1.14 consistently out performs 1.15. So take it as > > >>> you > > >>> will. I'm also curious what performance is like if I > > >>> would > > >>> save the session after every page, instead of one large > > >>> commit of 500 pages. > > >>> > > >>> - Nick > > >>> > > >> > > > > > _______________________________________________ > > gatein-dev mailing list > > gatein-dev(a)lists.jboss.org > > https://lists.jboss.org/mailman/listinfo/gatein-dev > > > _______________________________________________ > gatein-dev mailing list > gatein-dev(a)lists.jboss.org > https://lists.jboss.org/mailman/listinfo/gatein-dev > _______________________________________________ gatein-dev mailing listgatein-dev@lists.jboss.orghttps://lists.jboss.org/mailman/listinfo/gatein-dev

Ran some more tests as I saw 1.15 having better numbers for pages less then 500. Looks like the new jar is scaling better, and even outperforming 1.14 except for 500 pages. Here are the results http://bit.ly/T2ghPK. The second tab shows the results for batching commits rather then waiting and committing 500 pages at once. 1.15 outperforms 1.14 in this scenario as well. On 10/30/2012 03:56 AM, Nicolas Filotto wrote: Do you have new results to provide? Especially on PGSQL? On Mon, Oct 29, 2012 at 9:26 PM, Nick Scavelli <nscavell(a)redhat.com&gt;wrote: > Some quick tests suggest there seems to be some improvement however the > difference between 1.14 and 1.15 is still there. And it still seems to be > the time that is spent in lucene updating the index > (IndexWriter#addDocument). With the new jar it seems to indicate a little > less time is being spent here, but no where close to the time spent in > JCR1.14. > > > On 10/26/2012 11:31 AM, Nicolas Filotto wrote: > > My mistake jcr.core is not enough you need core.database too, you can get > the latest versions from here > > http://repository.exoplatform.org/content/groups/public/org/exoplatform/j... > and here > > http://repository.exoplatform.org/content/groups/public/org/exoplatform/c... > > On Fri, Oct 26, 2012 at 7:37 AM, Michal Vanco <mvanco(a)redhat.com&gt; wrote: > >> Same for me with mysql when I was about to try initialization of >> manyPages in portal with upgraded jcr core. Log is here: >> http://pastebin.com/yqTXEbs5 >> >> Michal >> >> ----- Original Message ----- >> > From: "Matt Wringe" <mwringe(a)redhat.com&gt; >> > To: "Nick Scavelli" <nscavell(a)redhat.com&gt; >> > Cc: "gatein-dev" <gatein-dev(a)lists.jboss.org&gt; >> > Sent: Thursday, October 25, 2012 10:12:20 PM >> > Subject: Re: [gatein-dev] Performance degradation between JCR 1.14 and >> 1.15? >> > >> > same with mysql >> > >> > On Thu 25 Oct 2012 04:05:52 PM EDT, Nick Scavelli wrote: >> > > Using both v1 and v2 I get errors in postgres. Full stacktrace here >> > > http://pastebin.com/BFAMW85M >> > > >> > > On 10/25/2012 08:43 AM, Nicolas Filotto wrote: >> > >> Here is the latest version >> > >> >> http://dl.dropbox.com/u/20836627/exo.jcr.component.core-1.15.0-CR2-SNAPSH... >> > >> >> > >> On Wed, Oct 24, 2012 at 9:57 PM, Matt Wringe <mwringe(a)redhat.com >> > >> <mailto:mwringe@redhat.com>> wrote: >> > >> >> > >> On 24/10/12 03:33 PM, Nicolas Filotto wrote: >> > >>> Could you please retry with this jar? >> > >> >> > >> I tested it quickly with the updated jar, and it seems to be >> > >> much >> > >> closer to the 1.14 results in my test when dealing with 500 >> > >> pages. I will let Nick comment if it fixes the issues he was >> > >> seeing with import/export of sites. >> > >> >> > >> >> > >>> >> > >>> On Mon, Oct 22, 2012 at 2:51 PM, Nick Scavelli >> > >>> <nscavell(a)redhat.com <mailto:nscavell@redhat.com>> wrote: >> > >>> >> > >>> >> > >>> Here are results of some quick tests I ran on Friday >> > >>> using >> > >>> PostgreSQL. Note this is total time spent saving session >> > >>> after 500 pages, not time spent indexing. >> > >>> >> > >>> 1.15: 112.916s, 113.433s, 110.835s >> > >>> >> > >>> 1.14: 69.711s, 81.118s, 81.680s >> > >>> >> > >>> For 400 pages (only ran this test once) >> > >>> 1.15: 61.503s >> > >>> 1.14: 57.856s >> > >>> >> > >>> And the less pages the more closely 1.15 seems to perform >> > >>> close to 1.14. This is a very low sample size, and my >> > >>> tests >> > >>> might not best paint an accurate picture, but it does >> > >>> seem >> > >>> that 1.14 consistently out performs 1.15. So take it as >> > >>> you >> > >>> will. I'm also curious what performance is like if I >> > >>> would >> > >>> save the session after every page, instead of one large >> > >>> commit of 500 pages. >> > >>> >> > >>> - Nick >> > >>> >> > >> >> > > >> > _______________________________________________ >> > gatein-dev mailing list >> > gatein-dev(a)lists.jboss.org >> > https://lists.jboss.org/mailman/listinfo/gatein-dev >> > >> _______________________________________________ >> gatein-dev mailing list >> gatein-dev(a)lists.jboss.org >> https://lists.jboss.org/mailman/listinfo/gatein-dev >> > > > > _______________________________________________ > gatein-dev mailing listgatein-dev@lists.jboss.orghttps://lists.jboss.org/mailman/listinfo/gatein-dev > > > _______________________________________________ gatein-dev mailing list gatein-dev(a)lists.jboss.org https://lists.jboss.org/mailman/listinfo/gatein-dev

Hi, I have some feedback on this topic as well. I have tried 2 scenarios: 1) initialization of portal with many pages (server startup time) 2) jcr portlet (for writing some randon data in jcr) - portlet is accessed with concurrent users during perf test ad 1) 3 portals with many pages at different structure are initialized (each portal has +- 780 nodes/pages - [size,height]: [5,4] , [27,2] , [780,1]) - EPP 5.2.2 started at 50m:51s:425ms - JPP 6.0.0 ER02 started at 5154494ms = 85,9m - JPP 6.0.0 ER02 with upgraded jcr core started at 5054052ms = 84,2m Accessing these portals is much better at JPP 6 as I have already mentioned at previous email. ad 2) This is a refreshed scenario we have tested, textlogs from perf runs are attached - best results were with epp 5.2.2 For jpp 6, results were slightly better with upgraded jcr core I'm also attaching jcr portlets which can be reviewed - write portlet is used, it adds some random data at jcr when portlet is accessed Please keep in mind that it's a comparison of 2 major versions which are quite different, but I would expect these scenarios do not differ too much. Best regards, Michal ----- Original Message ----- > From: "Nick Scavelli" <nscavell(a)redhat.com&gt; > To: "Nicolas Filotto" <nicolas.filotto(a)exoplatform.com&gt; > Cc: "Michal Vanco" <mvanco(a)redhat.com&gt;, "gatein-dev" < gatein-dev(a)lists.jboss.org&gt; > Sent: Tuesday, October 30, 2012 11:10:03 PM > Subject: Re: [gatein-dev] Performance degradation between JCR 1.14 and 1.15? > > Ran some more tests as I saw 1.15 having better numbers for pages > less then 500. > > Looks like the new jar is scaling better, and even outperforming 1.14 > except for 500 pages. Here are the results http://bit.ly/T2ghPK . > The second tab shows the results for batching commits rather then > waiting and committing 500 pages at once. 1.15 outperforms 1.14 in > this scenario as well. > > > On 10/30/2012 03:56 AM, Nicolas Filotto wrote: > > > Do you have new results to provide? Especially on PGSQL? > > > On Mon, Oct 29, 2012 at 9:26 PM, Nick Scavelli < nscavell(a)redhat.com > > wrote: > > > > Some quick tests suggest there seems to be some improvement however > the difference between 1.14 and 1.15 is still there. And it still > seems to be the time that is spent in lucene updating the index > (IndexWriter#addDocument). With the new jar it seems to indicate a > little less time is being spent here, but no where close to the time > spent in JCR1.14. > > > > > On 10/26/2012 11:31 AM, Nicolas Filotto wrote: > > > My mistake jcr.core is not enough you need core.database too, you can > get the latest versions from here > http://repository.exoplatform.org/content/groups/public/org/exoplatform/j... > and here > http://repository.exoplatform.org/content/groups/public/org/exoplatform/c... > > > On Fri, Oct 26, 2012 at 7:37 AM, Michal Vanco < mvanco(a)redhat.com > > wrote: > > > Same for me with mysql when I was about to try initialization of > manyPages in portal with upgraded jcr core. Log is here: > http://pastebin.com/yqTXEbs5 > > Michal > > > ----- Original Message ----- > > From: "Matt Wringe" < mwringe(a)redhat.com > > > > > To: "Nick Scavelli" < nscavell(a)redhat.com > > > Cc: "gatein-dev" < gatein-dev(a)lists.jboss.org > > > Sent: Thursday, October 25, 2012 10:12:20 PM > > Subject: Re: [gatein-dev] Performance degradation between JCR 1.14 > > and 1.15? > > > > same with mysql > > > > On Thu 25 Oct 2012 04:05:52 PM EDT, Nick Scavelli wrote: > > > Using both v1 and v2 I get errors in postgres. Full stacktrace > > > here > > > http://pastebin.com/BFAMW85M > > > > > > On 10/25/2012 08:43 AM, Nicolas Filotto wrote: > > >> Here is the latest version > > >> http://dl.dropbox.com/u/20836627/exo.jcr.component.core-1.15.0-CR2-SNAPSH... > > >> > > >> On Wed, Oct 24, 2012 at 9:57 PM, Matt Wringe < > > >> mwringe(a)redhat.com > > >> <mailto: mwringe(a)redhat.com >> wrote: > > >> > > >> On 24/10/12 03:33 PM, Nicolas Filotto wrote: > > >>> Could you please retry with this jar? > > >> > > >> I tested it quickly with the updated jar, and it seems to be > > >> much > > >> closer to the 1.14 results in my test when dealing with 500 > > >> pages. I will let Nick comment if it fixes the issues he was > > >> seeing with import/export of sites. > > >> > > >> > > >>> > > >>> On Mon, Oct 22, 2012 at 2:51 PM, Nick Scavelli > > >>> < nscavell(a)redhat.com <mailto: nscavell(a)redhat.com >> wrote: > > >>> > > >>> > > >>> Here are results of some quick tests I ran on Friday > > >>> using > > >>> PostgreSQL. Note this is total time spent saving session > > >>> after 500 pages, not time spent indexing. > > >>> > > >>> 1.15: 112.916s, 113.433s, 110.835s > > >>> > > >>> 1.14: 69.711s, 81.118s, 81.680s > > >>> > > >>> For 400 pages (only ran this test once) > > >>> 1.15: 61.503s > > >>> 1.14: 57.856s > > >>> > > >>> And the less pages the more closely 1.15 seems to perform > > >>> close to 1.14. This is a very low sample size, and my > > >>> tests > > >>> might not best paint an accurate picture, but it does > > >>> seem > > >>> that 1.14 consistently out performs 1.15. So take it as > > >>> you > > >>> will. I'm also curious what performance is like if I > > >>> would > > >>> save the session after every page, instead of one large > > >>> commit of 500 pages. > > >>> > > >>> - Nick > > >>> > > >> > > > > > > > _______________________________________________ > > gatein-dev mailing list > > gatein-dev(a)lists.jboss.org > > https://lists.jboss.org/mailman/listinfo/gatein-dev > > > _______________________________________________ > gatein-dev mailing list > gatein-dev(a)lists.jboss.org > https://lists.jboss.org/mailman/listinfo/gatein-dev > > > > _______________________________________________ > gatein-dev mailing list gatein-dev(a)lists.jboss.org > https://lists.jboss.org/mailman/listinfo/gatein-dev > > >

Hi Nick, I'm using MySql 5.5 for portal performance. Best regards, Michal ----- Original Message ----- > From: "Nicolas Filotto" <nicolas.filotto(a)exoplatform.com&gt; > To: "Michal Vanco" <mvanco(a)redhat.com&gt; > Cc: "Nick Scavelli" <nscavell(a)redhat.com&gt;, "gatein-dev" < gatein-dev(a)lists.jboss.org&gt; > Sent: Friday, November 2, 2012 10:07:12 AM > Subject: Re: [gatein-dev] Performance degradation between JCR 1.14 and 1.15? > > Michal, same question for you, which db did you use? > > > On Thu, Nov 1, 2012 at 12:09 PM, Michal Vanco < mvanco(a)redhat.com > > wrote: > > > Hi, > > I have some feedback on this topic as well. > > I have tried 2 scenarios: > 1) initialization of portal with many pages (server startup time) > 2) jcr portlet (for writing some randon data in jcr) - portlet is > accessed with concurrent users during perf test > > ad 1) > 3 portals with many pages at different structure are initialized > (each portal has +- 780 nodes/pages - [size,height]: [5,4] , [27,2] > , [780,1]) > - EPP 5.2.2 started at 50m:51s:425ms > - JPP 6.0.0 ER02 started at 5154494ms = 85,9m > - JPP 6.0.0 ER02 with upgraded jcr core started at 5054052ms = 84,2m > > Accessing these portals is much better at JPP 6 as I have already > mentioned at previous email. > > ad 2) > This is a refreshed scenario we have tested, textlogs from perf runs > are attached - best results were with epp 5.2.2 > For jpp 6, results were slightly better with upgraded jcr core > I'm also attaching jcr portlets which can be reviewed - write portlet > is used, it adds some random data at jcr when portlet is accessed > > Please keep in mind that it's a comparison of 2 major versions which > are quite different, but I would expect these scenarios do not > differ too much. > > Best regards, > > Michal > > ----- Original Message ----- > > > From: "Nick Scavelli" < nscavell(a)redhat.com > > > To: "Nicolas Filotto" < nicolas.filotto(a)exoplatform.com > > > Cc: "Michal Vanco" < mvanco(a)redhat.com >, "gatein-dev" < > > gatein-dev(a)lists.jboss.org > > > Sent: Tuesday, October 30, 2012 11:10:03 PM > > Subject: Re: [gatein-dev] Performance degradation between JCR 1.14 > > and 1.15? > > > > > > Ran some more tests as I saw 1.15 having better numbers for pages > > less then 500. > > > > Looks like the new jar is scaling better, and even outperforming > > 1.14 > > except for 500 pages. Here are the results http://bit.ly/T2ghPK . > > The second tab shows the results for batching commits rather then > > waiting and committing 500 pages at once. 1.15 outperforms 1.14 in > > this scenario as well. > > > > > > On 10/30/2012 03:56 AM, Nicolas Filotto wrote: > > > > > > Do you have new results to provide? Especially on PGSQL? > > > > > > On Mon, Oct 29, 2012 at 9:26 PM, Nick Scavelli < > > nscavell(a)redhat.com > > > wrote: > > > > > > > > Some quick tests suggest there seems to be some improvement however > > the difference between 1.14 and 1.15 is still there. And it still > > seems to be the time that is spent in lucene updating the index > > (IndexWriter#addDocument). With the new jar it seems to indicate a > > little less time is being spent here, but no where close to the > > time > > spent in JCR1.14. > > > > > > > > > > On 10/26/2012 11:31 AM, Nicolas Filotto wrote: > > > > > > My mistake jcr.core is not enough you need core.database too, you > > can > > get the latest versions from here > > http://repository.exoplatform.org/content/groups/public/org/exoplatform/j... > > and here > > http://repository.exoplatform.org/content/groups/public/org/exoplatform/c... > > > > > > On Fri, Oct 26, 2012 at 7:37 AM, Michal Vanco < mvanco(a)redhat.com > > > wrote: > > > > > > Same for me with mysql when I was about to try initialization of > > manyPages in portal with upgraded jcr core. Log is here: > > http://pastebin.com/yqTXEbs5 > > > > Michal > > > > > > ----- Original Message ----- > > > From: "Matt Wringe" < mwringe(a)redhat.com > > > > > > > > To: "Nick Scavelli" < nscavell(a)redhat.com > > > > Cc: "gatein-dev" < gatein-dev(a)lists.jboss.org > > > > Sent: Thursday, October 25, 2012 10:12:20 PM > > > Subject: Re: [gatein-dev] Performance degradation between JCR > > > 1.14 > > > and 1.15? > > > > > > same with mysql > > > > > > On Thu 25 Oct 2012 04:05:52 PM EDT, Nick Scavelli wrote: > > > > Using both v1 and v2 I get errors in postgres. Full stacktrace > > > > here > > > > http://pastebin.com/BFAMW85M > > > > > > > > On 10/25/2012 08:43 AM, Nicolas Filotto wrote: > > > >> Here is the latest version > > > >> http://dl.dropbox.com/u/20836627/exo.jcr.component.core-1.15.0-CR2-SNAPSH... > > > >> > > > >> On Wed, Oct 24, 2012 at 9:57 PM, Matt Wringe < > > > >> mwringe(a)redhat.com > > > >> <mailto: mwringe(a)redhat.com >> wrote: > > > >> > > > >> On 24/10/12 03:33 PM, Nicolas Filotto wrote: > > > >>> Could you please retry with this jar? > > > >> > > > >> I tested it quickly with the updated jar, and it seems to be > > > >> much > > > >> closer to the 1.14 results in my test when dealing with 500 > > > >> pages. I will let Nick comment if it fixes the issues he was > > > >> seeing with import/export of sites. > > > >> > > > >> > > > >>> > > > >>> On Mon, Oct 22, 2012 at 2:51 PM, Nick Scavelli > > > >>> < nscavell(a)redhat.com <mailto: nscavell(a)redhat.com >> wrote: > > > >>> > > > >>> > > > >>> Here are results of some quick tests I ran on Friday > > > >>> using > > > >>> PostgreSQL. Note this is total time spent saving session > > > >>> after 500 pages, not time spent indexing. > > > >>> > > > >>> 1.15: 112.916s, 113.433s, 110.835s > > > >>> > > > >>> 1.14: 69.711s, 81.118s, 81.680s > > > >>> > > > >>> For 400 pages (only ran this test once) > > > >>> 1.15: 61.503s > > > >>> 1.14: 57.856s > > > >>> > > > >>> And the less pages the more closely 1.15 seems to perform > > > >>> close to 1.14. This is a very low sample size, and my > > > >>> tests > > > >>> might not best paint an accurate picture, but it does > > > >>> seem > > > >>> that 1.14 consistently out performs 1.15. So take it as > > > >>> you > > > >>> will. I'm also curious what performance is like if I > > > >>> would > > > >>> save the session after every page, instead of one large > > > >>> commit of 500 pages. > > > >>> > > > >>> - Nick > > > >>> > > > >> > > > > > > > > > > > _______________________________________________ > > > gatein-dev mailing list > > > gatein-dev(a)lists.jboss.org > > > https://lists.jboss.org/mailman/listinfo/gatein-dev > > > > > _______________________________________________ > > gatein-dev mailing list > > gatein-dev(a)lists.jboss.org > > https://lists.jboss.org/mailman/listinfo/gatein-dev > > > > > > > > _______________________________________________ > > gatein-dev mailing list gatein-dev(a)lists.jboss.org > > https://lists.jboss.org/mailman/listinfo/gatein-dev > > > > > > >

From: "Michal Vanco" <mvanco(a)redhat.com&gt; To: "Nicolas Filotto" <nicolas.filotto(a)exoplatform.com&gt; Cc: "Nick Scavelli" <nscavell(a)redhat.com&gt;, "gatein-dev" <gatein-dev(a)lists.jboss.org&gt;, "Honza Fnukal" <hfnukal(a)redhat.com&gt; Sent: Friday, November 2, 2012 11:37:04 AM Subject: Re: [gatein-dev] Performance degradation between JCR 1.14 and 1.15? Hi, ----- Original Message ----- > From: "Nicolas Filotto" <nicolas.filotto(a)exoplatform.com&gt; > To: "Michal Vanco" <mvanco(a)redhat.com&gt; > Cc: "Nick Scavelli" <nscavell(a)redhat.com&gt;, "gatein-dev" > <gatein-dev(a)lists.jboss.org&gt; > Sent: Friday, November 2, 2012 10:23:26 AM > Subject: Re: [gatein-dev] Performance degradation between JCR 1.14 > and 1.15? > > Good, next questions: > > > 1. Where can I get JPP 6.0.0 ER02? Is this > http://intranet.exoplatform.org/rest/jcr/repository/collaboration/Groups/... > what you meant? No, this is plain EAP, I'm talking about JPP 6.0.0 ER02 build on top of EAP 6.0.1 ER03 - Honza should be able to share on intranet with you. > 2. What are the steps to reproduce? To reproduce first scenario: - use attached files - add to configuration.xml <!-- Configuration for many pages and navigations --> <import>war:/conf/portal/manyPagesPortal-configuration.xml</import> - place manyPagesPortal-configuration.xml at conf/portal folder (using NewPortalConfigListener) - copy folders with generated pages/navigations to portal folder - copy nullPortletPortalPage.war at standalone/deployments (contains very simple hello world portlet which is referenced at pages.xml) - (I have some extra pages for groups/users, but it's not necessary to add) - start the portal - then do the same with epp 5.2.2 to measure difference - difference is at initialization time, then you can verify initialized portals - there is big improvement in times when accessing portals thanks to new page service I suppose To reproduce second scenario: - use the write portlet I have attached last time - place them somewhere at portal and run load test on this page - jcr operation (with randon nodes write) is called everytime portlet is being rendered, you should be able to compare difference with current/old/updated version of portal/jcr Regards, Michal > > > On Fri, Nov 2, 2012 at 9:11 AM, Michal Vanco < mvanco(a)redhat.com > > wrote: > > > Hi Nick, > > I'm using MySql 5.5 for portal performance. > > > Best regards, > Michal > > ----- Original Message ----- > > > > From: "Nicolas Filotto" < nicolas.filotto(a)exoplatform.com > > > To: "Michal Vanco" < mvanco(a)redhat.com > > > Cc: "Nick Scavelli" < nscavell(a)redhat.com >, "gatein-dev" < > > gatein-dev(a)lists.jboss.org > > > Sent: Friday, November 2, 2012 10:07:12 AM > > Subject: Re: [gatein-dev] Performance degradation between JCR > > 1.14 > > and 1.15? > > > > Michal, same question for you, which db did you use? > > > > > > On Thu, Nov 1, 2012 at 12:09 PM, Michal Vanco < mvanco(a)redhat.com > > > > > wrote: > > > > > > Hi, > > > > I have some feedback on this topic as well. > > > > I have tried 2 scenarios: > > 1) initialization of portal with many pages (server startup time) > > 2) jcr portlet (for writing some randon data in jcr) - portlet is > > accessed with concurrent users during perf test > > > > ad 1) > > 3 portals with many pages at different structure are initialized > > (each portal has +- 780 nodes/pages - [size,height]: [5,4] , > > [27,2] > > , [780,1]) > > - EPP 5.2.2 started at 50m:51s:425ms > > - JPP 6.0.0 ER02 started at 5154494ms = 85,9m > > - JPP 6.0.0 ER02 with upgraded jcr core started at 5054052ms = > > 84,2m > > > > Accessing these portals is much better at JPP 6 as I have already > > mentioned at previous email. > > > > ad 2) > > This is a refreshed scenario we have tested, textlogs from perf > > runs > > are attached - best results were with epp 5.2.2 > > For jpp 6, results were slightly better with upgraded jcr core > > I'm also attaching jcr portlets which can be reviewed - write > > portlet > > is used, it adds some random data at jcr when portlet is accessed > > > > Please keep in mind that it's a comparison of 2 major versions > > which > > are quite different, but I would expect these scenarios do not > > differ too much. > > > > Best regards, > > > > Michal > > > > ----- Original Message ----- > > > > > From: "Nick Scavelli" < nscavell(a)redhat.com > > > > To: "Nicolas Filotto" < nicolas.filotto(a)exoplatform.com > > > > Cc: "Michal Vanco" < mvanco(a)redhat.com >, "gatein-dev" < > > > gatein-dev(a)lists.jboss.org > > > > Sent: Tuesday, October 30, 2012 11:10:03 PM > > > Subject: Re: [gatein-dev] Performance degradation between JCR > > > 1.14 > > > and 1.15? > > > > > > > > > > Ran some more tests as I saw 1.15 having better numbers for > > > pages > > > less then 500. > > > > > > Looks like the new jar is scaling better, and even > > > outperforming > > > 1.14 > > > except for 500 pages. Here are the results http://bit.ly/T2ghPK > > > . > > > The second tab shows the results for batching commits rather > > > then > > > waiting and committing 500 pages at once. 1.15 outperforms 1.14 > > > in > > > this scenario as well. > > > > > > > > > On 10/30/2012 03:56 AM, Nicolas Filotto wrote: > > > > > > > > > Do you have new results to provide? Especially on PGSQL? > > > > > > > > > On Mon, Oct 29, 2012 at 9:26 PM, Nick Scavelli < > > > nscavell(a)redhat.com > > > > wrote: > > > > > > > > > > > > Some quick tests suggest there seems to be some improvement > > > however > > > the difference between 1.14 and 1.15 is still there. And it > > > still > > > seems to be the time that is spent in lucene updating the index > > > (IndexWriter#addDocument). With the new jar it seems to > > > indicate > > > a > > > little less time is being spent here, but no where close to the > > > time > > > spent in JCR1.14. > > > > > > > > > > > > > > > On 10/26/2012 11:31 AM, Nicolas Filotto wrote: > > > > > > > > > My mistake jcr.core is not enough you need core.database too, > > > you > > > can > > > get the latest versions from here > > > http://repository.exoplatform.org/content/groups/public/org/exoplatform/j... > > > and here > > > http://repository.exoplatform.org/content/groups/public/org/exoplatform/c... > > > > > > > > > On Fri, Oct 26, 2012 at 7:37 AM, Michal Vanco < > > > mvanco(a)redhat.com > > > > > > > wrote: > > > > > > > > > Same for me with mysql when I was about to try initialization > > > of > > > manyPages in portal with upgraded jcr core. Log is here: > > > http://pastebin.com/yqTXEbs5 > > > > > > Michal > > > > > > > > > ----- Original Message ----- > > > > From: "Matt Wringe" < mwringe(a)redhat.com > > > > > > > > > > > To: "Nick Scavelli" < nscavell(a)redhat.com > > > > > Cc: "gatein-dev" < gatein-dev(a)lists.jboss.org > > > > > Sent: Thursday, October 25, 2012 10:12:20 PM > > > > Subject: Re: [gatein-dev] Performance degradation between JCR > > > > 1.14 > > > > and 1.15? > > > > > > > > same with mysql > > > > > > > > On Thu 25 Oct 2012 04:05:52 PM EDT, Nick Scavelli wrote: > > > > > Using both v1 and v2 I get errors in postgres. Full > > > > > stacktrace > > > > > here > > > > > http://pastebin.com/BFAMW85M > > > > > > > > > > On 10/25/2012 08:43 AM, Nicolas Filotto wrote: > > > > >> Here is the latest version > > > > >> http://dl.dropbox.com/u/20836627/exo.jcr.component.core-1.15.0-CR2-SNAPSH... > > > > >> > > > > >> On Wed, Oct 24, 2012 at 9:57 PM, Matt Wringe < > > > > >> mwringe(a)redhat.com > > > > >> <mailto: mwringe(a)redhat.com >> wrote: > > > > >> > > > > >> On 24/10/12 03:33 PM, Nicolas Filotto wrote: > > > > >>> Could you please retry with this jar? > > > > >> > > > > >> I tested it quickly with the updated jar, and it seems to > > > > >> be > > > > >> much > > > > >> closer to the 1.14 results in my test when dealing with > > > > >> 500 > > > > >> pages. I will let Nick comment if it fixes the issues he > > > > >> was > > > > >> seeing with import/export of sites. > > > > >> > > > > >> > > > > >>> > > > > >>> On Mon, Oct 22, 2012 at 2:51 PM, Nick Scavelli > > > > >>> < nscavell(a)redhat.com <mailto: nscavell(a)redhat.com >> > > > > >>> wrote: > > > > >>> > > > > >>> > > > > >>> Here are results of some quick tests I ran on Friday > > > > >>> using > > > > >>> PostgreSQL. Note this is total time spent saving session > > > > >>> after 500 pages, not time spent indexing. > > > > >>> > > > > >>> 1.15: 112.916s, 113.433s, 110.835s > > > > >>> > > > > >>> 1.14: 69.711s, 81.118s, 81.680s > > > > >>> > > > > >>> For 400 pages (only ran this test once) > > > > >>> 1.15: 61.503s > > > > >>> 1.14: 57.856s > > > > >>> > > > > >>> And the less pages the more closely 1.15 seems to perform > > > > >>> close to 1.14. This is a very low sample size, and my > > > > >>> tests > > > > >>> might not best paint an accurate picture, but it does > > > > >>> seem > > > > >>> that 1.14 consistently out performs 1.15. So take it as > > > > >>> you > > > > >>> will. I'm also curious what performance is like if I > > > > >>> would > > > > >>> save the session after every page, instead of one large > > > > >>> commit of 500 pages. > > > > >>> > > > > >>> - Nick > > > > >>> > > > > >> > > > > > > > > > > > > > > > _______________________________________________ > > > > gatein-dev mailing list > > > > gatein-dev(a)lists.jboss.org > > > > https://lists.jboss.org/mailman/listinfo/gatein-dev > > > > > > > _______________________________________________ > > > gatein-dev mailing list > > > gatein-dev(a)lists.jboss.org > > > https://lists.jboss.org/mailman/listinfo/gatein-dev > > > > > > > > > > > > _______________________________________________ > > > gatein-dev mailing list gatein-dev(a)lists.jboss.org > > > https://lists.jboss.org/mailman/listinfo/gatein-dev > > > > > > > > > > > > >

I launched your first scenario on EPP 5.2.2 GA now I'm stuck since I don't have JPP to be able to compare. On Fri, Nov 2, 2012 at 10:38 AM, Michal Vanco <mvanco(a)redhat.com&gt; wrote: > Forget to attach files... > > ----- Original Message ----- > > From: "Michal Vanco" <mvanco(a)redhat.com&gt; > > To: "Nicolas Filotto" <nicolas.filotto(a)exoplatform.com&gt; > > Cc: "Nick Scavelli" <nscavell(a)redhat.com&gt;, "gatein-dev" < > gatein-dev(a)lists.jboss.org&gt;, "Honza Fnukal" > > <hfnukal(a)redhat.com&gt; > > Sent: Friday, November 2, 2012 11:37:04 AM > > Subject: Re: [gatein-dev] Performance degradation between JCR 1.14 and > 1.15? > > > > Hi, > > > > ----- Original Message ----- > > > From: "Nicolas Filotto" <nicolas.filotto(a)exoplatform.com&gt; > > > To: "Michal Vanco" <mvanco(a)redhat.com&gt; > > > Cc: "Nick Scavelli" <nscavell(a)redhat.com&gt;, "gatein-dev" > > > <gatein-dev(a)lists.jboss.org&gt; > > > Sent: Friday, November 2, 2012 10:23:26 AM > > > Subject: Re: [gatein-dev] Performance degradation between JCR 1.14 > > > and 1.15? > > > > > > Good, next questions: > > > > > > > > > 1. Where can I get JPP 6.0.0 ER02? Is this > > > > http://intranet.exoplatform.org/rest/jcr/repository/collaboration/Groups/... > > > what you meant? > > > > No, this is plain EAP, I'm talking about JPP 6.0.0 ER02 build on top > > of EAP 6.0.1 ER03 - Honza should be able to share on intranet with > > you. > > > > > 2. What are the steps to reproduce? > > > > To reproduce first scenario: > > - use attached files > > - add to configuration.xml > > <!-- Configuration for many pages and navigations --> > > <import>war:/conf/portal/manyPagesPortal-configuration.xml</import> > > - place manyPagesPortal-configuration.xml at conf/portal folder > > (using NewPortalConfigListener) > > - copy folders with generated pages/navigations to portal folder > > - copy nullPortletPortalPage.war at standalone/deployments > > (contains very simple hello world portlet which is referenced at > > pages.xml) > > - (I have some extra pages for groups/users, but it's not necessary > > to add) > > - start the portal > > - then do the same with epp 5.2.2 to measure difference > > - difference is at initialization time, then you can verify > > initialized portals - there is big improvement in times when > > accessing portals thanks to new page service I suppose > > > > To reproduce second scenario: > > - use the write portlet I have attached last time - place them > > somewhere at portal and run load test on this page > > - jcr operation (with randon nodes write) is called everytime > > portlet is being rendered, you should be able to compare difference > > with current/old/updated version of portal/jcr > > > > Regards, > > Michal > > > > > > > > > > > On Fri, Nov 2, 2012 at 9:11 AM, Michal Vanco < mvanco(a)redhat.com > > > > wrote: > > > > > > > > > Hi Nick, > > > > > > I'm using MySql 5.5 for portal performance. > > > > > > > > > Best regards, > > > Michal > > > > > > ----- Original Message ----- > > > > > > > > > > From: "Nicolas Filotto" < nicolas.filotto(a)exoplatform.com > > > > > To: "Michal Vanco" < mvanco(a)redhat.com > > > > > Cc: "Nick Scavelli" < nscavell(a)redhat.com >, "gatein-dev" < > > > > gatein-dev(a)lists.jboss.org > > > > > Sent: Friday, November 2, 2012 10:07:12 AM > > > > Subject: Re: [gatein-dev] Performance degradation between JCR > > > > 1.14 > > > > and 1.15? > > > > > > > > Michal, same question for you, which db did you use? > > > > > > > > > > > > On Thu, Nov 1, 2012 at 12:09 PM, Michal Vanco < mvanco(a)redhat.com > > > > > > > > > wrote: > > > > > > > > > > > > Hi, > > > > > > > > I have some feedback on this topic as well. > > > > > > > > I have tried 2 scenarios: > > > > 1) initialization of portal with many pages (server startup time) > > > > 2) jcr portlet (for writing some randon data in jcr) - portlet is > > > > accessed with concurrent users during perf test > > > > > > > > ad 1) > > > > 3 portals with many pages at different structure are initialized > > > > (each portal has +- 780 nodes/pages - [size,height]: [5,4] , > > > > [27,2] > > > > , [780,1]) > > > > - EPP 5.2.2 started at 50m:51s:425ms > > > > - JPP 6.0.0 ER02 started at 5154494ms = 85,9m > > > > - JPP 6.0.0 ER02 with upgraded jcr core started at 5054052ms = > > > > 84,2m > > > > > > > > Accessing these portals is much better at JPP 6 as I have already > > > > mentioned at previous email. > > > > > > > > ad 2) > > > > This is a refreshed scenario we have tested, textlogs from perf > > > > runs > > > > are attached - best results were with epp 5.2.2 > > > > For jpp 6, results were slightly better with upgraded jcr core > > > > I'm also attaching jcr portlets which can be reviewed - write > > > > portlet > > > > is used, it adds some random data at jcr when portlet is accessed > > > > > > > > Please keep in mind that it's a comparison of 2 major versions > > > > which > > > > are quite different, but I would expect these scenarios do not > > > > differ too much. > > > > > > > > Best regards, > > > > > > > > Michal > > > > > > > > ----- Original Message ----- > > > > > > > > > From: "Nick Scavelli" < nscavell(a)redhat.com > > > > > > To: "Nicolas Filotto" < nicolas.filotto(a)exoplatform.com > > > > > > Cc: "Michal Vanco" < mvanco(a)redhat.com >, "gatein-dev" < > > > > > gatein-dev(a)lists.jboss.org > > > > > > Sent: Tuesday, October 30, 2012 11:10:03 PM > > > > > Subject: Re: [gatein-dev] Performance degradation between JCR > > > > > 1.14 > > > > > and 1.15? > > > > > > > > > > > > > > > > > > Ran some more tests as I saw 1.15 having better numbers for > > > > > pages > > > > > less then 500. > > > > > > > > > > Looks like the new jar is scaling better, and even > > > > > outperforming > > > > > 1.14 > > > > > except for 500 pages. Here are the results http://bit.ly/T2ghPK > > > > > . > > > > > The second tab shows the results for batching commits rather > > > > > then > > > > > waiting and committing 500 pages at once. 1.15 outperforms 1.14 > > > > > in > > > > > this scenario as well. > > > > > > > > > > > > > > > On 10/30/2012 03:56 AM, Nicolas Filotto wrote: > > > > > > > > > > > > > > > Do you have new results to provide? Especially on PGSQL? > > > > > > > > > > > > > > > On Mon, Oct 29, 2012 at 9:26 PM, Nick Scavelli < > > > > > nscavell(a)redhat.com > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > Some quick tests suggest there seems to be some improvement > > > > > however > > > > > the difference between 1.14 and 1.15 is still there. And it > > > > > still > > > > > seems to be the time that is spent in lucene updating the index > > > > > (IndexWriter#addDocument). With the new jar it seems to > > > > > indicate > > > > > a > > > > > little less time is being spent here, but no where close to the > > > > > time > > > > > spent in JCR1.14. > > > > > > > > > > > > > > > > > > > > > > > > > On 10/26/2012 11:31 AM, Nicolas Filotto wrote: > > > > > > > > > > > > > > > My mistake jcr.core is not enough you need core.database too, > > > > > you > > > > > can > > > > > get the latest versions from here > > > > > > http://repository.exoplatform.org/content/groups/public/org/exoplatform/j... > > > > > and here > > > > > > http://repository.exoplatform.org/content/groups/public/org/exoplatform/c... > > > > > > > > > > > > > > > On Fri, Oct 26, 2012 at 7:37 AM, Michal Vanco < > > > > > mvanco(a)redhat.com > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > Same for me with mysql when I was about to try initialization > > > > > of > > > > > manyPages in portal with upgraded jcr core. Log is here: > > > > > http://pastebin.com/yqTXEbs5 > > > > > > > > > > Michal > > > > > > > > > > > > > > > ----- Original Message ----- > > > > > > From: "Matt Wringe" < mwringe(a)redhat.com > > > > > > > > > > > > > > > > > To: "Nick Scavelli" < nscavell(a)redhat.com > > > > > > > Cc: "gatein-dev" < gatein-dev(a)lists.jboss.org > > > > > > > Sent: Thursday, October 25, 2012 10:12:20 PM > > > > > > Subject: Re: [gatein-dev] Performance degradation between JCR > > > > > > 1.14 > > > > > > and 1.15? > > > > > > > > > > > > same with mysql > > > > > > > > > > > > On Thu 25 Oct 2012 04:05:52 PM EDT, Nick Scavelli wrote: > > > > > > > Using both v1 and v2 I get errors in postgres. Full > > > > > > > stacktrace > > > > > > > here > > > > > > > http://pastebin.com/BFAMW85M > > > > > > > > > > > > > > On 10/25/2012 08:43 AM, Nicolas Filotto wrote: > > > > > > >> Here is the latest version > > > > > > >> > http://dl.dropbox.com/u/20836627/exo.jcr.component.core-1.15.0-CR2-SNAPSH... > > > > > > >> > > > > > > >> On Wed, Oct 24, 2012 at 9:57 PM, Matt Wringe < > > > > > > >> mwringe(a)redhat.com > > > > > > >> <mailto: mwringe(a)redhat.com >> wrote: > > > > > > >> > > > > > > >> On 24/10/12 03:33 PM, Nicolas Filotto wrote: > > > > > > >>> Could you please retry with this jar? > > > > > > >> > > > > > > >> I tested it quickly with the updated jar, and it seems to > > > > > > >> be > > > > > > >> much > > > > > > >> closer to the 1.14 results in my test when dealing with > > > > > > >> 500 > > > > > > >> pages. I will let Nick comment if it fixes the issues he > > > > > > >> was > > > > > > >> seeing with import/export of sites. > > > > > > >> > > > > > > >> > > > > > > >>> > > > > > > >>> On Mon, Oct 22, 2012 at 2:51 PM, Nick Scavelli > > > > > > >>> < nscavell(a)redhat.com <mailto: nscavell(a)redhat.com >> > > > > > > >>> wrote: > > > > > > >>> > > > > > > >>> > > > > > > >>> Here are results of some quick tests I ran on Friday > > > > > > >>> using > > > > > > >>> PostgreSQL. Note this is total time spent saving session > > > > > > >>> after 500 pages, not time spent indexing. > > > > > > >>> > > > > > > >>> 1.15: 112.916s, 113.433s, 110.835s > > > > > > >>> > > > > > > >>> 1.14: 69.711s, 81.118s, 81.680s > > > > > > >>> > > > > > > >>> For 400 pages (only ran this test once) > > > > > > >>> 1.15: 61.503s > > > > > > >>> 1.14: 57.856s > > > > > > >>> > > > > > > >>> And the less pages the more closely 1.15 seems to perform > > > > > > >>> close to 1.14. This is a very low sample size, and my > > > > > > >>> tests > > > > > > >>> might not best paint an accurate picture, but it does > > > > > > >>> seem > > > > > > >>> that 1.14 consistently out performs 1.15. So take it as > > > > > > >>> you > > > > > > >>> will. I'm also curious what performance is like if I > > > > > > >>> would > > > > > > >>> save the session after every page, instead of one large > > > > > > >>> commit of 500 pages. > > > > > > >>> > > > > > > >>> - Nick > > > > > > >>> > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > _______________________________________________ > > > > > > gatein-dev mailing list > > > > > > gatein-dev(a)lists.jboss.org > > > > > > https://lists.jboss.org/mailman/listinfo/gatein-dev > > > > > > > > > > > _______________________________________________ > > > > > gatein-dev mailing list > > > > > gatein-dev(a)lists.jboss.org > > > > > https://lists.jboss.org/mailman/listinfo/gatein-dev > > > > > > > > > > > > > > > > > > > > _______________________________________________ > > > > > gatein-dev mailing list gatein-dev(a)lists.jboss.org > > > > > https://lists.jboss.org/mailman/listinfo/gatein-dev > > > > > > > > > > > > > > > > > > > > > > > > > >

Ran some more tests as I saw 1.15 having better numbers for pages less then 500. Looks like the new jar is scaling better, and even outperforming 1.14 except for 500 pages. Here are the results http://bit.ly/T2ghPK. The second tab shows the results for batching commits rather then waiting and committing 500 pages at once. 1.15 outperforms 1.14 in this scenario as well. On 10/30/2012 03:56 AM, Nicolas Filotto wrote: Do you have new results to provide? Especially on PGSQL? On Mon, Oct 29, 2012 at 9:26 PM, Nick Scavelli <nscavell(a)redhat.com&gt;wrote: > Some quick tests suggest there seems to be some improvement however the > difference between 1.14 and 1.15 is still there. And it still seems to be > the time that is spent in lucene updating the index > (IndexWriter#addDocument). With the new jar it seems to indicate a little > less time is being spent here, but no where close to the time spent in > JCR1.14. > > > On 10/26/2012 11:31 AM, Nicolas Filotto wrote: > > My mistake jcr.core is not enough you need core.database too, you can get > the latest versions from here > > http://repository.exoplatform.org/content/groups/public/org/exoplatform/j... > and here > > http://repository.exoplatform.org/content/groups/public/org/exoplatform/c... > > On Fri, Oct 26, 2012 at 7:37 AM, Michal Vanco <mvanco(a)redhat.com&gt; wrote: > >> Same for me with mysql when I was about to try initialization of >> manyPages in portal with upgraded jcr core. Log is here: >> http://pastebin.com/yqTXEbs5 >> >> Michal >> >> ----- Original Message ----- >> > From: "Matt Wringe" <mwringe(a)redhat.com&gt; >> > To: "Nick Scavelli" <nscavell(a)redhat.com&gt; >> > Cc: "gatein-dev" <gatein-dev(a)lists.jboss.org&gt; >> > Sent: Thursday, October 25, 2012 10:12:20 PM >> > Subject: Re: [gatein-dev] Performance degradation between JCR 1.14 and >> 1.15? >> > >> > same with mysql >> > >> > On Thu 25 Oct 2012 04:05:52 PM EDT, Nick Scavelli wrote: >> > > Using both v1 and v2 I get errors in postgres. Full stacktrace here >> > > http://pastebin.com/BFAMW85M >> > > >> > > On 10/25/2012 08:43 AM, Nicolas Filotto wrote: >> > >> Here is the latest version >> > >> >> http://dl.dropbox.com/u/20836627/exo.jcr.component.core-1.15.0-CR2-SNAPSH... >> > >> >> > >> On Wed, Oct 24, 2012 at 9:57 PM, Matt Wringe <mwringe(a)redhat.com >> > >> <mailto:mwringe@redhat.com>> wrote: >> > >> >> > >> On 24/10/12 03:33 PM, Nicolas Filotto wrote: >> > >>> Could you please retry with this jar? >> > >> >> > >> I tested it quickly with the updated jar, and it seems to be >> > >> much >> > >> closer to the 1.14 results in my test when dealing with 500 >> > >> pages. I will let Nick comment if it fixes the issues he was >> > >> seeing with import/export of sites. >> > >> >> > >> >> > >>> >> > >>> On Mon, Oct 22, 2012 at 2:51 PM, Nick Scavelli >> > >>> <nscavell(a)redhat.com <mailto:nscavell@redhat.com>> wrote: >> > >>> >> > >>> >> > >>> Here are results of some quick tests I ran on Friday >> > >>> using >> > >>> PostgreSQL. Note this is total time spent saving session >> > >>> after 500 pages, not time spent indexing. >> > >>> >> > >>> 1.15: 112.916s, 113.433s, 110.835s >> > >>> >> > >>> 1.14: 69.711s, 81.118s, 81.680s >> > >>> >> > >>> For 400 pages (only ran this test once) >> > >>> 1.15: 61.503s >> > >>> 1.14: 57.856s >> > >>> >> > >>> And the less pages the more closely 1.15 seems to perform >> > >>> close to 1.14. This is a very low sample size, and my >> > >>> tests >> > >>> might not best paint an accurate picture, but it does >> > >>> seem >> > >>> that 1.14 consistently out performs 1.15. So take it as >> > >>> you >> > >>> will. I'm also curious what performance is like if I >> > >>> would >> > >>> save the session after every page, instead of one large >> > >>> commit of 500 pages. >> > >>> >> > >>> - Nick >> > >>> >> > >> >> > > >> > _______________________________________________ >> > gatein-dev mailing list >> > gatein-dev(a)lists.jboss.org >> > https://lists.jboss.org/mailman/listinfo/gatein-dev >> > >> _______________________________________________ >> gatein-dev mailing list >> gatein-dev(a)lists.jboss.org >> https://lists.jboss.org/mailman/listinfo/gatein-dev >> > > > > _______________________________________________ > gatein-dev mailing listgatein-dev@lists.jboss.orghttps://lists.jboss.org/mailman/listinfo/gatein-dev > > >