From lkrzyzan at redhat.com Fri Jul 17 09:32:07 2015 From: lkrzyzan at redhat.com (=?utf-8?Q?Libor_Krzy=C5=BEanek?=) Date: Fri, 17 Jul 2015 15:32:07 +0200 Subject: [searchisko-dev] How to speed up full contributors resync Message-ID: <94D598D9-F3AC-4744-8169-0D30790A58A8@redhat.com> Hi, I?m investigating how to get faster full resync form jive to searchisko. Jive performs not so bad - aproxx 25 users in 2 seconds which leads aprox 8.5 hours for 380.000 users. But the full sync task looks like 10 days. I checked production and looks like flush operation is very expensive - 5.7 hours (refresh 30 mins) so I focused where it is used. See here: https://github.com/searchisko/searchisko/blob/master/api/src/main/java/org/searchisko/api/service/ContributorService.java#L588 The searchClientService.performIndexFlushAndRefreshBlocking(SEARCH_INDEX_NAME); is called twice within same method. Isn?t second call redundant? (https://github.com/searchisko/searchisko/blob/master/api/src/main/java/org/searchisko/api/service/ContributorService.java#L656 ) Other question is where we?re with ES 1.4 with flush and refresh indices methods. Isn?t refresh enough? How it changed from ES 0.9 from time when the contributor service was implemented? Thanks, Libor Krzy?anek jboss.org Development Team -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.jboss.org/pipermail/searchisko-dev/attachments/20150717/729ba6f3/attachment.html From lkrzyzan at redhat.com Tue Jul 21 07:36:02 2015 From: lkrzyzan at redhat.com (=?utf-8?Q?Libor_Krzy=C5=BEanek?=) Date: Tue, 21 Jul 2015 13:36:02 +0200 Subject: [searchisko-dev] Openshift remote debugging Message-ID: <491B0F16-8288-4A64-8B9F-7A189CC006CC@redhat.com> Hi there, I've just added JPDA flag in openshift configuration so you can easily debug the instance. See docs: https://github.com/searchisko/searchisko/blob/master/documentation/development.md#remote-debugging-on-openshift Thanks, Libor Krzy?anek jboss.org Development Team -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.jboss.org/pipermail/searchisko-dev/attachments/20150721/1b6f1bb5/attachment-0001.html