[hibernate-issues] [Hibernate-JIRA] Commented: (HSEARCH-1019) Profile mass indexer to reduce number of index commits

[Guillaume Smet (JIRA)]

    [ http://opensource.atlassian.com/projects/hibernate/browse/HSEARCH-1019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=45008#comment-45008 ] 

Guillaume Smet commented on HSEARCH-1019:
-----------------------------------------

Hi Sanne,

Very promising numbers. Is there a snapshot we can test somewhere so that we also test your patch on standard hard drives?

FYI, Laurent did some further testing to understand the difference between his laptop and mine (see numbers above: Lucene 3.4 is 20x slower for him whereas it is only 3x slower on my laptop): this is due to write barriers being enabled by default even for ext3 on the newest Linux kernels - >= 3.1 - (and they also are enabled by default on ext4). I still have ext3 with an old kernel and that's why they are disabled on my laptop.

-- 
Guillaume

> Profile mass indexer to reduce number of index commits
> ------------------------------------------------------
>
>                 Key: HSEARCH-1019
>                 URL: http://opensource.atlassian.com/projects/hibernate/browse/HSEARCH-1019
>             Project: Hibernate Search
>          Issue Type: Improvement
>          Components: massindexer
>    Affects Versions: 4.0.0.Final
>            Reporter: Hardy Ferentschik
>            Assignee: Sanne Grinovero
>            Priority: Blocker
>             Fix For: 4.1.0.Alpha1
>
>
> We need to profile the new mass indexer design and try to reduce the number of index commits. Performance of the filesystem based directory declined to a bug fix in Lucene (https://issues.apache.org/jira/browse/LUCENE-3418). Trying to reduce the amount of index commits (and hence fsync calls) might alleviate the performance loss. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira