[hibernate-issues] [Hibernate-JIRA] Commented: (HSEARCH-1019) Profile mass indexer to reduce number of index commits

[Sanne Grinovero (JIRA)]

    [ http://opensource.atlassian.com/projects/hibernate/browse/HSEARCH-1019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=45009#comment-45009 ] 

Sanne Grinovero commented on HSEARCH-1019:
------------------------------------------

Hi Guillaume,
yes I've deployed a fresh 4.1.0-SNAPSHOT to the Maven repository (after Hardy merged this in master)

The numbers above refer to an ext4 partition using default settings - but if you want to try to experiment with the write barriers, these are the "tuned" settings I usually use on the SSD drive on the laptop:
rw,noatime,commit=60,max_batch_time=0,barrier=0,data=writeback

These should provide better performance (that's why I use them for coding), but I don't suggest using them in a production system: I'm not a filesystems expert, have just been playing with them especially because of the write barriers you mention.

> Profile mass indexer to reduce number of index commits
> ------------------------------------------------------
>
>                 Key: HSEARCH-1019
>                 URL: http://opensource.atlassian.com/projects/hibernate/browse/HSEARCH-1019
>             Project: Hibernate Search
>          Issue Type: Improvement
>          Components: massindexer
>    Affects Versions: 4.0.0.Final
>            Reporter: Hardy Ferentschik
>            Assignee: Sanne Grinovero
>            Priority: Blocker
>             Fix For: 4.1.0.Alpha1
>
>
> We need to profile the new mass indexer design and try to reduce the number of index commits. Performance of the filesystem based directory declined to a bug fix in Lucene (https://issues.apache.org/jira/browse/LUCENE-3418). Trying to reduce the amount of index commits (and hence fsync calls) might alleviate the performance loss. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira