[infinispan-issues] [JBoss JIRA] (ISPN-5622) Make use of parallel iteration in the MassIndexer

Sanne Grinovero (JIRA) issues at jboss.org
Wed Aug 12 06:35:02 EDT 2015


    [ https://issues.jboss.org/browse/ISPN-5622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13097554#comment-13097554 ] 

Sanne Grinovero commented on ISPN-5622:
---------------------------------------

Right but that type of contention isn't a big problem, if any it means the indexing couldn't be faster than what you achieved. I expect it to be strongly beneficial for distributed data?

Also to keep in mind: the {{indexwriter.max_thread_states}} property - although it defaults to 8 so probably not related to your test.

I think there was a plan for Lucene 5 to drop that limit, we'll need to check if that was done too -> HSEARCH-1962

> Make use of parallel iteration in the MassIndexer
> -------------------------------------------------
>
>                 Key: ISPN-5622
>                 URL: https://issues.jboss.org/browse/ISPN-5622
>             Project: Infinispan
>          Issue Type: Enhancement
>          Components: Embedded Querying
>            Reporter: Gustavo Fernandes
>            Assignee: Gustavo Fernandes
>
> As the EntryRetriever is being deprecated, there's a possibility of speeding up the indexing process by using parallel streams 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


More information about the infinispan-issues mailing list