[infinispan-issues] [JBoss JIRA] (ISPN-10581) Segmented Store can get stuck with bulk write

[Ryan Emerson (Jira)]

Ryan Emerson created ISPN-10581:
-----------------------------------

             Summary: Segmented Store can get stuck with bulk write
                 Key: ISPN-10581
                 URL: https://issues.jboss.org/browse/ISPN-10581
             Project: Infinispan
          Issue Type: Bug
          Components: Loaders and Stores
    Affects Versions: 10.0.0.Alpha3
            Reporter: Will Burns
            Assignee: Will Burns
             Fix For: 10.0.0.Beta4, 10.0.0.CR2


The code was refactored in ComposedSegmentedLoadWriteStore to be more non blocking friendly. Unfortunately due to how groupBy and flatMap interact it is possible for the bulkUpdate to never complete.

FlatMap by default sets  a parallelism level of 128. this means it will request 128 groups from groupBy, but unfortunately if there are more than 128 groups, it will never complete as groupBy must publish all groups before a single one can complete. Thus any time we use flatMap after a groupBy we must either set the parallelism level to Integer.MAX_VALUE or to an explicit value if we know how many groups at max there will be.



--
This message was sent by Atlassian Jira
(v7.13.5#713005)