[ https://issues.jboss.org/browse/ISPN-9003?page=com.atlassian.jira.plugin.... ] William Burns edited comment on ISPN-9003 at 4/3/18 1:12 PM: ------------------------------------------------------------- Talking with [~NadirX] we believe the best approach may be a consensus based removal of maxIdle entries. That is it will do the following things 1. Read occurs on node where maxIdle is expired and sends request to primary owner (blocks the read) 2. Primary owner locks the key 3. Primary sends message to all nodes asking if entry is expired due to maxIdle -(also updates the updated time on all keys - just in case it isn't expired)- 4. Primary receives responses to decide if it is expired 5a. Primary responds to read node and tells them if it was expired 5b. Primary removes from all nodes if it was expired or sends request to all nodes to update last access time (reaper updates to largest access and read updates every node to now + maxIdle). 6. Cluster wide expiration occurs if necessary allowing for listeners to be invoked (including cluster listeners - which we didn't do before) The above approach gives no overhead for reads when the entry is not present and is not expired. The only overhead is if a node finds that the entry was expired via maxIdle and then must block to confirm if it should be removed. However the chance of this occurring seems a bit low depending on what maxIdle was set to. If the expiration reaper finds the expired entry first it will properly update its timestamps or remove as needed. Another side effect of this is that maxIdle may be refreshed for all entries that are transferred via state transfer since I don't think the access time is currently replicated when state transfer occurs. was (Author: william.burns): Talking with [~NadirX] we believe the best approach may be a consensus based removal of maxIdle entries. That is it will do the following things 1. Read occurs on node where maxIdle is expired and sends request to primary owner (blocks the read) 2. Primary owner locks the key 3. Primary sends message to all nodes asking if entry is expired due to maxIdle -(also updates the updated time on all keys - just in case it isn't expired)- 4. Primary receives responses to decide if it is expired 5a. Primary responds to read node and tells them if it was expired 5b. Primary removes from all nodes if it was expired or sends request to all nodes to update last access time. 6. Cluster wide expiration occurs if necessary allowing for listeners to be invoked (including cluster listeners - which we didn't do before) The above approach gives no overhead for reads when the entry is not present and is not expired. The only overhead is if a node finds that the entry was expired via maxIdle and then must block to confirm if it should be removed. However the chance of this occurring seems a bit low depending on what maxIdle was set to. If the expiration reaper finds the expired entry first it will properly update its timestamps or remove as needed. Another side effect of this is that maxIdle may be refreshed for all entries that are transferred via state transfer since I don't think the access time is currently replicated when state transfer occurs. -- This message was sent by Atlassian JIRA (v7.5.0#75005)