[infinispan-issues] [JBoss JIRA] (ISPN-9411) Shutdown process hangs on same cache each time

[William Burns (JIRA)]

    [ https://issues.jboss.org/browse/ISPN-9411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13622052#comment-13622052 ] 

William Burns commented on ISPN-9411:
-------------------------------------

This is caused due to having passivation enabled with an eviction size of 1M elements. During passivation of all entries the writes get blocked by the expiration queue in RocksDB which is default configured at only 1000 elements. Thus it would take at least 1000! minutes to shut down as the reaper has to run each time to allow for 1000 more writes. The RocksDB should shut down irrespective of the expiration queue as everything is getting dumped anyways.

> Shutdown process hangs on same cache each time
> ----------------------------------------------
>
>                 Key: ISPN-9411
>                 URL: https://issues.jboss.org/browse/ISPN-9411
>             Project: Infinispan
>          Issue Type: Bug
>    Affects Versions: 9.2.4.Final, 9.3.1.Final
>         Environment: Linux, cluster with two nodes
>            Reporter: Sergey Chernolyas
>         Attachments: server_log.txt, shutdown_10540_931.txt, shutdown_15226_931.txt, shutdown_7181_924.txt, shutdown_7252_924.txt
>
>
> Each time, shutdown process hangs on same cache.
> Configuration of the caches are:
> {code:title=Cache configurations|linenumbers=true|language=XML}
> <distributed-cache name="ACCESSORIES" owners="2" segments="1024"  mode="SYNC">
>                     <state-transfer await-initial-transfer="true" enabled="true" timeout="2400000" chunk-size="2048"/>
>                     <partition-handling when-split="ALLOW_READ_WRITES" merge-policy="PREFERRED_ALWAYS"/>
>                     <memory>
>                         <object size="1000000" strategy="REMOVE"/>
>                     </memory>
>                     <indexing index="LOCAL">
>                         <property name="default.directory_provider">infinispan</property>
>                         <property name="default.indexmanager">org.infinispan.query.indexmanager.InfinispanIndexManager
>                         </property>
>                         <property name="default.worker.execution">async</property>
>                         <property name="default.index_flush_interval">500</property>
>                         <property name="default.indexwriter.merge_factor">30</property>
>                         <property name="default.indexwriter.merge_max_size">1024</property>
>                         <property name="default.indexwriter.ram_buffer_size">256</property>
>                         <property name="default.locking_cachename">LuceneIndexesLocking_accessories</property>
>                         <property name="default.data_cachename">LuceneIndexesData_accessories</property>
>                         <property name="default.metadata_cachename">LuceneIndexesMetadata_accessories</property>
>                     </indexing>
>                     <rocksdb-store preload="true" path="/data/rocksdb/accessories/data">
>                         <expiration path="/data/rocksdb/accessories/expired"/>
>                     </rocksdb-store>
>                 </distributed-cache>
> <distributed-cache name="LuceneIndexesData_accessories">
>                     <state-transfer await-initial-transfer="true" enabled="true" timeout="2400000" chunk-size="2048"/>
>                     <partition-handling when-split="ALLOW_READ_WRITES" merge-policy="PREFERRED_ALWAYS"/>
>                     <rocksdb-store preload="true" fetch-state="true" passivation="true" name="accessories_index_data" path="/data/rocksdb/accessories_index_data/data">
>                         <expiration path="/data/rocksdb/accessories_index_data/expired"/>
>                     </rocksdb-store>
>                 </distributed-cache>
> {code}



--
This message was sent by Atlassian JIRA
(v7.5.0#75005)