[JBoss JIRA] (ISPN-12038) RocksDB compression options incomplete and incorrectly applied
by Tristan Tarrant (Jira)
[ https://issues.redhat.com/browse/ISPN-12038?page=com.atlassian.jira.plugi... ]
Tristan Tarrant updated ISPN-12038:
-----------------------------------
Status: Open (was: New)
> RocksDB compression options incomplete and incorrectly applied
> --------------------------------------------------------------
>
> Key: ISPN-12038
> URL: https://issues.redhat.com/browse/ISPN-12038
> Project: Infinispan
> Issue Type: Bug
> Components: Loaders and Stores
> Affects Versions: 11.0.0.Final
> Reporter: Tristan Tarrant
> Assignee: Tristan Tarrant
> Priority: Major
> Fix For: 11.0.1.Final
>
>
> The RocksDB store compression configuration has several issues:
> * it uses string names which are not in sync with the library
> * some new compression options are missing (XPRESS and ZSTD)
> * the free-form properties for setting compression are always overwritten with the default store setting (NONE)
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
5 years, 9 months
[JBoss JIRA] (ISPN-12038) RocksDB compression options incomplete and incorrectly applied
by Tristan Tarrant (Jira)
Tristan Tarrant created ISPN-12038:
--------------------------------------
Summary: RocksDB compression options incomplete and incorrectly applied
Key: ISPN-12038
URL: https://issues.redhat.com/browse/ISPN-12038
Project: Infinispan
Issue Type: Bug
Components: Loaders and Stores
Affects Versions: 11.0.0.Final
Reporter: Tristan Tarrant
Assignee: Tristan Tarrant
Fix For: 11.0.1.Final
The RocksDB store compression configuration has several issues:
* it uses string names which are not in sync with the library
* some new compression options are missing (XPRESS and ZSTD)
* the free-form properties for setting compression are always overwritten with the default store setting (NONE)
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
5 years, 9 months
[JBoss JIRA] (ISPN-12037) JUnit-friendly replacement for MultipleCacheManagerTest
by Dan Berindei (Jira)
Dan Berindei created ISPN-12037:
-----------------------------------
Summary: JUnit-friendly replacement for MultipleCacheManagerTest
Key: ISPN-12037
URL: https://issues.redhat.com/browse/ISPN-12037
Project: Infinispan
Issue Type: Task
Components: Core, Test Suite
Affects Versions: 11.0.0.Final
Reporter: Dan Berindei
Assignee: Dan Berindei
Fix For: 12.0.0.Final
Core tests that need one more more cache managers extend either {{SingleCacheManagerTest}} or {{MultipleCacheManagersTest}}. Many other modules' tests do the same for convenience.
We would like to eventually move all modules to JUnit, and having an alternative to MCMT that can be used from either JUnit or TestNG and can support an incremental migration is the first step.
The starting plan is for a {{TestCluster}} class for building and interacting with clusters including features from MCMT/TestingUtil/TestCacheManagerFactory/BasePartitionHandlingTest.
Assertions like {{assertLocked()}}, {{assertIsInL1()}} etc. would be in separate classes, ideally with AssertJ-like {{assertThat}} static methods.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
5 years, 9 months
[JBoss JIRA] (ISPN-12036) Automatic SerializationContextInitializer registration
by Tristan Tarrant (Jira)
Tristan Tarrant created ISPN-12036:
--------------------------------------
Summary: Automatic SerializationContextInitializer registration
Key: ISPN-12036
URL: https://issues.redhat.com/browse/ISPN-12036
Project: Infinispan
Issue Type: Enhancement
Components: Configuration
Reporter: Tristan Tarrant
Assignee: Tristan Tarrant
Fix For: 12.0.0.Final
For usability and convenience, we should toggle the service attribute of the AutoProtoSchemaBuilder annotation to true so that service files are always generated.
ProtobufMetadataManagerImpl should then automatically scan for services and register them.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
5 years, 9 months
[JBoss JIRA] (ISPN-12035) RocksDB Options do not work with RocksDB examples
by Michael Burman (Jira)
Michael Burman created ISPN-12035:
-------------------------------------
Summary: RocksDB Options do not work with RocksDB examples
Key: ISPN-12035
URL: https://issues.redhat.com/browse/ISPN-12035
Project: Infinispan
Issue Type: Bug
Components: Loaders and Stores
Reporter: Michael Burman
RocksDB examples and configurations use a method to indicate the size in multiples, such as:
db_options.db_write_buffer_size = 64 << 30;
Or for example 512 * 1024 * 1024. This does not work with Infinispan, setting:
<property name="database.db_write_buffer_size">268435456</property>
vs
<property name="database.db_write_buffer_size">256 * 1024 * 1024</property>
Ends with different result in the RocksDB, with only the first one working and the latter one causing the size to be 256 bytes instead.
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
5 years, 9 months
[JBoss JIRA] (ISPN-11641) JVM crashed. SIGSEGV in org.rocksdb.RocksIterator.next0
by Dan Berindei (Jira)
[ https://issues.redhat.com/browse/ISPN-11641?page=com.atlassian.jira.plugi... ]
Dan Berindei commented on ISPN-11641:
-------------------------------------
Looks like [https://github.com/facebook/rocksdb/issues/5234]
[~william.burns] could we somehow cancel all in-progress cache iterations/publishers as the first step of cache.stop()? Or maybe there's something simpler we can do just for RocksDBStore, since the other stores can catch any exception an replace it with an {{IllegalLifecycleStateException}}?
> JVM crashed. SIGSEGV in org.rocksdb.RocksIterator.next0
> -------------------------------------------------------
>
> Key: ISPN-11641
> URL: https://issues.redhat.com/browse/ISPN-11641
> Project: Infinispan
> Issue Type: Bug
> Components: Loaders and Stores
> Affects Versions: 9.4.16.Final
> Reporter: Sergey Morgunov
> Priority: Major
> Attachments: crash.log
>
>
> *JRE*: OpenJDK 8u222.
> Crash log attached. (crash.log)
> Cache configuration:
> {code:xml}
> <distributed-cache name="sessions" configuration="sessionsConfiguration">
> <memory>
> <object size="100000" strategy="REMOVE"/>
> </memory>
> <persistence passivation="false">
> <rocksdb-store path="cache/warm/" preload="true" fetch-state="true">
> <expiration path="cache/expired/"/>
> </rocksdb-store>
> </persistence>
> </distributed-cache>
> {code}
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
5 years, 9 months
[JBoss JIRA] (ISPN-9411) Shutdown process hangs on same cache each time
by Dan Berindei (Jira)
[ https://issues.redhat.com/browse/ISPN-9411?page=com.atlassian.jira.plugin... ]
Dan Berindei closed ISPN-9411.
------------------------------
Fix Version/s: 10.1.0.Final
Resolution: Done
The RocksDBStore expiration queue was removed in 10.1.0 (ISPN-10963)
> Shutdown process hangs on same cache each time
> ----------------------------------------------
>
> Key: ISPN-9411
> URL: https://issues.redhat.com/browse/ISPN-9411
> Project: Infinispan
> Issue Type: Bug
> Affects Versions: 9.2.4.Final, 9.3.1.Final
> Environment: Linux, cluster with two nodes
> Reporter: Sergey Chernolyas
> Priority: Major
> Fix For: 10.1.0.Final
>
> Attachments: filestore_931_stack.txt, server_log.txt, server_log_for_infinispan_931_hang.txt, shutdown_10540_931.txt, shutdown_15226_931.txt, shutdown_7181_924.txt, shutdown_7252_924.txt
>
>
> Each time, shutdown process hangs on same cache.
> Configuration of the caches are:
> {code:title=Cache configurations|linenumbers=true|language=XML}
> <distributed-cache name="ACCESSORIES" owners="2" segments="1024" mode="SYNC">
> <state-transfer await-initial-transfer="true" enabled="true" timeout="2400000" chunk-size="2048"/>
> <partition-handling when-split="ALLOW_READ_WRITES" merge-policy="PREFERRED_ALWAYS"/>
> <memory>
> <object size="1000000" strategy="REMOVE"/>
> </memory>
> <indexing index="LOCAL">
> <property name="default.directory_provider">infinispan</property>
> <property name="default.indexmanager">org.infinispan.query.indexmanager.InfinispanIndexManager
> </property>
> <property name="default.worker.execution">async</property>
> <property name="default.index_flush_interval">500</property>
> <property name="default.indexwriter.merge_factor">30</property>
> <property name="default.indexwriter.merge_max_size">1024</property>
> <property name="default.indexwriter.ram_buffer_size">256</property>
> <property name="default.locking_cachename">LuceneIndexesLocking_accessories</property>
> <property name="default.data_cachename">LuceneIndexesData_accessories</property>
> <property name="default.metadata_cachename">LuceneIndexesMetadata_accessories</property>
> </indexing>
> <rocksdb-store preload="true" path="/data/rocksdb/accessories/data">
> <expiration path="/data/rocksdb/accessories/expired"/>
> </rocksdb-store>
> </distributed-cache>
> <distributed-cache name="LuceneIndexesData_accessories">
> <state-transfer await-initial-transfer="true" enabled="true" timeout="2400000" chunk-size="2048"/>
> <partition-handling when-split="ALLOW_READ_WRITES" merge-policy="PREFERRED_ALWAYS"/>
> <rocksdb-store preload="true" fetch-state="true" passivation="true" name="accessories_index_data" path="/data/rocksdb/accessories_index_data/data">
> <expiration path="/data/rocksdb/accessories_index_data/expired"/>
> </rocksdb-store>
> </distributed-cache>
> {code}
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
5 years, 9 months
[JBoss JIRA] (ISPN-12032) JCache cache loader should not require marshalling
by Dan Berindei (Jira)
[ https://issues.redhat.com/browse/ISPN-12032?page=com.atlassian.jira.plugi... ]
Dan Berindei updated ISPN-12032:
--------------------------------
Status: Open (was: New)
> JCache cache loader should not require marshalling
> --------------------------------------------------
>
> Key: ISPN-12032
> URL: https://issues.redhat.com/browse/ISPN-12032
> Project: Infinispan
> Issue Type: Bug
> Components: JCache, Loaders and Stores
> Affects Versions: 11.0.0.Final, 10.1.8.Final
> Reporter: Dan Berindei
> Priority: Major
> Fix For: 12.0.0.Final
>
>
> {{JCacheLoaderAdapter}} wraps the value returned by JCache {{CacheLoader.load()}} using a {{MarshalledEntryFactoryImpl.create()}} overload that eagerly marshalls the key+value+metadata. This is unnecessary work, because the created {{MarshallableEntryImpl}} only needs the key+value+metadata in storage format.
>
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
5 years, 9 months
[JBoss JIRA] (ISPN-12032) JCache cache loader should not require marshalling
by Dan Berindei (Jira)
[ https://issues.redhat.com/browse/ISPN-12032?page=com.atlassian.jira.plugi... ]
Dan Berindei reassigned ISPN-12032:
-----------------------------------
Assignee: Dan Berindei
> JCache cache loader should not require marshalling
> --------------------------------------------------
>
> Key: ISPN-12032
> URL: https://issues.redhat.com/browse/ISPN-12032
> Project: Infinispan
> Issue Type: Bug
> Components: JCache, Loaders and Stores
> Affects Versions: 11.0.0.Final, 10.1.8.Final
> Reporter: Dan Berindei
> Assignee: Dan Berindei
> Priority: Major
> Fix For: 12.0.0.Final
>
>
> {{JCacheLoaderAdapter}} wraps the value returned by JCache {{CacheLoader.load()}} using a {{MarshalledEntryFactoryImpl.create()}} overload that eagerly marshalls the key+value+metadata. This is unnecessary work, because the created {{MarshallableEntryImpl}} only needs the key+value+metadata in storage format.
>
--
This message was sent by Atlassian Jira
(v7.13.8#713008)
5 years, 9 months