[JBoss JIRA] (ISPN-2981) Infinispan as Lucene directory provider has "No sub-file with id .fnm found" errors in distributed mode
by Bryan Kelly (JIRA)
[ https://issues.jboss.org/browse/ISPN-2981?page=com.atlassian.jira.plugin.... ]
Bryan Kelly commented on ISPN-2981:
-----------------------------------
I have started consumption of infinispan with hibernate search today. Hibernate search version 4.5.0.Final which is dependent on infinispan 6.0.2.Final. The stack trace that we get is very similar to the one reported here. The configuration is similar other than we are using JGroups + TCP and stock infinispan configuration. We have a JMS setup to process index changes. When we run a single threaded test everything replicates find. However, when we run a test with 6 threads that purpose writes / changes to the index we get the stack trace above.
> Infinispan as Lucene directory provider has "No sub-file with id .fnm found" errors in distributed mode
> -------------------------------------------------------------------------------------------------------
>
> Key: ISPN-2981
> URL: https://issues.jboss.org/browse/ISPN-2981
> Project: Infinispan
> Issue Type: Feature Request
> Components: Core
> Affects Versions: 5.2.4.Final
> Environment: Hibernate Search 4.1.1, Hibernate Core 4.1.4, Lucene 3.5.0, Spring Framework 3.1.1
> Reporter: Christopher Wong
> Assignee: Mircea Markus
> Attachments: infinispan.cfg.xml, luceneindexerrors.txt
>
>
> I have been trying to use Infinispan as a Lucene directory provider under Hibernate Search. A single node writes to the index via JMS. A configuration that uses Infinispan in distributed mode seems to work under development, but under load results in an exception that looks like the following.
> Caused by: java.io.IOException: No sub-file with id .fnm found (fileName=_3.cfs files: [.fdt, .fdx])
> at org.apache.lucene.index.CompoundFileReader.openInput(CompoundFileReader.java:156)
> at org.apache.lucene.index.CompoundFileReader.openInput(CompoundFileReader.java:145)
> at org.apache.lucene.index.FieldInfos.<init>(FieldInfos.java:74)
> at org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:73)
> at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:115)
> at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:93)
> at org.apache.lucene.index.DirectoryReader.<init>(DirectoryReader.java:235)
> at org.apache.lucene.index.ReadOnlyDirectoryReader.<init>(ReadOnlyDirectoryReader.java:34)
> at org.apache.lucene.index.DirectoryReader.doOpenIfChanged(DirectoryReader.java:506)
> at org.apache.lucene.index.DirectoryReader.access$000(DirectoryReader.java:45)
> at org.apache.lucene.index.DirectoryReader$2.doBody(DirectoryReader.java:498)
> at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:754)
> at org.apache.lucene.index.DirectoryReader.doOpenNoWriter(DirectoryReader.java:493)
> at org.apache.lucene.index.DirectoryReader.doOpenIfChanged(DirectoryReader.java:450)
> at org.apache.lucene.index.DirectoryReader.doOpenIfChanged(DirectoryReader.java:391)
> at org.apache.lucene.index.IndexReader.openIfChanged(IndexReader.java:497)
> at org.apache.lucene.index.IndexReader.reopen(IndexReader.java:681)
> at org.hibernate.search.indexes.impl.SharingBufferReaderProvider$PerDirectoryLatestReader.refreshAndGet(SharingBufferReaderProvider.java:227)
> ... 117 more
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
10 years, 1 month
[JBoss JIRA] (ISPN-3877) SingleFileStore continues to consume space on the disk even if the free entries at end of the file are not in use. This space can be released back to the filesystem
by Dan Berindei (JIRA)
[ https://issues.jboss.org/browse/ISPN-3877?page=com.atlassian.jira.plugin.... ]
Dan Berindei updated ISPN-3877:
-------------------------------
Status: Resolved (was: Pull Request Sent)
Assignee: Dan Berindei (was: Galder Zamarreño)
Fix Version/s: 7.0.0.Alpha4
Resolution: Done
> SingleFileStore continues to consume space on the disk even if the free entries at end of the file are not in use. This space can be released back to the filesystem
> --------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: ISPN-3877
> URL: https://issues.jboss.org/browse/ISPN-3877
> Project: Infinispan
> Issue Type: Patch
> Components: Loaders and Stores
> Affects Versions: 6.0.0.Final
> Environment: Oracle JDK 1.7, Windows Server 2008 R2 x64
> Reporter: Rajesh Jangam
> Assignee: Dan Berindei
> Fix For: 7.0.0.Alpha4
>
> Attachments: PersistentQueue.java
>
>
> We are testing the latest Infinispan 6.0 SingleFileStore version for our application.
> We tend to create a lot of entries in the store and remove them when not required.
> However, what we have observed is that the size of the file keeps on increasing as more data is being added/removed and that it does not get reclaimed.
>
> This was not seen with earlier versions like 5.3.0. There the size of the cache folder would reduce as entries got removed.
> We have attempted to create a fix for this issue and tested it in our environment. It keeps the space usage under control as compared to the original implementation.
> As a part of this fix, we truncate the file (as a part of purge cycle) if there are free entries found towards the end of the file. Also these free entries are removed from the freeList.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
10 years, 1 month
[JBoss JIRA] (ISPN-4187) LRU eviction algorithm does not evict the eldest entry
by William Burns (JIRA)
[ https://issues.jboss.org/browse/ISPN-4187?page=com.atlassian.jira.plugin.... ]
Work on ISPN-4187 started by William Burns.
> LRU eviction algorithm does not evict the eldest entry
> ------------------------------------------------------
>
> Key: ISPN-4187
> URL: https://issues.jboss.org/browse/ISPN-4187
> Project: Infinispan
> Issue Type: Bug
> Components: Eviction
> Affects Versions: 7.0.0.Alpha2
> Reporter: Martin Gencur
> Assignee: William Burns
> Attachments: server2.log
>
>
> The following test for JDBC cache stores fails:
> {code:java}
> @Test
> @WithRunningServer({@RunningServer(name = CONTAINER1, config = CONFIG_FETCH_STATE_1)})
> public void testFetchState() throws Exception {
> try {
> mc1 = createMemcachedClient(server1);
> assertCleanCacheAndStore1();
> mc1.set("k1", "v1");
> mc1.set("k2", "v2");
> mc1.set("k3", "v3");
> assertNotNull(dbServer1.stringTable.getValueByKey("k1"));
> startContainer(controller, CONTAINER2, CONFIG_FETCH_STATE_2);
> mc2 = createMemcachedClient(server2);
> assertTrue(0 < server2.getCacheManager(MANAGER_NAME).getCache(CACHE_NAME).getNumberOfEntries());
> //the cache store should fetch state from the others
> //since eviction.max-entries==2, first k2 and k3 is loaded from the other cache, then k1 is loaded
> //from the other cache's loader and thus k2 is evicted and ends up in a cache loader
> assertNull(dbServer2.stringTable.getValueByKey("k1"));
> assertEquals("v1", mc2.get("k1"));
> assertEquals("v2", mc2.get("k2"));
> assertNull(dbServer2.stringTable.getValueByKey("k1"));
> //^^^^^fails here, the K1 was evicted even though it was used recently
> //K3 was supposed to be evicted but it did not happen
> assertNull(dbServer2.stringTable.getValueByKey("k2"));
> assertCleanCacheAndStore2();
> } finally {
> controller.stop(CONTAINER2);
> }
> }
> {code}
> This tests works properly if the following commit is reverted, so it was caused by this commit:
> https://github.com/infinispan/infinispan/commit/b190230d84beb41474bae0239...
> Note that there's another commit with the same name but different commit hash: b71da1c
> The test above can be run from https://github.com/chepa653/infinispan/tree/t_ISPN-3904 by going to server/integration/testsuite and running mvn clean verify -Dtest=StringBasedStoreMultinodeTest#testFetchState -Dlog.level.infinispan=TRACE
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
10 years, 1 month
[JBoss JIRA] (ISPN-4222) Add support for distributed entry iterator
by William Burns (JIRA)
William Burns created ISPN-4222:
-----------------------------------
Summary: Add support for distributed entry iterator
Key: ISPN-4222
URL: https://issues.jboss.org/browse/ISPN-4222
Project: Infinispan
Issue Type: Feature Request
Components: Core
Reporter: William Burns
Assignee: William Burns
Fix For: 7.0.0.Final
ISPN-4068 requires the need of being able to iterate over all entries found in the cache, irrespective of it is a distributed cache and with or without a loader/store. This jira is to cover adding that support.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
10 years, 1 month