Indexing: Read past EOF ----------------------- Key: ISPN-4577 URL: https://issues.jboss.org/browse/ISPN-4577 Project: Infinispan Issue Type: Bug Security Level: Public(Everyone can see) Components: Embedded Querying Affects Versions: 6.0.1.Final Reporter: Radim Vansa Assignee: Sanne Grinovero Priority: Critical When starting a cluster of 2 nodes with distributed cache configured to index to Infinispan, on the second I get this exception: {code} org.hibernate.search.SearchException: HSEARCH000103: Unable to initialize IndexManager org.infinispan.query.remote.indexing.ProtobufValueWrapper at org.hibernate.search.indexes.impl.IndexManagerHolder.createIndexManager(IndexManagerHolder.java:265) at org.hibernate.search.indexes.impl.IndexManagerHolder.createIndexManager(IndexManagerHolder.java:528) at org.hibernate.search.indexes.impl.IndexManagerHolder.createIndexManagers(IndexManagerHolder.java:495) at org.hibernate.search.indexes.impl.IndexManagerHolder.buildEntityIndexBinding(IndexManagerHolder.java:104) at org.hibernate.search.spi.SearchFactoryBuilder.initDocumentBuilders(SearchFactoryBuilder.java:359) at org.hibernate.search.spi.SearchFactoryBuilder.buildNewSearchFactory(SearchFactoryBuilder.java:217) at org.hibernate.search.spi.SearchFactoryBuilder.buildSearchFactory(SearchFactoryBuilder.java:141) at org.infinispan.query.impl.LifecycleManager.getSearchFactory(LifecycleManager.java:213) at org.infinispan.query.impl.LifecycleManager.cacheStarting(LifecycleManager.java:73) at org.infinispan.factories.ComponentRegistry.notifyCacheStarting(ComponentRegistry.java:228) at org.infinispan.factories.ComponentRegistry.start(ComponentRegistry.java:214) at org.infinispan.CacheImpl.start(CacheImpl.java:675) at org.infinispan.manager.DefaultCacheManager.wireAndStartCache(DefaultCacheManager.java:553) at org.infinispan.manager.DefaultCacheManager.createCache(DefaultCacheManager.java:516) at org.infinispan.manager.DefaultCacheManager.getCache(DefaultCacheManager.java:398) at (my application stack) Caused by: org.hibernate.search.SearchException: Could not initialize index at org.hibernate.search.store.impl.DirectoryProviderHelper.initializeIndexIfNeeded(DirectoryProviderHelper.java:162) at org.hibernate.search.infinispan.impl.InfinispanDirectoryProvider.start(InfinispanDirectoryProvider.java:103) at org.hibernate.search.indexes.impl.DirectoryBasedIndexManager.initialize(DirectoryBasedIndexManager.java:103) at org.hibernate.search.indexes.impl.IndexManagerHolder.createIndexManager(IndexManagerHolder.java:261) ... 23 more Caused by: java.io.IOException: Read past EOF at org.infinispan.lucene.impl.SingleChunkIndexInput.readByte(SingleChunkIndexInput.java:54) at org.apache.lucene.store.ChecksumIndexInput.readByte(ChecksumIndexInput.java:41) at org.apache.lucene.store.DataInput.readInt(DataInput.java:86) at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:272) at org.apache.lucene.index.IndexFileDeleter.<init>(IndexFileDeleter.java:182) at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:1168) at org.hibernate.search.store.impl.DirectoryProviderHelper.initializeIndexIfNeeded(DirectoryProviderHelper.java:157) ... 26 more {code} Here is the configuration: {code} <?xml version="1.0" encoding="UTF-8"?> <infinispan xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="urn:infinispan:config:6.0 http://www.infinispan.org/schemas/infinispan-config-6.0.xsd" xmlns="urn:infinispan:config:6.0"> <global> <transport clusterName="default" distributedSyncTimeout="600000"> <properties> <property name="configurationFile" value="${infinispan.jgroups.config:jgroups-udp-custom.xml}"/> </properties> </transport> </global> <default/> <namedCache name="dist_lucene"> <transaction transactionMode="NON_TRANSACTIONAL"/> <clustering mode="DIST"> <hash numOwners="2" /> </clustering> <locking lockAcquisitionTimeout="3000" concurrencyLevel="1000" /> <indexing enabled="true" indexLocalOnly="true"> <properties> <property name="default.indexmanager" value="org.infinispan.query.indexmanager.InfinispanIndexManager" /> <property name="default.exclusive_index_use" value="false" /> <property name="default.metadata_cachename" value="lucene_metadata_repl" /> <property name="default.data_cachename" value="lucene_data_dist" /> <property name="default.locking_cachename" value="lucene_locking_repl" /> <property name="lucene_version" value="LUCENE_36" /> </properties> </indexing> </namedCache> <namedCache name="lucene_metadata_repl"> <clustering mode="REPL"> <sync replTimeout="30000" /> </clustering> </namedCache> <namedCache name="lucene_data_repl"> <clustering mode="DIST"> <hash numOwners="2" /> <sync replTimeout="30000" /> </clustering> </namedCache> <namedCache name="lucene_locking_repl"> <clustering mode="REPL"> <sync replTimeout="30000" /> </clustering> </namedCache> </infinispan> {code} I was not able to locate the root cause though I can replicate the issue all the time.