[JBoss JIRA] (ISPN-7186) SFS Avoid Reading Index if Purge on startup is enabled
by Ryan Emerson (Jira)
[ https://issues.jboss.org/browse/ISPN-7186?page=com.atlassian.jira.plugin.... ]
Ryan Emerson updated ISPN-7186:
-------------------------------
Status: Pull Request Sent (was: Open)
Git Pull Request: https://github.com/infinispan/infinispan/pull/6381
> SFS Avoid Reading Index if Purge on startup is enabled
> ------------------------------------------------------
>
> Key: ISPN-7186
> URL: https://issues.jboss.org/browse/ISPN-7186
> Project: Infinispan
> Issue Type: Bug
> Components: Loaders and Stores
> Affects Versions: 8.2.2.Final
> Reporter: Elias Ross
> Assignee: Ryan Emerson
> Priority: Major
> Fix For: 10.0.0.Alpha1, 9.4.2.Final
>
>
> I've observed the following error, which periodically happens when the application restarts.
> This is likely due to a non-clean shutdown truncating the file. Ideally Inifinispan can simply truncate or skip such entries without blocking start-up
> Caused by: org.infinispan.persistence.spi.PersistenceException: org.infinispan.persistence.spi.PersistenceException: ISPN000279: Failed to re
> ad stored entries from file. Error in file raster.dat at offset 4
> at org.infinispan.persistence.file.SingleFileStore.start(SingleFileStore.java:135) ~[org.infinispan-infinispan-core-8.2.2.Final.jar:8
> .2.2.Final]
> at org.infinispan.persistence.manager.PersistenceManagerImpl.start(PersistenceManagerImpl.java:144) ~[org.infinispan-infinispan-core-
> 8.2.2.Final.jar:8.2.2.Final]
> ... 115 common frames omitted
> Caused by: org.infinispan.persistence.spi.PersistenceException: ISPN000279: Failed to read stored entries from file. Error in file raster.dat at offset 4
> at org.infinispan.persistence.file.SingleFileStore.rebuildIndex(SingleFileStore.java:195) ~[org.infinispan-infinispan-core-8.2.2.Fina
> l.jar:8.2.2.Final]
> at org.infinispan.persistence.file.SingleFileStore.start(SingleFileStore.java:126) ~[org.infinispan-infinispan-core-8.2.2.Final.jar:8
> .2.2.Final]
> ... 116 common frames omitted
--
This message was sent by Atlassian Jira
(v7.12.1#712002)
7 years, 5 months
[JBoss JIRA] (ISPN-7186) SFS Avoid Reading Index if Purge on startup is enabled
by Ryan Emerson (Jira)
[ https://issues.jboss.org/browse/ISPN-7186?page=com.atlassian.jira.plugin.... ]
Ryan Emerson updated ISPN-7186:
-------------------------------
Fix Version/s: 10.0.0.Alpha1
9.4.2.Final
Sprint: Sprint 10.0.0.Alpha1
> SFS Avoid Reading Index if Purge on startup is enabled
> ------------------------------------------------------
>
> Key: ISPN-7186
> URL: https://issues.jboss.org/browse/ISPN-7186
> Project: Infinispan
> Issue Type: Bug
> Components: Loaders and Stores
> Affects Versions: 8.2.2.Final
> Reporter: Elias Ross
> Assignee: Ryan Emerson
> Priority: Major
> Fix For: 10.0.0.Alpha1, 9.4.2.Final
>
>
> I've observed the following error, which periodically happens when the application restarts.
> This is likely due to a non-clean shutdown truncating the file. Ideally Inifinispan can simply truncate or skip such entries without blocking start-up
> Caused by: org.infinispan.persistence.spi.PersistenceException: org.infinispan.persistence.spi.PersistenceException: ISPN000279: Failed to re
> ad stored entries from file. Error in file raster.dat at offset 4
> at org.infinispan.persistence.file.SingleFileStore.start(SingleFileStore.java:135) ~[org.infinispan-infinispan-core-8.2.2.Final.jar:8
> .2.2.Final]
> at org.infinispan.persistence.manager.PersistenceManagerImpl.start(PersistenceManagerImpl.java:144) ~[org.infinispan-infinispan-core-
> 8.2.2.Final.jar:8.2.2.Final]
> ... 115 common frames omitted
> Caused by: org.infinispan.persistence.spi.PersistenceException: ISPN000279: Failed to read stored entries from file. Error in file raster.dat at offset 4
> at org.infinispan.persistence.file.SingleFileStore.rebuildIndex(SingleFileStore.java:195) ~[org.infinispan-infinispan-core-8.2.2.Fina
> l.jar:8.2.2.Final]
> at org.infinispan.persistence.file.SingleFileStore.start(SingleFileStore.java:126) ~[org.infinispan-infinispan-core-8.2.2.Final.jar:8
> .2.2.Final]
> ... 116 common frames omitted
--
This message was sent by Atlassian Jira
(v7.12.1#712002)
7 years, 5 months
[JBoss JIRA] (ISPN-8691) Infinispan rejects to read cache file bigger than 2147483647 (Integer.MAX_VALUE)
by Ryan Emerson (Jira)
[ https://issues.jboss.org/browse/ISPN-8691?page=com.atlassian.jira.plugin.... ]
Ryan Emerson closed ISPN-8691.
------------------------------
Resolution: Explained
Closing as the cause of the issue appears to be a corrupt file. https://issues.jboss.org/browse/ISPN-7186 will ensure that we don't try to rebuild the index if purge is set to true.
> Infinispan rejects to read cache file bigger than 2147483647 (Integer.MAX_VALUE)
> --------------------------------------------------------------------------------
>
> Key: ISPN-8691
> URL: https://issues.jboss.org/browse/ISPN-8691
> Project: Infinispan
> Issue Type: Bug
> Components: Loaders and Stores
> Affects Versions: 9.1.1.Final
> Reporter: Dmitry Katsubo
> Assignee: Ryan Emerson
> Priority: Minor
> Fix For: 9.4.2.Final
>
>
> In my scenario the cache file size created by {{SingleFileStore}} is 3.054.196.342 bytes. When this file is tried to be loaded, it fails with the following exception:
> {code}
> Caused by: org.infinispan.persistence.spi.PersistenceException: ISPN000279: Failed to read stored entries from file. Error in file /work/search-service-layer_data/infinispan/cache_test_dk83146/markupCache.dat at offset 4
> at org.infinispan.persistence.file.SingleFileStore.rebuildIndex(SingleFileStore.java:182)
> at org.infinispan.persistence.file.SingleFileStore.start(SingleFileStore.java:127)
> ... 155 more
> {code}
> Cache file content:
> {code}
> 0000000000: 46 43 53 31 80 B1 89 47 │ 00 00 00 00 00 00 00 00 FCS1?+%G
> 0000000010: 00 00 00 00 FF FF FF FF │ FF FF FF FF 02 15 4E 06 yyyyyyyy☻§N♠
> 0000000020: 05 03 04 09 00 00 00 2F │ 6F 72 67 2E 73 70 72 69 ♣♥♦○ /org.spri
> 0000000030: 6E 67 66 72 61 6D 65 77 │ 6F 72 6B 2E 63 61 63 68 ngframework.cach
> 0000000040: 65 2E 69 6E 74 65 72 63 │ 65 70 74 6F 72 2E 53 69 e.interceptor.Si
> 0000000050: 6D 70 6C 65 4B 65 79 4C │ 0A 57 03 6B 6D 93 D8 00 mpleKeyL◙W♥km"O
> 0000000060: 00 00 02 00 00 00 08 68 │ 61 73 68 43 6F 64 65 23 ☻ ◘hashCode#
> 0000000070: 00 00 00 00 06 70 61 72 │ 61 6D 73 16 00 16 15 E6 ♠params▬ ▬§?
> {code}
> The problem is that integer value 0x80B18947 is treated as signed integer in line {{SingleFileStore:181}}, hence in expression
> {code}
> if (fe.size < KEY_POS + fe.keyLen + fe.dataLen + fe.metadataLen) {
> throw log.errorReadingFileStore(file.getPath(), filePos);
> }
> {code}
> {{fe.size}} is negative and equal to -2135848633.
> I have tried to configure the persistence storage so that it gets purged on start:
> {code}
> <persistence passivation="true">
> <file-store path="/var/cache/infinispan" purge="true">
> <write-behind thread-pool-size="5" />
> </file-store>
> </persistence>
> {code}
> however this does not help as storage is first read and then purged (see also ISPN-7186).
> It is expected that {{SingleFileStore}} either does not allow to write such big entries to the cache, or handles them correctly.
--
This message was sent by Atlassian Jira
(v7.12.1#712002)
7 years, 5 months
[JBoss JIRA] (ISPN-7186) SFS Avoid Reading Index if Purge on startup is enabled
by Ryan Emerson (Jira)
[ https://issues.jboss.org/browse/ISPN-7186?page=com.atlassian.jira.plugin.... ]
Ryan Emerson updated ISPN-7186:
-------------------------------
Status: Open (was: New)
> SFS Avoid Reading Index if Purge on startup is enabled
> ------------------------------------------------------
>
> Key: ISPN-7186
> URL: https://issues.jboss.org/browse/ISPN-7186
> Project: Infinispan
> Issue Type: Bug
> Components: Loaders and Stores
> Affects Versions: 8.2.2.Final
> Reporter: Elias Ross
> Assignee: Ryan Emerson
> Priority: Major
> Fix For: 10.0.0.Alpha1, 9.4.2.Final
>
>
> I've observed the following error, which periodically happens when the application restarts.
> This is likely due to a non-clean shutdown truncating the file. Ideally Inifinispan can simply truncate or skip such entries without blocking start-up
> Caused by: org.infinispan.persistence.spi.PersistenceException: org.infinispan.persistence.spi.PersistenceException: ISPN000279: Failed to re
> ad stored entries from file. Error in file raster.dat at offset 4
> at org.infinispan.persistence.file.SingleFileStore.start(SingleFileStore.java:135) ~[org.infinispan-infinispan-core-8.2.2.Final.jar:8
> .2.2.Final]
> at org.infinispan.persistence.manager.PersistenceManagerImpl.start(PersistenceManagerImpl.java:144) ~[org.infinispan-infinispan-core-
> 8.2.2.Final.jar:8.2.2.Final]
> ... 115 common frames omitted
> Caused by: org.infinispan.persistence.spi.PersistenceException: ISPN000279: Failed to read stored entries from file. Error in file raster.dat at offset 4
> at org.infinispan.persistence.file.SingleFileStore.rebuildIndex(SingleFileStore.java:195) ~[org.infinispan-infinispan-core-8.2.2.Fina
> l.jar:8.2.2.Final]
> at org.infinispan.persistence.file.SingleFileStore.start(SingleFileStore.java:126) ~[org.infinispan-infinispan-core-8.2.2.Final.jar:8
> .2.2.Final]
> ... 116 common frames omitted
--
This message was sent by Atlassian Jira
(v7.12.1#712002)
7 years, 5 months
[JBoss JIRA] (ISPN-7186) SFS Avoid Reading Index if Purge on startup is enabled
by Ryan Emerson (Jira)
[ https://issues.jboss.org/browse/ISPN-7186?page=com.atlassian.jira.plugin.... ]
Ryan Emerson updated ISPN-7186:
-------------------------------
Summary: SFS Avoid Reading Index if Purge on startup is enabled (was: ISPN000279: Failed to read stored ... should not halt startup)
> SFS Avoid Reading Index if Purge on startup is enabled
> ------------------------------------------------------
>
> Key: ISPN-7186
> URL: https://issues.jboss.org/browse/ISPN-7186
> Project: Infinispan
> Issue Type: Bug
> Components: Loaders and Stores
> Affects Versions: 8.2.2.Final
> Reporter: Elias Ross
> Assignee: Ryan Emerson
> Priority: Major
>
> I've observed the following error, which periodically happens when the application restarts.
> This is likely due to a non-clean shutdown truncating the file. Ideally Inifinispan can simply truncate or skip such entries without blocking start-up
> Caused by: org.infinispan.persistence.spi.PersistenceException: org.infinispan.persistence.spi.PersistenceException: ISPN000279: Failed to re
> ad stored entries from file. Error in file raster.dat at offset 4
> at org.infinispan.persistence.file.SingleFileStore.start(SingleFileStore.java:135) ~[org.infinispan-infinispan-core-8.2.2.Final.jar:8
> .2.2.Final]
> at org.infinispan.persistence.manager.PersistenceManagerImpl.start(PersistenceManagerImpl.java:144) ~[org.infinispan-infinispan-core-
> 8.2.2.Final.jar:8.2.2.Final]
> ... 115 common frames omitted
> Caused by: org.infinispan.persistence.spi.PersistenceException: ISPN000279: Failed to read stored entries from file. Error in file raster.dat at offset 4
> at org.infinispan.persistence.file.SingleFileStore.rebuildIndex(SingleFileStore.java:195) ~[org.infinispan-infinispan-core-8.2.2.Fina
> l.jar:8.2.2.Final]
> at org.infinispan.persistence.file.SingleFileStore.start(SingleFileStore.java:126) ~[org.infinispan-infinispan-core-8.2.2.Final.jar:8
> .2.2.Final]
> ... 116 common frames omitted
--
This message was sent by Atlassian Jira
(v7.12.1#712002)
7 years, 5 months
[JBoss JIRA] (ISPN-7186) ISPN000279: Failed to read stored ... should not halt startup
by Ryan Emerson (Jira)
[ https://issues.jboss.org/browse/ISPN-7186?page=com.atlassian.jira.plugin.... ]
Ryan Emerson reassigned ISPN-7186:
----------------------------------
Assignee: Ryan Emerson
> ISPN000279: Failed to read stored ... should not halt startup
> -------------------------------------------------------------
>
> Key: ISPN-7186
> URL: https://issues.jboss.org/browse/ISPN-7186
> Project: Infinispan
> Issue Type: Bug
> Components: Loaders and Stores
> Affects Versions: 8.2.2.Final
> Reporter: Elias Ross
> Assignee: Ryan Emerson
> Priority: Major
>
> I've observed the following error, which periodically happens when the application restarts.
> This is likely due to a non-clean shutdown truncating the file. Ideally Inifinispan can simply truncate or skip such entries without blocking start-up
> Caused by: org.infinispan.persistence.spi.PersistenceException: org.infinispan.persistence.spi.PersistenceException: ISPN000279: Failed to re
> ad stored entries from file. Error in file raster.dat at offset 4
> at org.infinispan.persistence.file.SingleFileStore.start(SingleFileStore.java:135) ~[org.infinispan-infinispan-core-8.2.2.Final.jar:8
> .2.2.Final]
> at org.infinispan.persistence.manager.PersistenceManagerImpl.start(PersistenceManagerImpl.java:144) ~[org.infinispan-infinispan-core-
> 8.2.2.Final.jar:8.2.2.Final]
> ... 115 common frames omitted
> Caused by: org.infinispan.persistence.spi.PersistenceException: ISPN000279: Failed to read stored entries from file. Error in file raster.dat at offset 4
> at org.infinispan.persistence.file.SingleFileStore.rebuildIndex(SingleFileStore.java:195) ~[org.infinispan-infinispan-core-8.2.2.Fina
> l.jar:8.2.2.Final]
> at org.infinispan.persistence.file.SingleFileStore.start(SingleFileStore.java:126) ~[org.infinispan-infinispan-core-8.2.2.Final.jar:8
> .2.2.Final]
> ... 116 common frames omitted
--
This message was sent by Atlassian Jira
(v7.12.1#712002)
7 years, 5 months
[JBoss JIRA] (ISPN-9696) Exception based eviction should be segment based
by William Burns (Jira)
William Burns created ISPN-9696:
-----------------------------------
Summary: Exception based eviction should be segment based
Key: ISPN-9696
URL: https://issues.jboss.org/browse/ISPN-9696
Project: Infinispan
Issue Type: Enhancement
Components: Eviction
Reporter: William Burns
Exception based eviction currently keeps track of the size of the entries in one stored value. We should keep track by segment. This allows us to report an approximate size to other components, such as state transfer which could be useful in ensuring elements will fit.
Also it allows for us to remove the addRemovalListener method on the InternalDataContainer as this is currently used by exception based eviction when a segment is removed to update its count. Instead it would be notified of a segment being removed and just remove the value internally.
--
This message was sent by Atlassian Jira
(v7.12.1#712002)
7 years, 5 months
[JBoss JIRA] (ISPN-9690) EXCEPTION eviction strategy should not require transactions
by Galder Zamarreño (Jira)
[ https://issues.jboss.org/browse/ISPN-9690?page=com.atlassian.jira.plugin.... ]
Galder Zamarreño updated ISPN-9690:
-----------------------------------
Attachment: ispn-9690-zulip-chat.log
> EXCEPTION eviction strategy should not require transactions
> -----------------------------------------------------------
>
> Key: ISPN-9690
> URL: https://issues.jboss.org/browse/ISPN-9690
> Project: Infinispan
> Issue Type: Enhancement
> Reporter: Galder Zamarreño
> Priority: Major
> Attachments: ispn-9690-zulip-chat.log
>
>
> Unfortunately we need 2 phase commit to guarantee consistency. Imagine the case where one of the owners says the write is okay and another says no, there is no way without two phase commit to guarantee that either all or none of the writes are completed.
> One possibility would be node to deny a write if it expects it would result in other nodes running out of memory. However, this could still fail if some keys store more data than others. It would require Infinispan to calculate some probabilistic method of deciding when a node would run out of memory.
> Another way would be to have a local (or shared) persistent store attached. In that case, if a backup owner will run out of memory if storing data, it would not store it in memory but store it to the persistent layer. If the node is restarted with new memory settings, the persistent stores would be consistent and the rebalance would put the data back in memory.
--
This message was sent by Atlassian Jira
(v7.12.1#712002)
7 years, 5 months