11:22 a.m.
Matthew Farwell created ISPN-1936:
-------------------------------------
Summary: FileCacheStore does not seem to close open files on Windows
Key: ISPN-1936
URL: https://issues.jboss.org/browse/ISPN-1936
Project: Infinispan
Issue Type: Bug
Components: Core API
Affects Versions: 5.1.2.FINAL
Environment: Windows 7
Reporter: Matthew Farwell
Assignee: Manik Surtani
Using the following java (see Test.java):
public static void main(String[] args) throws Exception {
DefaultCacheManager manager = new DefaultCacheManager("config/config.xml");
Cache<String, String> cache = manager.getCache("evictionCache");
for (int i = 0; i < 10000; i++) {
cache.put("key" + i, "value" + i);
}
cache.stop();
manager.stop();
}
with the following config (see config.xml):
<infinispan>
<namedCache name="evictionCache">
<loaders passivation="false" shared="false"
preload="true">
<loader class="org.infinispan.loaders.file.FileCacheStore"
fetchPersistentState="true" ignoreModifications="false"
purgeOnStartup="false">
<properties>
<property name="location" value="d:\code\infinispan\store"
/>
</properties>
</loader>
</loaders>
<eviction maxEntries="5000" strategy="LRU" />
<expiration lifespan="60000" maxIdle="10000"
wakeUpInterval="500" />
</namedCache>
</infinispan>
running under Windows 7, there are two problems:
1) There are lots INFO: Unable to remove empty file
d:\code\infinispan\store\evictionCache\-1134715904 - will try again
later. I'm running under windows, so this may have something to do
with it, but the process which is holding on to the file handles is
the jvm. Is it possible that something somewhere is holding the files
open somewhere? Looking at the code in FileCacheStore, there doesn't
seem to be anything obvious.
2) This may be related to the above, but the process eventually falls
over with java.nio.channels.ClosedByInterruptException (with
iterations = 1000) see console-1000.txt or a java.io.EOFException: The
stream ended unexpectedly. for iterations = 10000 (see
console-10000.txt).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.jboss.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
11:24 a.m.
[
https://issues.jboss.org/browse/ISPN-1936?page=com.atlassian.jira.plugin....
]
Matthew Farwell updated ISPN-1936:
----------------------------------
Attachment: console-1000.out
console-10000.out
config.xml
Test.java
FileCacheStore does not seem to close open files on Windows
-----------------------------------------------------------
Key: ISPN-1936
URL: https://issues.jboss.org/browse/ISPN-1936
Project: Infinispan
Issue Type: Bug
Components: Core API
Affects Versions: 5.1.2.FINAL
Environment: Windows 7
Reporter: Matthew Farwell
Assignee: Manik Surtani
Attachments: config.xml, console-1000.out, console-10000.out, Test.java
Using the following java (see Test.java):
public static void main(String[] args) throws Exception {
DefaultCacheManager manager = new DefaultCacheManager("config/config.xml");
Cache<String, String> cache = manager.getCache("evictionCache");
for (int i = 0; i < 10000; i++) {
cache.put("key" + i, "value" + i);
}
cache.stop();
manager.stop();
}
with the following config (see config.xml):
<infinispan>
<namedCache name="evictionCache">
<loaders passivation="false" shared="false"
preload="true">
<loader class="org.infinispan.loaders.file.FileCacheStore"
fetchPersistentState="true" ignoreModifications="false"
purgeOnStartup="false">
<properties>
<property name="location" value="d:\code\infinispan\store"
/>
</properties>
</loader>
</loaders>
<eviction maxEntries="5000" strategy="LRU" />
<expiration lifespan="60000" maxIdle="10000"
wakeUpInterval="500" />
</namedCache>
</infinispan>
running under Windows 7, there are two problems:
1) There are lots INFO: Unable to remove empty file
d:\code\infinispan\store\evictionCache\-1134715904 - will try again
later. I'm running under windows, so this may have something to do
with it, but the process which is holding on to the file handles is
the jvm. Is it possible that something somewhere is holding the files
open somewhere? Looking at the code in FileCacheStore, there doesn't
seem to be anything obvious.
2) This may be related to the above, but the process eventually falls
over with java.nio.channels.ClosedByInterruptException (with
iterations = 1000) see console-1000.txt or a java.io.EOFException: The
stream ended unexpectedly. for iterations = 10000 (see
console-10000.txt).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.jboss.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
5:45 p.m.
[
https://issues.jboss.org/browse/ISPN-1936?page=com.atlassian.jira.plugin....
]
Galder Zamarreño updated ISPN-1936:
-----------------------------------
Fix Version/s: 5.1.3.FINAL
FileCacheStore does not seem to close open files on Windows
-----------------------------------------------------------
Key: ISPN-1936
URL: https://issues.jboss.org/browse/ISPN-1936
Project: Infinispan
Issue Type: Bug
Components: Core API
Affects Versions: 5.1.2.FINAL
Environment: Windows 7
Reporter: Matthew Farwell
Assignee: Manik Surtani
Fix For: 5.1.3.FINAL
Attachments: config.xml, console-1000.out, console-10000.out, Test.java
Using the following java (see Test.java):
public static void main(String[] args) throws Exception {
DefaultCacheManager manager = new DefaultCacheManager("config/config.xml");
Cache<String, String> cache = manager.getCache("evictionCache");
for (int i = 0; i < 10000; i++) {
cache.put("key" + i, "value" + i);
}
cache.stop();
manager.stop();
}
with the following config (see config.xml):
<infinispan>
<namedCache name="evictionCache">
<loaders passivation="false" shared="false"
preload="true">
<loader class="org.infinispan.loaders.file.FileCacheStore"
fetchPersistentState="true" ignoreModifications="false"
purgeOnStartup="false">
<properties>
<property name="location" value="d:\code\infinispan\store"
/>
</properties>
</loader>
</loaders>
<eviction maxEntries="5000" strategy="LRU" />
<expiration lifespan="60000" maxIdle="10000"
wakeUpInterval="500" />
</namedCache>
</infinispan>
running under Windows 7, there are two problems:
1) There are lots INFO: Unable to remove empty file
d:\code\infinispan\store\evictionCache\-1134715904 - will try again
later. I'm running under windows, so this may have something to do
with it, but the process which is holding on to the file handles is
the jvm. Is it possible that something somewhere is holding the files
open somewhere? Looking at the code in FileCacheStore, there doesn't
seem to be anything obvious.
2) This may be related to the above, but the process eventually falls
over with java.nio.channels.ClosedByInterruptException (with
iterations = 1000) see console-1000.txt or a java.io.EOFException: The
stream ended unexpectedly. for iterations = 10000 (see
console-10000.txt).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.jboss.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
6:09 p.m.
[
https://issues.jboss.org/browse/ISPN-1936?page=com.atlassian.jira.plugin....
]
Manik Surtani updated ISPN-1936:
--------------------------------
Priority: Critical (was: Major)
FileCacheStore does not seem to close open files on Windows
-----------------------------------------------------------
Key: ISPN-1936
URL: https://issues.jboss.org/browse/ISPN-1936
Project: Infinispan
Issue Type: Bug
Components: Core API
Affects Versions: 5.1.2.FINAL
Environment: Windows 7
Reporter: Matthew Farwell
Assignee: Manik Surtani
Priority: Critical
Fix For: 5.1.3.FINAL
Attachments: config.xml, console-1000.out, console-10000.out, Test.java
Using the following java (see Test.java):
public static void main(String[] args) throws Exception {
DefaultCacheManager manager = new DefaultCacheManager("config/config.xml");
Cache<String, String> cache = manager.getCache("evictionCache");
for (int i = 0; i < 10000; i++) {
cache.put("key" + i, "value" + i);
}
cache.stop();
manager.stop();
}
with the following config (see config.xml):
<infinispan>
<namedCache name="evictionCache">
<loaders passivation="false" shared="false"
preload="true">
<loader class="org.infinispan.loaders.file.FileCacheStore"
fetchPersistentState="true" ignoreModifications="false"
purgeOnStartup="false">
<properties>
<property name="location" value="d:\code\infinispan\store"
/>
</properties>
</loader>
</loaders>
<eviction maxEntries="5000" strategy="LRU" />
<expiration lifespan="60000" maxIdle="10000"
wakeUpInterval="500" />
</namedCache>
</infinispan>
running under Windows 7, there are two problems:
1) There are lots INFO: Unable to remove empty file
d:\code\infinispan\store\evictionCache\-1134715904 - will try again
later. I'm running under windows, so this may have something to do
with it, but the process which is holding on to the file handles is
the jvm. Is it possible that something somewhere is holding the files
open somewhere? Looking at the code in FileCacheStore, there doesn't
seem to be anything obvious.
2) This may be related to the above, but the process eventually falls
over with java.nio.channels.ClosedByInterruptException (with
iterations = 1000) see console-1000.txt or a java.io.EOFException: The
stream ended unexpectedly. for iterations = 10000 (see
console-10000.txt).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.jboss.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
4:02 p.m.
[
https://issues.jboss.org/browse/ISPN-1936?page=com.atlassian.jira.plugin....
]
Manik Surtani commented on ISPN-1936:
-------------------------------------
This is a windows-specific problem. Just tried it on Linux and Mac OS, and works fine
there.
FileCacheStore does not seem to close open files on Windows
-----------------------------------------------------------
Key: ISPN-1936
URL: https://issues.jboss.org/browse/ISPN-1936
Project: Infinispan
Issue Type: Bug
Components: Core API
Affects Versions: 5.1.2.FINAL
Environment: Windows 7
Reporter: Matthew Farwell
Assignee: Manik Surtani
Priority: Critical
Fix For: 5.1.3.FINAL
Attachments: config.xml, console-1000.out, console-10000.out, Test.java
Using the following java (see Test.java):
public static void main(String[] args) throws Exception {
DefaultCacheManager manager = new DefaultCacheManager("config/config.xml");
Cache<String, String> cache = manager.getCache("evictionCache");
for (int i = 0; i < 10000; i++) {
cache.put("key" + i, "value" + i);
}
cache.stop();
manager.stop();
}
with the following config (see config.xml):
<infinispan>
<namedCache name="evictionCache">
<loaders passivation="false" shared="false"
preload="true">
<loader class="org.infinispan.loaders.file.FileCacheStore"
fetchPersistentState="true" ignoreModifications="false"
purgeOnStartup="false">
<properties>
<property name="location" value="d:\code\infinispan\store"
/>
</properties>
</loader>
</loaders>
<eviction maxEntries="5000" strategy="LRU" />
<expiration lifespan="60000" maxIdle="10000"
wakeUpInterval="500" />
</namedCache>
</infinispan>
running under Windows 7, there are two problems:
1) There are lots INFO: Unable to remove empty file
d:\code\infinispan\store\evictionCache\-1134715904 - will try again
later. I'm running under windows, so this may have something to do
with it, but the process which is holding on to the file handles is
the jvm. Is it possible that something somewhere is holding the files
open somewhere? Looking at the code in FileCacheStore, there doesn't
seem to be anything obvious.
2) This may be related to the above, but the process eventually falls
over with java.nio.channels.ClosedByInterruptException (with
iterations = 1000) see console-1000.txt or a java.io.EOFException: The
stream ended unexpectedly. for iterations = 10000 (see
console-10000.txt).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.jboss.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
4:09 p.m.
[
https://issues.jboss.org/browse/ISPN-1936?page=com.atlassian.jira.plugin....
]
Work on ISPN-1936 started by Manik Surtani.
FileCacheStore does not seem to close open files on Windows
-----------------------------------------------------------
Key: ISPN-1936
URL: https://issues.jboss.org/browse/ISPN-1936
Project: Infinispan
Issue Type: Bug
Components: Core API
Affects Versions: 5.1.2.FINAL
Environment: Windows 7
Reporter: Matthew Farwell
Assignee: Manik Surtani
Priority: Critical
Fix For: 5.1.3.FINAL
Attachments: config.xml, console-1000.out, console-10000.out, Test.java
Using the following java (see Test.java):
public static void main(String[] args) throws Exception {
DefaultCacheManager manager = new DefaultCacheManager("config/config.xml");
Cache<String, String> cache = manager.getCache("evictionCache");
for (int i = 0; i < 10000; i++) {
cache.put("key" + i, "value" + i);
}
cache.stop();
manager.stop();
}
with the following config (see config.xml):
<infinispan>
<namedCache name="evictionCache">
<loaders passivation="false" shared="false"
preload="true">
<loader class="org.infinispan.loaders.file.FileCacheStore"
fetchPersistentState="true" ignoreModifications="false"
purgeOnStartup="false">
<properties>
<property name="location" value="d:\code\infinispan\store"
/>
</properties>
</loader>
</loaders>
<eviction maxEntries="5000" strategy="LRU" />
<expiration lifespan="60000" maxIdle="10000"
wakeUpInterval="500" />
</namedCache>
</infinispan>
running under Windows 7, there are two problems:
1) There are lots INFO: Unable to remove empty file
d:\code\infinispan\store\evictionCache\-1134715904 - will try again
later. I'm running under windows, so this may have something to do
with it, but the process which is holding on to the file handles is
the jvm. Is it possible that something somewhere is holding the files
open somewhere? Looking at the code in FileCacheStore, there doesn't
seem to be anything obvious.
2) This may be related to the above, but the process eventually falls
over with java.nio.channels.ClosedByInterruptException (with
iterations = 1000) see console-1000.txt or a java.io.EOFException: The
stream ended unexpectedly. for iterations = 10000 (see
console-10000.txt).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.jboss.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
4:52 p.m.
[
https://issues.jboss.org/browse/ISPN-1936?page=com.atlassian.jira.plugin....
]
Manik Surtani commented on ISPN-1936:
-------------------------------------
Ok, I see this failure with Windows XP and JDK 7.
FileCacheStore does not seem to close open files on Windows
-----------------------------------------------------------
Key: ISPN-1936
URL: https://issues.jboss.org/browse/ISPN-1936
Project: Infinispan
Issue Type: Bug
Components: Core API
Affects Versions: 5.1.2.FINAL
Environment: Windows 7
Reporter: Matthew Farwell
Assignee: Manik Surtani
Priority: Critical
Fix For: 5.1.3.FINAL
Attachments: config.xml, console-1000.out, console-10000.out, Test.java
Using the following java (see Test.java):
public static void main(String[] args) throws Exception {
DefaultCacheManager manager = new DefaultCacheManager("config/config.xml");
Cache<String, String> cache = manager.getCache("evictionCache");
for (int i = 0; i < 10000; i++) {
cache.put("key" + i, "value" + i);
}
cache.stop();
manager.stop();
}
with the following config (see config.xml):
<infinispan>
<namedCache name="evictionCache">
<loaders passivation="false" shared="false"
preload="true">
<loader class="org.infinispan.loaders.file.FileCacheStore"
fetchPersistentState="true" ignoreModifications="false"
purgeOnStartup="false">
<properties>
<property name="location" value="d:\code\infinispan\store"
/>
</properties>
</loader>
</loaders>
<eviction maxEntries="5000" strategy="LRU" />
<expiration lifespan="60000" maxIdle="10000"
wakeUpInterval="500" />
</namedCache>
</infinispan>
running under Windows 7, there are two problems:
1) There are lots INFO: Unable to remove empty file
d:\code\infinispan\store\evictionCache\-1134715904 - will try again
later. I'm running under windows, so this may have something to do
with it, but the process which is holding on to the file handles is
the jvm. Is it possible that something somewhere is holding the files
open somewhere? Looking at the code in FileCacheStore, there doesn't
seem to be anything obvious.
2) This may be related to the above, but the process eventually falls
over with java.nio.channels.ClosedByInterruptException (with
iterations = 1000) see console-1000.txt or a java.io.EOFException: The
stream ended unexpectedly. for iterations = 10000 (see
console-10000.txt).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.jboss.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
4:59 p.m.
[
https://issues.jboss.org/browse/ISPN-1936?page=com.atlassian.jira.plugin....
]
Manik Surtani commented on ISPN-1936:
-------------------------------------
I can also confirm that the files are correctly being removed on OS X (not just a
suppressed error message).
FileCacheStore does not seem to close open files on Windows
-----------------------------------------------------------
Key: ISPN-1936
URL: https://issues.jboss.org/browse/ISPN-1936
Project: Infinispan
Issue Type: Bug
Components: Core API
Affects Versions: 5.1.2.FINAL
Environment: Windows 7
Reporter: Matthew Farwell
Assignee: Manik Surtani
Priority: Critical
Fix For: 5.1.3.FINAL
Attachments: config.xml, console-1000.out, console-10000.out, Test.java
Using the following java (see Test.java):
public static void main(String[] args) throws Exception {
DefaultCacheManager manager = new DefaultCacheManager("config/config.xml");
Cache<String, String> cache = manager.getCache("evictionCache");
for (int i = 0; i < 10000; i++) {
cache.put("key" + i, "value" + i);
}
cache.stop();
manager.stop();
}
with the following config (see config.xml):
<infinispan>
<namedCache name="evictionCache">
<loaders passivation="false" shared="false"
preload="true">
<loader class="org.infinispan.loaders.file.FileCacheStore"
fetchPersistentState="true" ignoreModifications="false"
purgeOnStartup="false">
<properties>
<property name="location" value="d:\code\infinispan\store"
/>
</properties>
</loader>
</loaders>
<eviction maxEntries="5000" strategy="LRU" />
<expiration lifespan="60000" maxIdle="10000"
wakeUpInterval="500" />
</namedCache>
</infinispan>
running under Windows 7, there are two problems:
1) There are lots INFO: Unable to remove empty file
d:\code\infinispan\store\evictionCache\-1134715904 - will try again
later. I'm running under windows, so this may have something to do
with it, but the process which is holding on to the file handles is
the jvm. Is it possible that something somewhere is holding the files
open somewhere? Looking at the code in FileCacheStore, there doesn't
seem to be anything obvious.
2) This may be related to the above, but the process eventually falls
over with java.nio.channels.ClosedByInterruptException (with
iterations = 1000) see console-1000.txt or a java.io.EOFException: The
stream ended unexpectedly. for iterations = 10000 (see
console-10000.txt).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.jboss.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
5:08 p.m.
[
https://issues.jboss.org/browse/ISPN-1936?page=com.atlassian.jira.plugin....
]
Tristan Tarrant commented on ISPN-1936:
---------------------------------------
You can use Process Explorer
(http://technet.microsoft.com/en-us/sysinternals/bb896653.aspx) to get the owners of the
handles
FileCacheStore does not seem to close open files on Windows
-----------------------------------------------------------
Key: ISPN-1936
URL: https://issues.jboss.org/browse/ISPN-1936
Project: Infinispan
Issue Type: Bug
Components: Core API
Affects Versions: 5.1.2.FINAL
Environment: Windows 7
Reporter: Matthew Farwell
Assignee: Manik Surtani
Priority: Critical
Fix For: 5.1.3.FINAL
Attachments: config.xml, console-1000.out, console-10000.out, Test.java
Using the following java (see Test.java):
public static void main(String[] args) throws Exception {
DefaultCacheManager manager = new DefaultCacheManager("config/config.xml");
Cache<String, String> cache = manager.getCache("evictionCache");
for (int i = 0; i < 10000; i++) {
cache.put("key" + i, "value" + i);
}
cache.stop();
manager.stop();
}
with the following config (see config.xml):
<infinispan>
<namedCache name="evictionCache">
<loaders passivation="false" shared="false"
preload="true">
<loader class="org.infinispan.loaders.file.FileCacheStore"
fetchPersistentState="true" ignoreModifications="false"
purgeOnStartup="false">
<properties>
<property name="location" value="d:\code\infinispan\store"
/>
</properties>
</loader>
</loaders>
<eviction maxEntries="5000" strategy="LRU" />
<expiration lifespan="60000" maxIdle="10000"
wakeUpInterval="500" />
</namedCache>
</infinispan>
running under Windows 7, there are two problems:
1) There are lots INFO: Unable to remove empty file
d:\code\infinispan\store\evictionCache\-1134715904 - will try again
later. I'm running under windows, so this may have something to do
with it, but the process which is holding on to the file handles is
the jvm. Is it possible that something somewhere is holding the files
open somewhere? Looking at the code in FileCacheStore, there doesn't
seem to be anything obvious.
2) This may be related to the above, but the process eventually falls
over with java.nio.channels.ClosedByInterruptException (with
iterations = 1000) see console-1000.txt or a java.io.EOFException: The
stream ended unexpectedly. for iterations = 10000 (see
console-10000.txt).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.jboss.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
5:24 p.m.
[
https://issues.jboss.org/browse/ISPN-1936?page=com.atlassian.jira.plugin....
]
Dan Berindei commented on ISPN-1936:
------------------------------------
Manik, Linux/Macos X allow you to delete a file while you (or another process) has it
open. So we have to confirm that the files are really closed with {{lsof}}.
FileCacheStore does not seem to close open files on Windows
-----------------------------------------------------------
Key: ISPN-1936
URL: https://issues.jboss.org/browse/ISPN-1936
Project: Infinispan
Issue Type: Bug
Components: Core API
Affects Versions: 5.1.2.FINAL
Environment: Windows 7
Reporter: Matthew Farwell
Assignee: Manik Surtani
Priority: Critical
Fix For: 5.1.3.FINAL
Attachments: config.xml, console-1000.out, console-10000.out, Test.java
Using the following java (see Test.java):
public static void main(String[] args) throws Exception {
DefaultCacheManager manager = new DefaultCacheManager("config/config.xml");
Cache<String, String> cache = manager.getCache("evictionCache");
for (int i = 0; i < 10000; i++) {
cache.put("key" + i, "value" + i);
}
cache.stop();
manager.stop();
}
with the following config (see config.xml):
<infinispan>
<namedCache name="evictionCache">
<loaders passivation="false" shared="false"
preload="true">
<loader class="org.infinispan.loaders.file.FileCacheStore"
fetchPersistentState="true" ignoreModifications="false"
purgeOnStartup="false">
<properties>
<property name="location" value="d:\code\infinispan\store"
/>
</properties>
</loader>
</loaders>
<eviction maxEntries="5000" strategy="LRU" />
<expiration lifespan="60000" maxIdle="10000"
wakeUpInterval="500" />
</namedCache>
</infinispan>
running under Windows 7, there are two problems:
1) There are lots INFO: Unable to remove empty file
d:\code\infinispan\store\evictionCache\-1134715904 - will try again
later. I'm running under windows, so this may have something to do
with it, but the process which is holding on to the file handles is
the jvm. Is it possible that something somewhere is holding the files
open somewhere? Looking at the code in FileCacheStore, there doesn't
seem to be anything obvious.
2) This may be related to the above, but the process eventually falls
over with java.nio.channels.ClosedByInterruptException (with
iterations = 1000) see console-1000.txt or a java.io.EOFException: The
stream ended unexpectedly. for iterations = 10000 (see
console-10000.txt).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.jboss.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
5:35 p.m.
[
https://issues.jboss.org/browse/ISPN-1936?page=com.atlassian.jira.plugin....
]
Dan Berindei commented on ISPN-1936:
------------------------------------
I just ran the test on my Linux machine and I found about 60 lines like this in the lsof
output:
{noformat}
COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME
java 18793 dan 73u REG 253,2 0 1311385
/home/dan/Work/infinispan/d:\code\infinispan\store/evictionCache/-816407552 (deleted)
{noformat}
So I think it's safe to say that we don't close files properly on Linux either.
FileCacheStore does not seem to close open files on Windows
-----------------------------------------------------------
Key: ISPN-1936
URL: https://issues.jboss.org/browse/ISPN-1936
Project: Infinispan
Issue Type: Bug
Components: Core API
Affects Versions: 5.1.2.FINAL
Environment: Windows 7
Reporter: Matthew Farwell
Assignee: Manik Surtani
Priority: Critical
Fix For: 5.1.3.FINAL
Attachments: config.xml, console-1000.out, console-10000.out, Test.java
Using the following java (see Test.java):
public static void main(String[] args) throws Exception {
DefaultCacheManager manager = new DefaultCacheManager("config/config.xml");
Cache<String, String> cache = manager.getCache("evictionCache");
for (int i = 0; i < 10000; i++) {
cache.put("key" + i, "value" + i);
}
cache.stop();
manager.stop();
}
with the following config (see config.xml):
<infinispan>
<namedCache name="evictionCache">
<loaders passivation="false" shared="false"
preload="true">
<loader class="org.infinispan.loaders.file.FileCacheStore"
fetchPersistentState="true" ignoreModifications="false"
purgeOnStartup="false">
<properties>
<property name="location" value="d:\code\infinispan\store"
/>
</properties>
</loader>
</loaders>
<eviction maxEntries="5000" strategy="LRU" />
<expiration lifespan="60000" maxIdle="10000"
wakeUpInterval="500" />
</namedCache>
</infinispan>
running under Windows 7, there are two problems:
1) There are lots INFO: Unable to remove empty file
d:\code\infinispan\store\evictionCache\-1134715904 - will try again
later. I'm running under windows, so this may have something to do
with it, but the process which is holding on to the file handles is
the jvm. Is it possible that something somewhere is holding the files
open somewhere? Looking at the code in FileCacheStore, there doesn't
seem to be anything obvious.
2) This may be related to the above, but the process eventually falls
over with java.nio.channels.ClosedByInterruptException (with
iterations = 1000) see console-1000.txt or a java.io.EOFException: The
stream ended unexpectedly. for iterations = 10000 (see
console-10000.txt).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.jboss.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
10:33 a.m.
New subject: [JBoss JIRA] (ISPN-1936) FileCacheStore does not seem to close open files
[
https://issues.jboss.org/browse/ISPN-1936?page=com.atlassian.jira.plugin....
]
Manik Surtani updated ISPN-1936:
--------------------------------
Summary: FileCacheStore does not seem to close open files (was: FileCacheStore
does not seem to close open files on Windows)
Environment: (was: Windows 7)
FileCacheStore does not seem to close open files
------------------------------------------------
Key: ISPN-1936
URL: https://issues.jboss.org/browse/ISPN-1936
Project: Infinispan
Issue Type: Bug
Components: Core API
Affects Versions: 5.1.2.FINAL
Reporter: Matthew Farwell
Assignee: Manik Surtani
Priority: Critical
Fix For: 5.1.3.FINAL
Attachments: config.xml, console-1000.out, console-10000.out, Test.java
Using the following java (see Test.java):
public static void main(String[] args) throws Exception {
DefaultCacheManager manager = new DefaultCacheManager("config/config.xml");
Cache<String, String> cache = manager.getCache("evictionCache");
for (int i = 0; i < 10000; i++) {
cache.put("key" + i, "value" + i);
}
cache.stop();
manager.stop();
}
with the following config (see config.xml):
<infinispan>
<namedCache name="evictionCache">
<loaders passivation="false" shared="false"
preload="true">
<loader class="org.infinispan.loaders.file.FileCacheStore"
fetchPersistentState="true" ignoreModifications="false"
purgeOnStartup="false">
<properties>
<property name="location" value="d:\code\infinispan\store"
/>
</properties>
</loader>
</loaders>
<eviction maxEntries="5000" strategy="LRU" />
<expiration lifespan="60000" maxIdle="10000"
wakeUpInterval="500" />
</namedCache>
</infinispan>
running under Windows 7, there are two problems:
1) There are lots INFO: Unable to remove empty file
d:\code\infinispan\store\evictionCache\-1134715904 - will try again
later. I'm running under windows, so this may have something to do
with it, but the process which is holding on to the file handles is
the jvm. Is it possible that something somewhere is holding the files
open somewhere? Looking at the code in FileCacheStore, there doesn't
seem to be anything obvious.
2) This may be related to the above, but the process eventually falls
over with java.nio.channels.ClosedByInterruptException (with
iterations = 1000) see console-1000.txt or a java.io.EOFException: The
stream ended unexpectedly. for iterations = 10000 (see
console-10000.txt).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.jboss.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
10:47 a.m.
New subject: [JBoss JIRA] (ISPN-1936) FileCacheStore does not seem to close open files
[
https://issues.jboss.org/browse/ISPN-1936?page=com.atlassian.jira.plugin....
]
Dan Berindei commented on ISPN-1936:
------------------------------------
Found the open files problem, when writing an empty bucket we deleted the file but we
didn't close the channel first.
I think the EOFExceptions were caused by the read operations removing expired entries and
updating the bucket o disk, without acquiring the bucket lock in exclusive
mode first.
FileCacheStore does not seem to close open files
------------------------------------------------
Key: ISPN-1936
URL: https://issues.jboss.org/browse/ISPN-1936
Project: Infinispan
Issue Type: Bug
Components: Core API
Affects Versions: 5.1.2.FINAL
Reporter: Matthew Farwell
Assignee: Manik Surtani
Priority: Critical
Fix For: 5.1.3.FINAL
Attachments: config.xml, console-1000.out, console-10000.out, Test.java
Using the following java (see Test.java):
public static void main(String[] args) throws Exception {
DefaultCacheManager manager = new DefaultCacheManager("config/config.xml");
Cache<String, String> cache = manager.getCache("evictionCache");
for (int i = 0; i < 10000; i++) {
cache.put("key" + i, "value" + i);
}
cache.stop();
manager.stop();
}
with the following config (see config.xml):
<infinispan>
<namedCache name="evictionCache">
<loaders passivation="false" shared="false"
preload="true">
<loader class="org.infinispan.loaders.file.FileCacheStore"
fetchPersistentState="true" ignoreModifications="false"
purgeOnStartup="false">
<properties>
<property name="location" value="d:\code\infinispan\store"
/>
</properties>
</loader>
</loaders>
<eviction maxEntries="5000" strategy="LRU" />
<expiration lifespan="60000" maxIdle="10000"
wakeUpInterval="500" />
</namedCache>
</infinispan>
running under Windows 7, there are two problems:
1) There are lots INFO: Unable to remove empty file
d:\code\infinispan\store\evictionCache\-1134715904 - will try again
later. I'm running under windows, so this may have something to do
with it, but the process which is holding on to the file handles is
the jvm. Is it possible that something somewhere is holding the files
open somewhere? Looking at the code in FileCacheStore, there doesn't
seem to be anything obvious.
2) This may be related to the above, but the process eventually falls
over with java.nio.channels.ClosedByInterruptException (with
iterations = 1000) see console-1000.txt or a java.io.EOFException: The
stream ended unexpectedly. for iterations = 10000 (see
console-10000.txt).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.jboss.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
5:40 p.m.
New subject: [JBoss JIRA] (ISPN-1936) FileCacheStore does not seem to close open files
[
https://issues.jboss.org/browse/ISPN-1936?page=com.atlassian.jira.plugin....
]
Dan Berindei updated ISPN-1936:
-------------------------------
Status: Pull Request Sent (was: Coding In Progress)
Git Pull Request: https://github.com/infinispan/infinispan/pull/1028
FileCacheStore does not seem to close open files
------------------------------------------------
Key: ISPN-1936
URL: https://issues.jboss.org/browse/ISPN-1936
Project: Infinispan
Issue Type: Bug
Components: Core API
Affects Versions: 5.1.2.FINAL
Reporter: Matthew Farwell
Assignee: Manik Surtani
Priority: Critical
Fix For: 5.1.3.FINAL
Attachments: config.xml, console-1000.out, console-10000.out, Test.java
Using the following java (see Test.java):
public static void main(String[] args) throws Exception {
DefaultCacheManager manager = new DefaultCacheManager("config/config.xml");
Cache<String, String> cache = manager.getCache("evictionCache");
for (int i = 0; i < 10000; i++) {
cache.put("key" + i, "value" + i);
}
cache.stop();
manager.stop();
}
with the following config (see config.xml):
<infinispan>
<namedCache name="evictionCache">
<loaders passivation="false" shared="false"
preload="true">
<loader class="org.infinispan.loaders.file.FileCacheStore"
fetchPersistentState="true" ignoreModifications="false"
purgeOnStartup="false">
<properties>
<property name="location" value="d:\code\infinispan\store"
/>
</properties>
</loader>
</loaders>
<eviction maxEntries="5000" strategy="LRU" />
<expiration lifespan="60000" maxIdle="10000"
wakeUpInterval="500" />
</namedCache>
</infinispan>
running under Windows 7, there are two problems:
1) There are lots INFO: Unable to remove empty file
d:\code\infinispan\store\evictionCache\-1134715904 - will try again
later. I'm running under windows, so this may have something to do
with it, but the process which is holding on to the file handles is
the jvm. Is it possible that something somewhere is holding the files
open somewhere? Looking at the code in FileCacheStore, there doesn't
seem to be anything obvious.
2) This may be related to the above, but the process eventually falls
over with java.nio.channels.ClosedByInterruptException (with
iterations = 1000) see console-1000.txt or a java.io.EOFException: The
stream ended unexpectedly. for iterations = 10000 (see
console-10000.txt).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.jboss.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
11:03 a.m.
New subject: [JBoss JIRA] (ISPN-1936) FileCacheStore does not seem to close open files
[
https://issues.jboss.org/browse/ISPN-1936?page=com.atlassian.jira.plugin....
]
Galder Zamarreño updated ISPN-1936:
-----------------------------------
Status: Resolved (was: Pull Request Sent)
Resolution: Done
FileCacheStore does not seem to close open files
------------------------------------------------
Key: ISPN-1936
URL: https://issues.jboss.org/browse/ISPN-1936
Project: Infinispan
Issue Type: Bug
Components: Core API
Affects Versions: 5.1.2.FINAL
Reporter: Matthew Farwell
Assignee: Manik Surtani
Priority: Critical
Fix For: 5.1.3.FINAL
Attachments: config.xml, console-1000.out, console-10000.out, Test.java
Using the following java (see Test.java):
public static void main(String[] args) throws Exception {
DefaultCacheManager manager = new DefaultCacheManager("config/config.xml");
Cache<String, String> cache = manager.getCache("evictionCache");
for (int i = 0; i < 10000; i++) {
cache.put("key" + i, "value" + i);
}
cache.stop();
manager.stop();
}
with the following config (see config.xml):
<infinispan>
<namedCache name="evictionCache">
<loaders passivation="false" shared="false"
preload="true">
<loader class="org.infinispan.loaders.file.FileCacheStore"
fetchPersistentState="true" ignoreModifications="false"
purgeOnStartup="false">
<properties>
<property name="location" value="d:\code\infinispan\store"
/>
</properties>
</loader>
</loaders>
<eviction maxEntries="5000" strategy="LRU" />
<expiration lifespan="60000" maxIdle="10000"
wakeUpInterval="500" />
</namedCache>
</infinispan>
running under Windows 7, there are two problems:
1) There are lots INFO: Unable to remove empty file
d:\code\infinispan\store\evictionCache\-1134715904 - will try again
later. I'm running under windows, so this may have something to do
with it, but the process which is holding on to the file handles is
the jvm. Is it possible that something somewhere is holding the files
open somewhere? Looking at the code in FileCacheStore, there doesn't
seem to be anything obvious.
2) This may be related to the above, but the process eventually falls
over with java.nio.channels.ClosedByInterruptException (with
iterations = 1000) see console-1000.txt or a java.io.EOFException: The
stream ended unexpectedly. for iterations = 10000 (see
console-10000.txt).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.jboss.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
4420
days inactive
4426
days old
infinispan-issues@lists.jboss.org
14 comments
5 participants
participants (5)
-
Dan Berindei (JIRA) -
Galder Zamarreño (JIRA)
-
Manik Surtani (JIRA)
-
Matthew Farwell (JIRA)
-
Tristan Tarrant (JIRA)