[JBoss JIRA] Created: (ISPN-871) Out-of-heap data container implementation

[JBoss JIRA] Created: (ISPN-1275)...

[JBoss JIRA] (ISPN-2093) State...

Manik Surtani (JIRA)

Tuesday, 11 January 2011 Tue, 11 Jan '11

5:17 a.m.

Out-of-heap data container implementation ----------------------------------------- Key: ISPN-871 URL: https://issues.jboss.org/browse/ISPN-871 Project: Infinispan Issue Type: Feature Request Components: Core API Reporter: Manik Surtani Assignee: Manik Surtani Fix For: 5.1.0.BETA1, 5.1.0.Final The DataContainer interface could be implemented using a off-heap impl in C, using mmap. It would require custom memory management (gc-lite?) to reclaim free space, as well as reimplementing of eviction algorithms to maintain the contract of a self-sizing data container, but the benefits of this would be the ability to address very large amounts of memory with minimal gc overhead from the JVM. -- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira

Show replies by thread

Alban Seurat (JIRA)

Tuesday, 11 January Tue, 11 Jan

5:29 a.m.

New subject: [JBoss JIRA] Commented: (ISPN-871) Out-of-heap data container implementation

[ https://issues.jboss.org/browse/ISPN-871?page=com.atlassian.jira.plugin.s... ] Alban Seurat commented on ISPN-871: ----------------------------------- Using "Low Fragmentation Heap" with eviction algorithm might be enough to validate the principle of this issue

...

Out-of-heap data container implementation ----------------------------------------- Key: ISPN-871 URL: https://issues.jboss.org/browse/ISPN-871 Project: Infinispan Issue Type: Feature Request Components: Core API Reporter: Manik Surtani Assignee: Manik Surtani Labels: gc, performance, research Fix For: 5.1.0.BETA1, 5.1.0.Final The DataContainer interface could be implemented using a off-heap impl in C, using mmap. It would require custom memory management (gc-lite?) to reclaim free space, as well as reimplementing of eviction algorithms to maintain the contract of a self-sizing data container, but the benefits of this would be the ability to address very large amounts of memory with minimal gc overhead from the JVM.

-- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira

Manik Surtani (JIRA)

6:06 a.m.

New subject: [JBoss JIRA] Assigned: (ISPN-871) Out-of-heap data container implementation

[ https://issues.jboss.org/browse/ISPN-871?page=com.atlassian.jira.plugin.s... ] Manik Surtani reassigned ISPN-871: ---------------------------------- Assignee: Alban Seurat (was: Manik Surtani)

...

Out-of-heap data container implementation ----------------------------------------- Key: ISPN-871 URL: https://issues.jboss.org/browse/ISPN-871 Project: Infinispan Issue Type: Feature Request Components: Core API Reporter: Manik Surtani Assignee: Alban Seurat Labels: gc, performance, research Fix For: 5.1.0.BETA1, 5.1.0.Final The DataContainer interface could be implemented using a off-heap impl in C, using mmap. It would require custom memory management (gc-lite?) to reclaim free space, as well as reimplementing of eviction algorithms to maintain the contract of a self-sizing data container, but the benefits of this would be the ability to address very large amounts of memory with minimal gc overhead from the JVM.

-- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira

Alban Seurat (JIRA)

Saturday, 5 March Sat, 5 Mar

12:19 p.m.

New subject: [JBoss JIRA] Work started: (ISPN-871) Out-of-heap data container implementation

[ https://issues.jboss.org/browse/ISPN-871?page=com.atlassian.jira.plugin.s... ] Work on ISPN-871 started by Alban Seurat.

...

Out-of-heap data container implementation ----------------------------------------- Key: ISPN-871 URL: https://issues.jboss.org/browse/ISPN-871 Project: Infinispan Issue Type: Feature Request Components: Core API Reporter: Manik Surtani Assignee: Alban Seurat Labels: gc, performance, research Fix For: 5.1.0.BETA1, 5.1.0.Final The DataContainer interface could be implemented using a off-heap impl in C, using mmap. It would require custom memory management (gc-lite?) to reclaim free space, as well as reimplementing of eviction algorithms to maintain the contract of a self-sizing data container, but the benefits of this would be the ability to address very large amounts of memory with minimal gc overhead from the JVM.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Alban Seurat (JIRA)

Saturday, 19 March Sat, 19 Mar

12:32 p.m.

New subject: [JBoss JIRA] Commented: (ISPN-871) Out-of-heap data container implementation

[ https://issues.jboss.org/browse/ISPN-871?page=com.atlassian.jira.plugin.s... ] Alban Seurat commented on ISPN-871: ----------------------------------- mmap-container module has been properly added to the project Infinispan, it's building the shared object using GNU toolchain driven by maven. Next phase is to allow to seamlessly integrate it into a Java using JNA

...

Out-of-heap data container implementation ----------------------------------------- Key: ISPN-871 URL: https://issues.jboss.org/browse/ISPN-871 Project: Infinispan Issue Type: Feature Request Components: Core API Reporter: Manik Surtani Assignee: Alban Seurat Labels: gc, performance, research Fix For: 5.1.0.BETA1, 5.1.0.Final The DataContainer interface could be implemented using a off-heap impl in C, using mmap. It would require custom memory management (gc-lite?) to reclaim free space, as well as reimplementing of eviction algorithms to maintain the contract of a self-sizing data container, but the benefits of this would be the ability to address very large amounts of memory with minimal gc overhead from the JVM.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Alban Seurat (JIRA)

Tuesday, 29 March Tue, 29 Mar

8:25 a.m.

New subject: [JBoss JIRA] Commented: (ISPN-871) Out-of-heap data container implementation

[ https://issues.jboss.org/browse/ISPN-871?page=com.atlassian.jira.plugin.s... ] Alban Seurat commented on ISPN-871: ----------------------------------- Build on Mac OS X and Linux (Ubuntu 10.10) with the latest GNU toolchain (automake, autoconf, make, gcc, libtool)

...

Out-of-heap data container implementation ----------------------------------------- Key: ISPN-871 URL: https://issues.jboss.org/browse/ISPN-871 Project: Infinispan Issue Type: Feature Request Components: Core API Reporter: Manik Surtani Assignee: Alban Seurat Labels: gc, performance, research Fix For: 5.1.0.BETA1, 5.1.0.Final The DataContainer interface could be implemented using a off-heap impl in C, using mmap. It would require custom memory management (gc-lite?) to reclaim free space, as well as reimplementing of eviction algorithms to maintain the contract of a self-sizing data container, but the benefits of this would be the ability to address very large amounts of memory with minimal gc overhead from the JVM.

-- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

Galder Zamarreño (Updated) (JIRA)

Tuesday, 4 October Tue, 4 Oct

8:34 a.m.

New subject: [JBoss JIRA] (ISPN-871) Out-of-heap data container implementation

[ https://issues.jboss.org/browse/ISPN-871?page=com.atlassian.jira.plugin.s... ] Galder Zamarreño updated ISPN-871: ---------------------------------- Fix Version/s: 5.1.0.BETA2 (was: 5.1.0.BETA1)

...

Out-of-heap data container implementation ----------------------------------------- Key: ISPN-871 URL: https://issues.jboss.org/browse/ISPN-871 Project: Infinispan Issue Type: Feature Request Components: Core API Reporter: Manik Surtani Assignee: Alban Seurat Labels: gc, jni, native, performance, research Fix For: 5.1.0.BETA2, 5.1.0.FINAL The DataContainer interface could be implemented using a off-heap impl in C, using mmap. It would require custom memory management (gc-lite?) to reclaim free space, as well as reimplementing of eviction algorithms to maintain the contract of a self-sizing data container, but the benefits of this would be the ability to address very large amounts of memory with minimal gc overhead from the JVM.

-- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.jboss.org/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira

Galder Zamarreño (Updated) (JIRA)

Wednesday, 19 October Wed, 19 Oct

2:24 a.m.

New subject: [JBoss JIRA] (ISPN-871) Out-of-heap data container implementation

[ https://issues.jboss.org/browse/ISPN-871?page=com.atlassian.jira.plugin.s... ] Galder Zamarreño updated ISPN-871: ---------------------------------- Fix Version/s: 5.1.0.BETA3 (was: 5.1.0.BETA2)

...

Out-of-heap data container implementation ----------------------------------------- Key: ISPN-871 URL: https://issues.jboss.org/browse/ISPN-871 Project: Infinispan Issue Type: Feature Request Components: Core API Reporter: Manik Surtani Assignee: Alban Seurat Labels: gc, jni, native, performance, research Fix For: 5.1.0.BETA3, 5.1.0.FINAL The DataContainer interface could be implemented using a off-heap impl in C, using mmap. It would require custom memory management (gc-lite?) to reclaim free space, as well as reimplementing of eviction algorithms to maintain the contract of a self-sizing data container, but the benefits of this would be the ability to address very large amounts of memory with minimal gc overhead from the JVM.

Manik Surtani (Updated) (JIRA)

Thursday, 20 October Thu, 20 Oct

7:32 p.m.

New subject: [JBoss JIRA] (ISPN-871) Out-of-heap data container implementation

...

Out-of-heap data container implementation ----------------------------------------- Key: ISPN-871 URL: https://issues.jboss.org/browse/ISPN-871 Project: Infinispan Issue Type: Feature Request Components: Configuration Reporter: Manik Surtani Assignee: Alban Seurat Labels: gc, jni, native, performance, research Fix For: 5.2.0.FINAL The DataContainer interface could be implemented using a off-heap impl in C, using mmap. It would require custom memory management (gc-lite?) to reclaim free space, as well as reimplementing of eviction algorithms to maintain the contract of a self-sizing data container, but the benefits of this would be the ability to address very large amounts of memory with minimal gc overhead from the JVM.

Manik Surtani (JIRA)

Tuesday, 31 January Tue, 31 Jan

10:35 a.m.

New subject: [JBoss JIRA] (ISPN-871) Out-of-heap data container implementation

[ https://issues.jboss.org/browse/ISPN-871?page=com.atlassian.jira.plugin.s... ] Manik Surtani updated ISPN-871: ------------------------------- Fix Version/s: 5.2.0.ALPHA1

...

Out-of-heap data container implementation ----------------------------------------- Key: ISPN-871 URL: https://issues.jboss.org/browse/ISPN-871 Project: Infinispan Issue Type: Feature Request Components: Configuration Reporter: Manik Surtani Assignee: Alban Seurat Labels: gc, jni, native, performance, research Fix For: 5.2.0.ALPHA1, 5.2.0.FINAL The DataContainer interface could be implemented using a off-heap impl in C, using mmap. It would require custom memory management (gc-lite?) to reclaim free space, as well as reimplementing of eviction algorithms to maintain the contract of a self-sizing data container, but the benefits of this would be the ability to address very large amounts of memory with minimal gc overhead from the JVM.

Galder Zamarreño (JIRA)

Friday, 22 June Fri, 22 Jun

4:42 p.m.

New subject: [JBoss JIRA] (ISPN-871) Out-of-heap data container implementation

Galder Zamarreño (JIRA)

Friday, 20 July Fri, 20 Jul

11:23 a.m.

New subject: [JBoss JIRA] (ISPN-871) Out-of-heap data container implementation

[ https://issues.jboss.org/browse/ISPN-871?page=com.atlassian.jira.plugin.s... ] Galder Zamarreño updated ISPN-871: ---------------------------------- Fix Version/s: 5.2.0.ALPHA3 (was: 5.2.0.ALPHA2)

...

Out-of-heap data container implementation ----------------------------------------- Key: ISPN-871 URL: https://issues.jboss.org/browse/ISPN-871 Project: Infinispan Issue Type: Feature Request Components: Configuration Reporter: Manik Surtani Assignee: Alban Seurat Labels: gc, jni, native, performance, research Fix For: 5.2.0.ALPHA3, 5.2.0.FINAL The DataContainer interface could be implemented using a off-heap impl in C, using mmap. It would require custom memory management (gc-lite?) to reclaim free space, as well as reimplementing of eviction algorithms to maintain the contract of a self-sizing data container, but the benefits of this would be the ability to address very large amounts of memory with minimal gc overhead from the JVM.

Mircea Markus (JIRA)

Saturday, 1 September Sat, 1 Sep

1:55 p.m.

New subject: [JBoss JIRA] (ISPN-871) Out-of-heap data container implementation

[ https://issues.jboss.org/browse/ISPN-871?page=com.atlassian.jira.plugin.s... ] Mircea Markus updated ISPN-871: ------------------------------- Fix Version/s: 5.2.0.Alpha4 (was: 5.2.0.Alpha3)

...

Out-of-heap data container implementation ----------------------------------------- Key: ISPN-871 URL: https://issues.jboss.org/browse/ISPN-871 Project: Infinispan Issue Type: Feature Request Components: Configuration Reporter: Manik Surtani Assignee: Alban Seurat Labels: gc, jni, native, performance, research Fix For: 5.2.0.Alpha4, 5.2.0.Final The DataContainer interface could be implemented using a off-heap impl in C, using mmap. It would require custom memory management (gc-lite?) to reclaim free space, as well as reimplementing of eviction algorithms to maintain the contract of a self-sizing data container, but the benefits of this would be the ability to address very large amounts of memory with minimal gc overhead from the JVM.

-- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira

Manik Surtani (JIRA)

Monday, 10 September Mon, 10 Sep

1:13 p.m.

New subject: [JBoss JIRA] (ISPN-871) Out-of-heap data container implementation

[ https://issues.jboss.org/browse/ISPN-871?page=com.atlassian.jira.plugin.s... ] Manik Surtani commented on ISPN-871: ------------------------------------ Rather than using a standard hashmap in C, what about the concurrent hashmap from TBB? http://threadingbuildingblocks.org/

...

Out-of-heap data container implementation ----------------------------------------- Key: ISPN-871 URL: https://issues.jboss.org/browse/ISPN-871 Project: Infinispan Issue Type: Feature Request Components: Configuration Reporter: Manik Surtani Assignee: Alban Seurat Labels: gc, jni, native, performance, research Fix For: 5.2.0.Alpha4, 5.2.0.Final The DataContainer interface could be implemented using a off-heap impl in C, using mmap. It would require custom memory management (gc-lite?) to reclaim free space, as well as reimplementing of eviction algorithms to maintain the contract of a self-sizing data container, but the benefits of this would be the ability to address very large amounts of memory with minimal gc overhead from the JVM.

Manik Surtani (JIRA)

Tuesday, 11 September Tue, 11 Sep

1:59 p.m.

New subject: [JBoss JIRA] (ISPN-871) Out-of-heap data container implementation

[ https://issues.jboss.org/browse/ISPN-871?page=com.atlassian.jira.plugin.s... ] Manik Surtani reassigned ISPN-871: ---------------------------------- Assignee: Tristan Tarrant (was: Alban Seurat)

...

Out-of-heap data container implementation ----------------------------------------- Key: ISPN-871 URL: https://issues.jboss.org/browse/ISPN-871 Project: Infinispan Issue Type: Feature Request Components: Configuration Reporter: Manik Surtani Assignee: Tristan Tarrant Labels: gc, jni, native, performance, research Fix For: 5.2.0.Alpha4, 5.2.0.Final The DataContainer interface could be implemented using a off-heap impl in C, using mmap. It would require custom memory management (gc-lite?) to reclaim free space, as well as reimplementing of eviction algorithms to maintain the contract of a self-sizing data container, but the benefits of this would be the ability to address very large amounts of memory with minimal gc overhead from the JVM.

Manik Surtani (JIRA)

2:03 p.m.

New subject: [JBoss JIRA] (ISPN-871) Out-of-heap data container implementation

[ https://issues.jboss.org/browse/ISPN-871?page=com.atlassian.jira.plugin.s... ] Manik Surtani updated ISPN-871: ------------------------------- Fix Version/s: 5.2.0.Beta1 (was: 5.2.0.Alpha4) Description: The {{DataContainer}} interface could be implemented using a off-heap impl in C, using a wrapper around [TBB|http://threadingbuildingblocks.org/]'s concurrent hashmap. Cheap and easy way, no memory management needed, at worst case same performance as the Java CHM-like impl of the data container + some JNI overhead. Potential benefit of large data heaps. was:The DataContainer interface could be implemented using a off-heap impl in C, using mmap. It would require custom memory management (gc-lite?) to reclaim free space, as well as reimplementing of eviction algorithms to maintain the contract of a self-sizing data container, but the benefits of this would be the ability to address very large amounts of memory with minimal gc overhead from the JVM. Complexity: Medium (was: High)

...

Out-of-heap data container implementation ----------------------------------------- Key: ISPN-871 URL: https://issues.jboss.org/browse/ISPN-871 Project: Infinispan Issue Type: Feature Request Components: Configuration Reporter: Manik Surtani Assignee: Tristan Tarrant Labels: gc, jni, native, performance, research Fix For: 5.2.0.Beta1, 5.2.0.Final The {{DataContainer}} interface could be implemented using a off-heap impl in C, using a wrapper around [TBB|http://threadingbuildingblocks.org/]'s concurrent hashmap. Cheap and easy way, no memory management needed, at worst case same performance as the Java CHM-like impl of the data container + some JNI overhead. Potential benefit of large data heaps.

Mircea Markus (JIRA)

Friday, 21 September Fri, 21 Sep

8:59 a.m.

New subject: [JBoss JIRA] (ISPN-871) Out-of-heap data container implementation

[ https://issues.jboss.org/browse/ISPN-871?page=com.atlassian.jira.plugin.s... ] Mircea Markus updated ISPN-871: ------------------------------- Fix Version/s: 6.0.0.Final (was: 5.2.0.Final) (was: 5.2.0.Beta1)

...

Out-of-heap data container implementation ----------------------------------------- Key: ISPN-871 URL: https://issues.jboss.org/browse/ISPN-871 Project: Infinispan Issue Type: Feature Request Components: Configuration Reporter: Manik Surtani Assignee: Tristan Tarrant Labels: gc, jni, native, performance, research Fix For: 6.0.0.Final The {{DataContainer}} interface could be implemented using a off-heap impl in C, using a wrapper around [TBB|http://threadingbuildingblocks.org/]'s concurrent hashmap. Cheap and easy way, no memory management needed, at worst case same performance as the Java CHM-like impl of the data container + some JNI overhead. Potential benefit of large data heaps.

4233

days inactive

4852

days old

infinispan-issues@lists.jboss.org

Manage subscription

16 comments

6 participants

tags (0)

participants (6)

Alban Seurat (JIRA)
Galder Zamarreño (JIRA)
Galder Zamarreño (Updated) (JIRA)
Manik Surtani (JIRA)
Manik Surtani (Updated) (JIRA)
Mircea Markus (JIRA)

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

[JBoss JIRA] Created: (ISPN-871) Out-of-heap data container implementation