January 2014 - infinispan-issues - Jboss List Archives

[JBoss JIRA] (ISPN-2941) Apache Hadoop MapReduce Impl

by Mircea Markus (JIRA)

[ https://issues.jboss.org/browse/ISPN-2941?page=com.atlassian.jira.plugin.... ] Mircea Markus updated ISPN-2941: -------------------------------- Component/s: Distributed Execution and Map/Reduce > Apache Hadoop MapReduce Impl > ---------------------------- > > Key: ISPN-2941 > URL: https://issues.jboss.org/browse/ISPN-2941 > Project: Infinispan > Issue Type: Feature Request > Components: Distributed Execution and Map/Reduce > Reporter: Shane Johnson > Assignee: Vladimir Blagojevic > > Create an Apache Hadoop MapReduce implementation. This will allow ISPN to execute HMR tasks. Perhaps allowing the working set to expand via an Apache HDFS cache store. > Seeing M3R (In-Memory Apache Hadoop MapReduce) > http://nosql.mypopescu.com/post/45411648905/paper-m3r-increased-performan... > Tighter integration with Apache Hadoop allows for hybrid architectures with ISPN. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira

12 years, 2 months

1
0
0 / 0

[JBoss JIRA] (ISPN-2940) Apache HDFS Cache Store

by Mircea Markus (JIRA)

[ https://issues.jboss.org/browse/ISPN-2940?page=com.atlassian.jira.plugin.... ] Mircea Markus closed ISPN-2940. ------------------------------- Resolution: Rejected I think we'll be better of with ISPN-2941, as all the Hadoop tooling running on top of M/R could be re-used on top of Infinispan > Apache HDFS Cache Store > ----------------------- > > Key: ISPN-2940 > URL: https://issues.jboss.org/browse/ISPN-2940 > Project: Infinispan > Issue Type: Feature Request > Reporter: Shane Johnson > Assignee: Manik Surtani > > Create an Apache HDFS cache store. Perhaps using the Parquet file format. Perhaps using a similar approach to HBase (WAL/memtable/SSTable). This will not only allow for durable data, but for the data to be processed using Apache Hadoop components (e.g. Hive / Cloudera Impala). > http://parquet.github.com/ > Tighter integration with Apache Hadoop allows for hybrid architectures with ISPN. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira

12 years, 2 months

1
0
0 / 0

[JBoss JIRA] (ISPN-2943) Apache Flume NG Cache Store

by Mircea Markus (JIRA)

[ https://issues.jboss.org/browse/ISPN-2943?page=com.atlassian.jira.plugin.... ] Mircea Markus updated ISPN-2943: -------------------------------- Component/s: Loaders and Stores > Apache Flume NG Cache Store > --------------------------- > > Key: ISPN-2943 > URL: https://issues.jboss.org/browse/ISPN-2943 > Project: Infinispan > Issue Type: Feature Request > Components: Loaders and Stores > Reporter: Shane Johnson > Assignee: Manik Surtani > > Create an Apache Flume NG cache store by creating an ISPN Apache Flume NG source. The ISPN cache store then sends data via events to Apache Flume NG. This might be a nice way to abstract the persistence as Apache Flume NG can then send the event to any number of sinks (e.g. Apache HDFS). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira

12 years, 2 months

1
0
0 / 0

[JBoss JIRA] (ISPN-2947) Column Oriented Data Model

by Mircea Markus (JIRA)

[ https://issues.jboss.org/browse/ISPN-2947?page=com.atlassian.jira.plugin.... ] Mircea Markus updated ISPN-2947: -------------------------------- Component/s: Core > Column Oriented Data Model > -------------------------- > > Key: ISPN-2947 > URL: https://issues.jboss.org/browse/ISPN-2947 > Project: Infinispan > Issue Type: Feature Request > Components: Core > Reporter: Shane Johnson > Assignee: Mircea Markus > > Create a column oriented data model. Big Data analytics vendors are now relying on distributed, in-memory column stores. I think that ISPN should support a column store configuration. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira

12 years, 2 months

1
0
0 / 0

[JBoss JIRA] (ISPN-2941) Apache Hadoop MapReduce Impl

by Mircea Markus (JIRA)

[ https://issues.jboss.org/browse/ISPN-2941?page=com.atlassian.jira.plugin.... ] Mircea Markus updated ISPN-2941: -------------------------------- Assignee: Vladimir Blagojevic (was: Mircea Markus) > Apache Hadoop MapReduce Impl > ---------------------------- > > Key: ISPN-2941 > URL: https://issues.jboss.org/browse/ISPN-2941 > Project: Infinispan > Issue Type: Feature Request > Reporter: Shane Johnson > Assignee: Vladimir Blagojevic > > Create an Apache Hadoop MapReduce implementation. This will allow ISPN to execute HMR tasks. Perhaps allowing the working set to expand via an Apache HDFS cache store. > Seeing M3R (In-Memory Apache Hadoop MapReduce) > http://nosql.mypopescu.com/post/45411648905/paper-m3r-increased-performan... > Tighter integration with Apache Hadoop allows for hybrid architectures with ISPN. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira

12 years, 2 months

1
0
0 / 0

[JBoss JIRA] (ISPN-3455) Cache replication not warranted under load

by Mircea Markus (JIRA)

[ https://issues.jboss.org/browse/ISPN-3455?page=com.atlassian.jira.plugin.... ] Mircea Markus resolved ISPN-3455. --------------------------------- Resolution: Done closing this as it it is not an Infinispan issue. > Cache replication not warranted under load > ------------------------------------------ > > Key: ISPN-3455 > URL: https://issues.jboss.org/browse/ISPN-3455 > Project: Infinispan > Issue Type: Feature Request > Components: Core > Affects Versions: 5.3.0.Final, 6.0.0.Alpha3 > Environment: JSE 1.6.0_45; Windows 7 > Reporter: Lukasz Szelag > Assignee: Mircea Markus > Attachments: infinispan.zip > > > Problem: > When running a replicated cache and repeatedly calling a cacheable method (using Spring cache abstraction), Infinispan enters an infinite replication loop. This can be confirmed by observing replication counts growing over time, where there are no cache misses. > Expected behavior: > Caches shouldn't be replicated when there is a cache hit. > Test case: > - 3 cluster members; asynchronous replication with a replication queue > - a cacheable method is executed repeatedly using 2 different keys > Notes: > - for some reason, this issue only occurs when using Enum arguments for a cache key; I was not able to replicate this when using int or String types (see com.designamus.infinispan.Main.works()) > - the behavior is not deterministic (random), which points to a race condition > - the problem does not seem to be related to the Spring's default cache key generator; I was able to reproduce the same behavior with a custom cache key generator, which was thread-safe > - the cacheable method is executed only twice (once both keys are stored in the cache); subsequent invocations retrieve stored values from the cache; this can be confirmed by inspecting the log file > - the cache doesn't expire and entries are not evicted > - the memory usage grows over time, eventually causing OOM on a heavily loaded system > - since the issue is random in nature it may take a 3-4 attempts to reproduce it; I was successful in reproducing this behavior numerous times > Steps to reproduce: > 1. Build a test project (mvn clean compile) > 2. Execute /run.sh (this will spawn 3 JVMs) > 3. Start JConsole to monitor 3 cluster members (jconsole localhost:17001 localhost:17002 localhost:17003) > 4. Monitor "replicationCount" attribute under RpcManager for cache "MyCache" for all JVMs (see /replication-counts.png) > 5. Observe that replication counts grow over time > 6. Observe that all caches are of size 2 and there are no cache misses (see /cache-statistics.png) > If the issue cannot be reproduced (replication counts stay at the same level): > 5. Terminate all 3 JVM processes (as a convenience you can execute /stop.sh) > 6. Repeat steps 2 through 5 above > When testing the above scenario using a distributed mode, I observed some other anomalies (i.e. the cacheable method was executed multiple times, as if the value was not there). While this may be related, it deserves a separate JIRA. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira

12 years, 2 months

1
0
0 / 0

[JBoss JIRA] (ISPN-3037) Failing test: MixedModeTest.testMixedMode:72 NullPointer

by Mircea Markus (JIRA)

[ https://issues.jboss.org/browse/ISPN-3037?page=com.atlassian.jira.plugin.... ] Mircea Markus updated ISPN-3037: -------------------------------- Component/s: Test Suite - Core > Failing test: MixedModeTest.testMixedMode:72 NullPointer > -------------------------------------------------------- > > Key: ISPN-3037 > URL: https://issues.jboss.org/browse/ISPN-3037 > Project: Infinispan > Issue Type: Bug > Components: Test Suite - Core > Reporter: Sanne Grinovero > Assignee: Pedro Ruivo > Labels: testsuite_stability > > ~~~~~~~~~~~~~~~~~~~~~~~~~ ENVIRONMENT INFO ~~~~~~~~~~~~~~~~~~~~~~~~~~ > jgroups.bind_addr = 127.0.0.1 > java.runtime.version = 1.6.0_43-b01 > java.runtime.name =Java(TM) SE Runtime Environment > java.vm.version = 20.14-b01 > java.vm.vendor = Sun Microsystems Inc. > os.name = Linux > os.version = 3.8.8-202.fc18.x86_64 > sun.arch.data.model = 64 > sun.cpu.endian = little > protocol.stack = null > infinispan.test.jgroups.protocol = tcp > infinispan.unsafe.allow_jdk8_chm = true > java.net.preferIPv4Stack = true > java.net.preferIPv6Stack = null > log4.configuration = null > MAVEN_OPTS = null > ~~~~~~~~~~~~~~~~~~~~~~~~~ ENVIRONMENT INFO ~~~~~~~~~~~~~~~~~~~~~~~~~~ > Tests run: 2911, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 212.448 sec <<< FAILURE! > testMixedMode(org.infinispan.api.MixedModeTest) Time elapsed: 0.03 sec <<< FAILURE! > java.lang.NullPointerException > at org.infinispan.api.MixedModeTest.testMixedMode(MixedModeTest.java:72) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:80) > at org.testng.internal.Invoker.invokeMethod(Invoker.java:714) > at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:901) > at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1231) > at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:127) > at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:111) > at org.testng.TestRunner.privateRun(TestRunner.java:767) > at org.testng.TestRunner.run(TestRunner.java:617) > at org.testng.SuiteRunner.runTest(SuiteRunner.java:334) > at org.testng.SuiteRunner.access$000(SuiteRunner.java:37) > at org.testng.SuiteRunner$SuiteWorker.run(SuiteRunner.java:368) > at org.testng.internal.thread.ThreadUtil$2.call(ThreadUtil.java:64) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) > at java.lang.Thread.run(Thread.java:662) > Results : > Failed tests: > MixedModeTest.testMixedMode:72 NullPointer > Tests run: 2911, Failures: 1, Errors: 0, Skipped: 0 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira

12 years, 2 months

1
0
0 / 0

[JBoss JIRA] (ISPN-3025) NullMarkerEntry is singleton but can be changed - very error prone!

by Mircea Markus (JIRA)

[ https://issues.jboss.org/browse/ISPN-3025?page=com.atlassian.jira.plugin.... ] Mircea Markus updated ISPN-3025: -------------------------------- Component/s: Core > NullMarkerEntry is singleton but can be changed - very error prone! > ------------------------------------------------------------------- > > Key: ISPN-3025 > URL: https://issues.jboss.org/browse/ISPN-3025 > Project: Infinispan > Issue Type: Bug > Components: Core > Affects Versions: 5.2.5.Final > Reporter: Mircea Markus > Assignee: Mircea Markus > > NullMarkerEntry is singleton but almost all the flags it aggregates can be amended. this is dangerous as some code might read the e.g. isChanged() value in a total random manner. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira

12 years, 2 months

1
0
0 / 0

[JBoss JIRA] (ISPN-2998) NPE on shutdown: ExternalizerTableProxy already cleared

by Mircea Markus (JIRA)

[ https://issues.jboss.org/browse/ISPN-2998?page=com.atlassian.jira.plugin.... ] Mircea Markus updated ISPN-2998: -------------------------------- Component/s: Core > NPE on shutdown: ExternalizerTableProxy already cleared > ------------------------------------------------------- > > Key: ISPN-2998 > URL: https://issues.jboss.org/browse/ISPN-2998 > Project: Infinispan > Issue Type: Bug > Components: Core > Affects Versions: 5.2.5.Final > Reporter: Sanne Grinovero > Assignee: Galder Zamarreño > Priority: Minor > > Apparently the method > {code}org.infinispan.marshall.jboss.JBossMarshaller.ExternalizerTableProxy.getObjectWriter(Object){code} > can be invoked during shutdown even when _externalizerTable_ is null, generating an NPE. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira

12 years, 2 months

1
0
0 / 0

[JBoss JIRA] (ISPN-2993) Hot Rod client for Ruby

by Mircea Markus (JIRA)

[ https://issues.jboss.org/browse/ISPN-2993?page=com.atlassian.jira.plugin.... ] Mircea Markus updated ISPN-2993: -------------------------------- Component/s: Remote protocols > Hot Rod client for Ruby > ----------------------- > > Key: ISPN-2993 > URL: https://issues.jboss.org/browse/ISPN-2993 > Project: Infinispan > Issue Type: Feature Request > Components: Remote protocols > Reporter: Mircea Markus > Assignee: Mircea Markus > > Ruby client impl for HotRod. Protocol is documented here: > http://community.jboss.org/wiki/HotRodProtocol > Could be based off the Java reference impl client: > https://github.com/infinispan/infinispan/tree/master/client/hotrod-client -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira

12 years, 2 months

1
0
0 / 0

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

infinispan-issues January 2014