March 2014 - infinispan-issues - Jboss List Archives

[JBoss JIRA] (ISPN-4022) M/R: Run the combiner concurrently with the mapper

by Vladimir Blagojevic (JIRA)

[ https://issues.jboss.org/browse/ISPN-4022?page=com.atlassian.jira.plugin.... ] Vladimir Blagojevic commented on ISPN-4022: ------------------------------------------- [~dan.berindei] and [~mircea.markus] I think I have a really good solution that will do parallel iteration of container's key/value pairs while doing batch combine in a staggered approach. Just as Dan suggested the algorithm will work for cases with or without combiner. I have enabled this algorithm for large tasks (distributed map/reduce, no input keys specified) See details at https://github.com/infinispan/infinispan/pull/2413 > M/R: Run the combiner concurrently with the mapper > -------------------------------------------------- > > Key: ISPN-4022 > URL: https://issues.jboss.org/browse/ISPN-4022 > Project: Infinispan > Issue Type: Feature Request > Components: Core, Distributed Execution and Map/Reduce > Affects Versions: 6.0.1.Final > Reporter: Dan Berindei > Assignee: Vladimir Blagojevic > Fix For: 7.0.0.Final > > > Because we only run the combiner after we finished the mapping phase, we need to keep all the results of the mapping phase in memory at once. We should split the output of the mapper into chunks and allow the combiner to process chunks while the mapper is still running, relieving some of the memory pressure. Maybe even block the mapper if there are too many chunks in-flight. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira

10 years, 10 months

1
0
0 / 0

[JBoss JIRA] (ISPN-4062) Infinispan directory server module is missing some dependecies

by Adrian Nistor (JIRA)

[ https://issues.jboss.org/browse/ISPN-4062?page=com.atlassian.jira.plugin.... ] Adrian Nistor updated ISPN-4062: -------------------------------- Status: Pull Request Sent (was: Coding In Progress) Git Pull Request: https://github.com/infinispan/infinispan/pull/2416 > Infinispan directory server module is missing some dependecies > -------------------------------------------------------------- > > Key: ISPN-4062 > URL: https://issues.jboss.org/browse/ISPN-4062 > Project: Infinispan > Issue Type: Bug > Components: Server > Affects Versions: 6.0.0.Final > Reporter: Adrian Nistor > Assignee: Adrian Nistor > Labels: 6.3remotequeries, 621 > Fix For: 7.0.0.Final, 7.0.0.Alpha2 > > > Configuring an indexed cache with 'infinispan' provider will result in an exception at server startup due to missing dependencies from module.xml: > {code} > 19:01:59,862 INFO [org.jboss.as.clustering.infinispan] (CacheStartThread,null,LuceneIndexesData) JBAS010281: Started LuceneIndexesData cache from local container > 19:01:59,868 INFO [org.infinispan.jmx.CacheJmxRegistration] (CacheStartThread,null,LuceneIndexesLocking) ISPN000031: MBeans were successfully registered to the platform MBean server. > 19:01:59,868 INFO [org.jboss.as.clustering.infinispan] (CacheStartThread,null,LuceneIndexesLocking) JBAS010281: Started LuceneIndexesLocking cache from local container > 19:01:59,883 ERROR [org.jboss.msc.service.fail] (MSC service thread 1-6) MSC00001: Failed to start service jboss.infinispan.local.addressbook: org.jboss.msc.service.StartException in service jboss.infinispan.local.addressbook: Failed to start service > at org.jboss.msc.service.ServiceControllerImpl$StartTask.run(ServiceControllerImpl.java:1767) [jboss-msc-1.0.4.GA.jar:1.0.4.GA] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_40] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_40] > at java.lang.Thread.run(Thread.java:724) [rt.jar:1.7.0_40] > Caused by: java.lang.NoClassDefFoundError: javax/management/MBeanRegistrationException > at java.lang.Class.forName0(Native Method) [rt.jar:1.7.0_40] > at java.lang.Class.forName(Class.java:270) [rt.jar:1.7.0_40] > at org.jboss.logging.Logger.getMessageLogger(Logger.java:2247) > at org.jboss.logging.Logger.getMessageLogger(Logger.java:2211) > at org.infinispan.util.logging.LogFactory.getLog(LogFactory.java:19) > at org.infinispan.lucene.impl.DirectoryBuilderImpl.<clinit>(DirectoryBuilderImpl.java:23) > at org.infinispan.lucene.directory.DirectoryBuilder.newDirectoryInstance(DirectoryBuilder.java:25) > at org.hibernate.search.infinispan.impl.InfinispanDirectoryProvider.start(InfinispanDirectoryProvider.java:103) > at org.hibernate.search.indexes.impl.DirectoryBasedIndexManager.initialize(DirectoryBasedIndexManager.java:103) > at org.hibernate.search.indexes.impl.IndexManagerHolder.createIndexManager(IndexManagerHolder.java:261) > at org.hibernate.search.indexes.impl.IndexManagerHolder.createIndexManager(IndexManagerHolder.java:528) > at org.hibernate.search.indexes.impl.IndexManagerHolder.createIndexManagers(IndexManagerHolder.java:495) > at org.hibernate.search.indexes.impl.IndexManagerHolder.buildEntityIndexBinding(IndexManagerHolder.java:104) > at org.hibernate.search.spi.SearchFactoryBuilder.initDocumentBuilders(SearchFactoryBuilder.java:363) > at org.hibernate.search.spi.SearchFactoryBuilder.buildNewSearchFactory(SearchFactoryBuilder.java:219) > at org.hibernate.search.spi.SearchFactoryBuilder.buildSearchFactory(SearchFactoryBuilder.java:143) > at org.infinispan.query.impl.LifecycleManager.getSearchFactory(LifecycleManager.java:213) > at org.infinispan.query.impl.LifecycleManager.cacheStarting(LifecycleManager.java:73) > at org.infinispan.factories.ComponentRegistry.notifyCacheStarting(ComponentRegistry.java:228) > at org.infinispan.factories.ComponentRegistry.start(ComponentRegistry.java:214) > at org.infinispan.CacheImpl.start(CacheImpl.java:674) > at org.infinispan.manager.DefaultCacheManager.wireAndStartCache(DefaultCacheManager.java:553) > at org.infinispan.manager.DefaultCacheManager.createCache(DefaultCacheManager.java:516) > at org.infinispan.manager.DefaultCacheManager.getCache(DefaultCacheManager.java:398) > at org.infinispan.manager.DefaultCacheManager.getCache(DefaultCacheManager.java:412) > at org.jboss.as.clustering.infinispan.DefaultEmbeddedCacheManager.getCache(DefaultEmbeddedCacheManager.java:89) > at org.jboss.as.clustering.infinispan.DefaultEmbeddedCacheManager.getCache(DefaultEmbeddedCacheManager.java:80) > at org.jboss.as.clustering.infinispan.subsystem.CacheService.start(CacheService.java:78) > at org.jboss.msc.service.ServiceControllerImpl$StartTask.startService(ServiceControllerImpl.java:1811) [jboss-msc-1.0.4.GA.jar:1.0.4.GA] > at org.jboss.msc.service.ServiceControllerImpl$StartTask.run(ServiceControllerImpl.java:1746) [jboss-msc-1.0.4.GA.jar:1.0.4.GA] > ... 3 more > Caused by: java.lang.ClassNotFoundException: javax.management.MBeanRegistrationException from [Module "org.infinispan.lucene:main" from local module loader @136d1b4 (finder: local module finder @19dc4 (roots: /home/adrian/work/cpp-client/infinispan-server-7.0.0-SNAPSHOT/modules,/home/adrian/work/cpp-client/infinispan-server-7.0.0-SNAPSHOT/modules/system/layers/base))] > at org.jboss.modules.ModuleClassLoader.findClass(ModuleClassLoader.java:190) [jboss-modules.jar:1.2.0.CR1] > at org.jboss.modules.ConcurrentClassLoader.performLoadClassUnchecked(ConcurrentClassLoader.java:468) [jboss-modules.jar:1.2.0.CR1] > at org.jboss.modules.ConcurrentClassLoader.performLoadClassChecked(ConcurrentClassLoader.java:456) [jboss-modules.jar:1.2.0.CR1] > at org.jboss.modules.ConcurrentClassLoader.performLoadClass(ConcurrentClassLoader.java:398) [jboss-modules.jar:1.2.0.CR1] > at org.jboss.modules.ConcurrentClassLoader.loadClass(ConcurrentClassLoader.java:120) [jboss-modules.jar:1.2.0.CR1] > ... 33 more > {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira

10 years, 10 months

1
0
0 / 0

[JBoss JIRA] (ISPN-3797) DataContainer should interact atomically with Persistence

by Pedro Ruivo (JIRA)

[ https://issues.jboss.org/browse/ISPN-3797?page=com.atlassian.jira.plugin.... ] Work on ISPN-3797 started by Pedro Ruivo. > DataContainer should interact atomically with Persistence > --------------------------------------------------------- > > Key: ISPN-3797 > URL: https://issues.jboss.org/browse/ISPN-3797 > Project: Infinispan > Issue Type: Enhancement > Components: Eviction, Loaders and Stores > Affects Versions: 6.0.0.Final > Reporter: Pedro Ruivo > Assignee: Pedro Ruivo > Fix For: 7.0.0.Final > > > DataContainer should handle atomically all the interactions with the Persistence. This includes all the eviction/passivation. > Main points: > * In DataContainer load/store will avoid any lose of data during concurrent operations > * Take advantage of CHMv8 > * CacheLoader and Writer Interceptors are no longer needed. > Check the mailling list for more info. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira

10 years, 10 months

1
0
0 / 0

[JBoss JIRA] (ISPN-3990) AtomicMapAPITest.testConcurrentTx fails randomly

by Pedro Ruivo (JIRA)

[ https://issues.jboss.org/browse/ISPN-3990?page=com.atlassian.jira.plugin.... ] Pedro Ruivo updated ISPN-3990: ------------------------------ Status: Pull Request Sent (was: Coding In Progress) Git Pull Request: https://github.com/infinispan/infinispan/pull/2415 > AtomicMapAPITest.testConcurrentTx fails randomly > ------------------------------------------------ > > Key: ISPN-3990 > URL: https://issues.jboss.org/browse/ISPN-3990 > Project: Infinispan > Issue Type: Bug > Components: Test Suite - Core > Affects Versions: 6.0.1.Final > Reporter: Pedro Ruivo > Assignee: Pedro Ruivo > Labels: testsuite_stability > Fix For: 7.0.0.Final, 7.0.0.Alpha2 > > > org.infinispan.atomic.AtomicMapAPITest.testConcurrentTx > http://ci.infinispan.org/viewLog.html?buildId=5946&tab=buildResultsDiv&bu... > --- > org.infinispan.atomic.RepeatableReadAtomicMapAPITest.testConcurrentTx > http://ci.infinispan.org/viewLog.html?buildId=6518&tab=buildResultsDiv&bu... -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira

10 years, 10 months

1
0
0 / 0

[JBoss JIRA] (ISPN-4061) JPA Cache Store fails on Oracle, Postgres and MsSQL

by Vojtech Juranek (JIRA)

[ https://issues.jboss.org/browse/ISPN-4061?page=com.atlassian.jira.plugin.... ] Vojtech Juranek updated ISPN-4061: ---------------------------------- Description: Current snapshot version of JPA Cache Store fails on Oracle (see [failed tests|https://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/infinispan-jpa...] with stack traces), Postgres ([failed tests|https://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/infinispan-jpa...]) and MsSQL ([failed tests|https://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/infinispan-jpa...]). While in case of Oracle and Postgres the problem is probably in {{\_\_ispn_metadata\_\_}} table, in case of MsSQL problem is in "User" entity, as User is reserved name in MsSQL. Oracle has a problem with table starting with underscrore, in case of Postgres {{VARBINARY}} type used in {{\_\_ispn_metadata\_\_}} is not available in. In case of MsSQL I'm not completely sure if it's bug or if it should be handled by user. was: Current snapshot version of JPA Cache Store fails on Oracle (see [failed tests|https://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/infinispan-jpa...] with stack traces), Postgres ([failed tests|https://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/infinispan-jpa...]) and MsSQL ([failed tests|https://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/infinispan-jpa...]). While in case of Oracle and Postgres the problem is probably in {{\_\_ispn_metadata__}} table, in case of MsSQL problem is in "User" entity, as User is reserved name in MySQL. In case of MySQL I'm not completely sure if it's bug or if it should be handled by user, but IMHO it should be considered as a bug, as JPA/Hibernate should provide DB agnostic interface and handle such cases. Besides that {{VARBINARY}} type used in {{\_\_ispn_metadata__}} is not available in Postgres. > JPA Cache Store fails on Oracle, Postgres and MsSQL > --------------------------------------------------- > > Key: ISPN-4061 > URL: https://issues.jboss.org/browse/ISPN-4061 > Project: Infinispan > Issue Type: Bug > Components: Loaders and Stores > Reporter: Vojtech Juranek > Assignee: Dan Berindei > > Current snapshot version of JPA Cache Store fails on Oracle (see [failed tests|https://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/infinispan-jpa...] with stack traces), Postgres ([failed tests|https://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/infinispan-jpa...]) and MsSQL ([failed tests|https://jenkins.mw.lab.eng.bos.redhat.com/hudson/job/infinispan-jpa...]). > While in case of Oracle and Postgres the problem is probably in {{\_\_ispn_metadata\_\_}} table, in case of MsSQL problem is in "User" entity, as User is reserved name in MsSQL. Oracle has a problem with table starting with underscrore, in case of Postgres {{VARBINARY}} type used in {{\_\_ispn_metadata\_\_}} is not available in. In case of MsSQL I'm not completely sure if it's bug or if it should be handled by user. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira

10 years, 10 months

1
0
0 / 0

[JBoss JIRA] (ISPN-3990) AtomicMapAPITest.testConcurrentTx fails randomly

by Pedro Ruivo (JIRA)

[ https://issues.jboss.org/browse/ISPN-3990?page=com.atlassian.jira.plugin.... ] Pedro Ruivo commented on ISPN-3990: ----------------------------------- looking at the logs, it looks like the timeout is smaller: {code} 02:33:22,213 ERROR (remote-thread-0,RepeatableReadAtomicMapAPITest-NodeA:atomic) [InvocationContextInterceptor] ISPN000136: Execution error org.infinispan.util.concurrent.TimeoutException: Unable to acquire lock after [100 milliseconds] on key [testConcurrentTx] for requestor [GlobalTransaction:<RepeatableReadAtomicMapAPITest-NodeB-52610>:1079:remote]! Lock held by [GlobalTransaction:<RepeatableReadAtomicMapAPITest-NodeA-53860>:1074:local] {code} > AtomicMapAPITest.testConcurrentTx fails randomly > ------------------------------------------------ > > Key: ISPN-3990 > URL: https://issues.jboss.org/browse/ISPN-3990 > Project: Infinispan > Issue Type: Bug > Components: Test Suite - Core > Affects Versions: 6.0.1.Final > Reporter: Pedro Ruivo > Assignee: Pedro Ruivo > Labels: testsuite_stability > Fix For: 7.0.0.Final, 7.0.0.Alpha2 > > > org.infinispan.atomic.AtomicMapAPITest.testConcurrentTx > http://ci.infinispan.org/viewLog.html?buildId=5946&tab=buildResultsDiv&bu... > --- > org.infinispan.atomic.RepeatableReadAtomicMapAPITest.testConcurrentTx > http://ci.infinispan.org/viewLog.html?buildId=6518&tab=buildResultsDiv&bu... -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira

10 years, 10 months

1
0
0 / 0

[JBoss JIRA] (ISPN-3990) AtomicMapAPITest.testConcurrentTx fails randomly

by Pedro Ruivo (JIRA)

[ https://issues.jboss.org/browse/ISPN-3990?page=com.atlassian.jira.plugin.... ] Work on ISPN-3990 started by Pedro Ruivo. > AtomicMapAPITest.testConcurrentTx fails randomly > ------------------------------------------------ > > Key: ISPN-3990 > URL: https://issues.jboss.org/browse/ISPN-3990 > Project: Infinispan > Issue Type: Bug > Components: Test Suite - Core > Affects Versions: 6.0.1.Final > Reporter: Pedro Ruivo > Assignee: Pedro Ruivo > Labels: testsuite_stability > Fix For: 7.0.0.Final, 7.0.0.Alpha2 > > > org.infinispan.atomic.AtomicMapAPITest.testConcurrentTx > http://ci.infinispan.org/viewLog.html?buildId=5946&tab=buildResultsDiv&bu... > --- > org.infinispan.atomic.RepeatableReadAtomicMapAPITest.testConcurrentTx > http://ci.infinispan.org/viewLog.html?buildId=6518&tab=buildResultsDiv&bu... -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira

10 years, 10 months

1
0
0 / 0

[JBoss JIRA] (ISPN-4075) State transfer should preserve the creation timestamp of entries

by Dan Berindei (JIRA)

Dan Berindei created ISPN-4075: ---------------------------------- Summary: State transfer should preserve the creation timestamp of entries Key: ISPN-4075 URL: https://issues.jboss.org/browse/ISPN-4075 Project: Infinispan Issue Type: Feature Request Components: Core Affects Versions: 6.0.1.Final Reporter: Dan Berindei Assignee: Dan Berindei Fix For: 7.0.0.Final State transfer inserts values with the current time as the creation time. Since the entries store the expected lifespan and not the expected expiration time, entries on the receiving node could expire much later than intended. The argument probably doesn't apply to the timestamp of the last usage. Since state transfer process could be interpreted as a reader, it should be fine to extend the update the time of the last usage both on the sending node and on the receiving node. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira

10 years, 10 months

1
0
0 / 0

[JBoss JIRA] (ISPN-3160) RemoteCacheManager javadocs list wrong default pool size

by Tristan Tarrant (JIRA)

[ https://issues.jboss.org/browse/ISPN-3160?page=com.atlassian.jira.plugin.... ] Tristan Tarrant updated ISPN-3160: ---------------------------------- Status: Pull Request Sent (was: Open) Git Pull Request: https://github.com/infinispan/infinispan/pull/2414 > RemoteCacheManager javadocs list wrong default pool size > -------------------------------------------------------- > > Key: ISPN-3160 > URL: https://issues.jboss.org/browse/ISPN-3160 > Project: Infinispan > Issue Type: Bug > Components: Remote Protocols > Affects Versions: 5.1.8.Final > Reporter: Dennis Reed > Assignee: Galder Zamarreño > Priority: Minor > > RemoteCacheManager javadocs list the default pool size as 10: > "infinispan.client.hotrod.default_executor_factory.pool_size, default = 10." > However, the default is actually 99: > org/infinispan/client/hotrodimpl/ConfigurationProperties.java: return props.getIntProperty(DEFAULT_EXECUTOR_FACTORY_POOL_SIZE, 99); -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira

10 years, 10 months

1
0
0 / 0

[JBoss JIRA] (ISPN-4074) Only include public API in JavaDoc

by Tristan Tarrant (JIRA)

[ https://issues.jboss.org/browse/ISPN-4074?page=com.atlassian.jira.plugin.... ] Tristan Tarrant updated ISPN-4074: ---------------------------------- Status: Pull Request Sent (was: Open) Git Pull Request: https://github.com/infinispan/infinispan/pull/2414 > Only include public API in JavaDoc > ---------------------------------- > > Key: ISPN-4074 > URL: https://issues.jboss.org/browse/ISPN-4074 > Project: Infinispan > Issue Type: Feature Request > Components: Build process, Documentation-Core > Affects Versions: 7.0.0.Alpha1 > Reporter: Tristan Tarrant > Assignee: Tristan Tarrant > Fix For: 7.0.0.Alpha2 > > > Introduce a @public tag and a custom Doclet so that we can filter out non-public interfaces/classes from the Javadocs -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira

10 years, 10 months

1
0
0 / 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

infinispan-issues March 2014