[JBoss JIRA] (ISPN-1568) Clustered Query fail when hibernate search not fully initialized

Thursday, 24 November 2011

Clustered Query fail when hibernate search not fully initialized
----------------------------------------------------------------

                 Key: ISPN-1568
                 URL: https://issues.jboss.org/browse/ISPN-1568
             Project: Infinispan
          Issue Type: Bug
          Components: Querying, RPC
    Affects Versions: 5.1.0.BETA5
            Reporter: Mathieu Lachance
            Assignee: Sanne Grinovero

Hi,

I'm running into this issue when doing a clustered query in distribution mode :

org.infinispan.CacheException: org.hibernate.search.SearchException: Not a mapped entity
(don't forget to add @Indexed): class com.XXX.Client
	at org.infinispan.remoting.rpc.RpcManagerImpl.invokeRemotely(RpcManagerImpl.java:166)
	at org.infinispan.remoting.rpc.RpcManagerImpl.invokeRemotely(RpcManagerImpl.java:181)
	at
org.infinispan.query.clustered.ClusteredQueryInvoker.broadcast(ClusteredQueryInvoker.java:113)
	at
org.infinispan.query.clustered.ClusteredCacheQueryImpl.broadcastQuery(ClusteredCacheQueryImpl.java:115)
	at
org.infinispan.query.clustered.ClusteredCacheQueryImpl.iterator(ClusteredCacheQueryImpl.java:90)
	at org.infinispan.query.impl.CacheQueryImpl.iterator(CacheQueryImpl.java:129)
	at
org.infinispan.query.clustered.ClusteredCacheQueryImpl.list(ClusteredCacheQueryImpl.java:133)
	at com.XXX.DistributedCache.cacheQueryList(DistributedCache.java:313)
	at com.XXX.DistributedCache.cacheQueryList(DistributedCache.java:274)
	at com.XXX.ClientCache.getClientsByServerId(ClientCache.java:127)
	at com.XXX.ClientManager.getClientsByServerId(ClientManager.java:157)
	at com.XXX$PingClient.run(PlayerBll.java:890)
	at java.util.TimerThread.mainLoop(Timer.java:512)
	at java.util.TimerThread.run(Timer.java:462)
Caused by: org.hibernate.search.SearchException: Not a mapped entity (don't forget to
add @Indexed): class com.XXX.Client
	at
org.hibernate.search.query.engine.impl.HSQueryImpl.buildSearcher(HSQueryImpl.java:549)
	at
org.hibernate.search.query.engine.impl.HSQueryImpl.buildSearcher(HSQueryImpl.java:493)
	at
org.hibernate.search.query.engine.impl.HSQueryImpl.queryDocumentExtractor(HSQueryImpl.java:292)
	at
org.infinispan.query.clustered.commandworkers.CQCreateEagerQuery.perform(CQCreateEagerQuery.java:44)
	at
org.infinispan.query.clustered.ClusteredQueryCommand.perform(ClusteredQueryCommand.java:135)
	at
org.infinispan.query.clustered.ClusteredQueryCommand.perform(ClusteredQueryCommand.java:129)
	at
org.infinispan.remoting.InboundInvocationHandlerImpl.handleInternal(InboundInvocationHandlerImpl.java:170)
	at
org.infinispan.remoting.InboundInvocationHandlerImpl.handleWithWaitForBlocks(InboundInvocationHandlerImpl.java:179)
	at
org.infinispan.remoting.InboundInvocationHandlerImpl.handleWithRetry(InboundInvocationHandlerImpl.java:208)
	at
org.infinispan.remoting.InboundInvocationHandlerImpl.handle(InboundInvocationHandlerImpl.java:156)
	at
org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.executeCommand(CommandAwareRpcDispatcher.java:162)
	at
org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.handle(CommandAwareRpcDispatcher.java:141)
	at org.jgroups.blocks.RequestCorrelator.handleRequest(RequestCorrelator.java:447)
	at org.jgroups.blocks.RequestCorrelator.receiveMessage(RequestCorrelator.java:354)
	at org.jgroups.blocks.RequestCorrelator.receive(RequestCorrelator.java:230)
	at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.up(MessageDispatcher.java:556)
	at org.jgroups.JChannel.up(JChannel.java:716)
	at org.jgroups.stack.ProtocolStack.up(ProtocolStack.java:1026)
	at org.jgroups.protocols.FRAG2.up(FRAG2.java:181)
	at org.jgroups.protocols.FlowControl.up(FlowControl.java:418)
	at org.jgroups.protocols.FlowControl.up(FlowControl.java:418)
	at org.jgroups.protocols.pbcast.GMS.up(GMS.java:881)
	at
org.jgroups.protocols.pbcast.StreamingStateTransfer.up(StreamingStateTransfer.java:262)
	at org.jgroups.protocols.pbcast.STABLE.up(STABLE.java:244)
	at org.jgroups.protocols.UNICAST.up(UNICAST.java:332)
	at org.jgroups.protocols.pbcast.NAKACK.handleMessage(NAKACK.java:700)
	at org.jgroups.protocols.pbcast.NAKACK.up(NAKACK.java:561)
	at org.jgroups.protocols.VERIFY_SUSPECT.up(VERIFY_SUSPECT.java:140)
	at org.jgroups.protocols.FD.up(FD.java:273)
	at org.jgroups.protocols.FD_SOCK.up(FD_SOCK.java:284)
	at org.jgroups.protocols.MERGE2.up(MERGE2.java:205)
	at org.jgroups.protocols.Discovery.up(Discovery.java:354)
	at org.jgroups.protocols.TP.passMessageUp(TP.java:1174)
	at org.jgroups.protocols.TP$IncomingPacket.handleMyMessage(TP.java:1709)
	at org.jgroups.protocols.TP$IncomingPacket.run(TP.java:1691)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
	at java.lang.Thread.run(Thread.java:662)

With the use of the following

cache configuration :
<infinispan xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
	xsi:schemaLocation="urn:infinispan:config:5.1
http://www.infinispan.org/schemas/infinispan-config-5.1.xsd"
	xmlns="urn:infinispan:config:5.1">

	<global>
		<transport clusterName="XXX-cluster" machineId="XXX"
siteId="XXX" rackId="XXX"
distributedSyncTimeout="15000">
			<properties>
				<property name="configurationFile"
value="jgroups-jdbc-ping.xml" />
			</properties>
		</transport>
	</global>

	<default>
		<transaction
			cacheStopTimeout="30000"
			transactionManagerLookupClass="org.infinispan.transaction.lookup.DummyTransactionManagerLookup"
			lockingMode="PESSIMISTIC"
			useSynchronization="true"
			transactionMode="TRANSACTIONAL"
			syncCommitPhase="true"
			syncRollbackPhase="false"
...
 			<recovery enabled="false" />
		</transaction>
		<clustering mode="local" />
		<indexing enabled="true" indexLocalOnly="true">
			<properties>
				<property name="hibernate.search.default.directory_provider"
value="ram" />
			</properties>
		</indexing>
	</default>

	<namedCache name="XXX-Client">
		<transaction
			cacheStopTimeout="30000"
			transactionManagerLookupClass="org.infinispan.transaction.lookup.DummyTransactionManagerLookup"
			lockingMode="PESSIMISTIC"
			useSynchronization="true"
			transactionMode="TRANSACTIONAL"
			syncCommitPhase="true"
			syncRollbackPhase="false"
...
 			<recovery enabled="false" />
		</transaction>
		<invocationBatching enabled="false" />
		<loaders passivation="false" />
		<clustering mode="distribution" >
			<sync replTimeout="15000" />
			<stateRetrieval
				timeout="240000"
				retryWaitTimeIncreaseFactor="2"
				numRetries="5"
				maxNonProgressingLogWrites="100"

				fetchInMemoryState="false"
				logFlushTimeout="60000"
				alwaysProvideInMemoryState="false"
			/>
		</clustering>
		<storeAsBinary enabled="false" storeValuesAsBinary="true"
storeKeysAsBinary="true" />
		<deadlockDetection enabled="true" spinDuration="100" />
		<eviction strategy="NONE" threadPolicy="PIGGYBACK"
maxEntries="-1" />
		<jmxStatistics enabled="true" />
		<locking writeSkewCheck="false" lockAcquisitionTimeout="10000"
isolationLevel="READ_COMMITTED" useLockStriping="false"
concurrencyLevel="32" />
		<expiration wakeUpInterval="60000" lifespan="-1"
maxIdle="3000000" />
	</namedCache>
</infinispan>

and jgroups configuration :
<config xmlns="urn:org:jgroups"
        xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
        xsi:schemaLocation="urn:org:jgroups file:schema/JGroups-3.0.xsd">
   <TCP
        bind_port="7800"
        loopback="true"
        port_range="30"
        recv_buf_size="20000000"
        send_buf_size="640000"
        discard_incompatible_packets="true"
        max_bundle_size="64000"
        max_bundle_timeout="30"
        enable_bundling="true"
        use_send_queues="true"
        sock_conn_timeout="300"
        enable_diagnostics="false"

        thread_pool.enabled="true"
        thread_pool.min_threads="2"
        thread_pool.max_threads="30"
        thread_pool.keep_alive_time="5000"
        thread_pool.queue_enabled="false"
        thread_pool.queue_max_size="100"
        thread_pool.rejection_policy="Discard"

        oob_thread_pool.enabled="true"
        oob_thread_pool.min_threads="2"
        oob_thread_pool.max_threads="30"
        oob_thread_pool.keep_alive_time="5000"
        oob_thread_pool.queue_enabled="false"
        oob_thread_pool.queue_max_size="100"
        oob_thread_pool.rejection_policy="Discard"        
         />

   <JDBC_PING
		connection_url="jdbc:jtds:sqlserver://XXX;databaseName=XXX"
		connection_username="XXX"
		connection_password="XXX"
		connection_driver="net.sourceforge.jtds.jdbcx.JtdsDataSource"
		initialize_sql=""
	/>

   <MERGE2 max_interval="30000"
           min_interval="10000"/>
   <FD_SOCK/>
   <FD timeout="3000" max_tries="3"/>
   <VERIFY_SUSPECT timeout="1500"/>
   <pbcast.NAKACK
         use_mcast_xmit="false"
         retransmit_timeout="300,600,1200,2400,4800"
         discard_delivered_msgs="false"/>
   <UNICAST timeout="300,600,1200"/>
   <pbcast.STABLE stability_delay="1000"
desired_avg_gossip="50000"
                  max_bytes="400000"/>
   <pbcast.STATE />
   <pbcast.GMS print_local_addr="false" join_timeout="7000"
view_bundling="true"/>
   <UFC max_credits="2000000" min_threshold="0.10"/>
   <MFC max_credits="2000000" min_threshold="0.10"/>
   <FRAG2 frag_size="60000"/>
</config>

Tough my entity is well annotated.

Here's the steps to reproduce :
1. boot node A completly.
2. boot node B, make all caches start (DefaultCacheManager::startCaches(...)), then
breakpoint just after.
3. on node A, do a clustered query.
4. node A fail because node b has not been fully initialized.

Here's how I do my query :
	private CacheQuery getClusteredNonClusteredQuery(Query query)
	{
		CacheQuery cacheQuery;
		if (useClusteredQuery)
		{
			cacheQuery = searchManager.getClusteredQuery(query, cacheValueClass);
		}
		else
		{
			cacheQuery = searchManager.getQuery(query, cacheValueClass);
		}
		return cacheQuery;
	}

I've tried also without supplying any "cacheValueClass" without any
success.

One ugly "workaround" I've found is, to as soon as possible in the
application, to force the local insertion and removal of one dummy key and value to force
initialization of the search manager like : 
cache.getAdvancedCache().withFlags(Flag.CACHE_MODE_LOCAL).put("XXX", new
Client("XXX");
cache.getAdvancedCache().withFlags(Flag.CACHE_MODE_LOCAL).remove("XXX");

Tough this technique won't still garanty me that any clustered query will occur
before.

I think the issue this might as well be related to issue : ISPN-627 Provision to get Cache
from CacheManager.

Any idea or workaround ? Do you think by just adding a try catch and return an empty list
could "fix" the problem ?

Thanks a lot,

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.jboss.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009