[jboss-user] [JBoss jBPM] - handling bulk amounts of processinstances; transaction probl

Can anybody give some advice? I am trying to figure out if and how jBPM can handle large amounts of processinstances at once. The scenario is this: a collection of domain-objects (possible 100.000) has to be processed. All elements may need the same update, but it may also be possible to deal with each element individually; The 1st approach i tried was to create 100.000 processinstances individually. This costs lots of time: almost 4 hours, which is not acceptible. So i tried some different approaches: 1. use batches when closing a jbpmContext to create and signall instances 2. let a process create 10.000 subprocesses (foreachfork) 3. use foreachfork for each element of the collection 4. tried those last 2 with an asynchronous processstep This last method ensured that each fork was scheduled as a job One problem occurred every time: when upsizing the collection from 100 to 10.000 instances, forks or subprocesses, i recieve an errormessage concerning a transaction: - transaction not active, cannot open connection - transaction closed, cannot commit i searched the forums an found that this is probably caused by a transaction-timeout, which you happily can change. http://wiki.jboss.org/wiki/Wiki.jsp?page=TransactionTimeout i think this essentially doesn't fix my problems, cause i can't be upsizing my timeout to eternity. Besides it puzzles me that even the job-executor gets these exceptions. So my guess is that i should change the config. I know there are some options left, but i don't know what is wise. Can anybody give me some advice? thanx, Marc my current config JBOSS 4.2.2 GA JBPM 3.2.2 Oracle 9 <jbpm-context> | <service name="persistence"> | <factory> | <bean class="org.jbpm.persistence.db.DbPersistenceServiceFactory"> | <field name="isTransactionEnabled"><false /></field> | <field name="isCurrentSessionEnabled"><true /></field> | </bean> | </factory> | </service> | <service name="tx" factory="org.jbpm.tx.TxServiceFactory" /> | <service name="message" factory="org.jbpm.msg.db.DbMessageServiceFactory" /> | <service name="scheduler" factory="org.jbpm.scheduler.db.DbSchedulerServiceFactory" /> | <!--service name="logging" factory="org.jbpm.logging.db.DbLoggingServiceFactory" /--> | <service name="authentication" factory="org.jbpm.security.authentication.DefaultAuthenticationServiceFactory" /> | | ... | | <bean name="jbpm.job.executor" class="org.jbpm.job.executor.JobExecutor"> | <field name="jbpmConfiguration"><ref bean="jbpmConfiguration" /></field> | <field name="name"><string value="JbpmJobExector" /></field> | <field name="nbrOfThreads"><int value="50" /></field> | <field name="idleInterval"><int value="5000" /></field> | <field name="maxIdleInterval"><int value="3600000" /></field> <!-- 1 hour --> | <field name="historyMaxSize"><int value="20" /></field> | <field name="maxLockTime"><int value="600000" /></field> <!-- 10 minutes --> | <field name="lockMonitorInterval"><int value="60000" /></field> <!-- 1 minute --> | <field name="lockBufferTime"><int value="5000" /></field> <!-- 5 seconds --> | </bean> | | | </jbpm-context> | | <hibernate-configuration> | <session-factory> | <property name="hibernate.session_factory_name">JbpmHibernateSessionFactory</property> | <property name="hibernate.connection.autocommit">false</property> | <property name="hibernate.jndi.class">org.jnp.interfaces.NamingContextFactory</property> | <property name="hibernate.dialect">org.hibernate.dialect.Oracle9iDialect</property> | <property name="hibernate.show_sql">false</property> | <property name="hibernate.format_sql">false</property> | <property name="hibernate.use_sql_comments">false</property> | <property name="hibernate.cache.provider_class">org.hibernate.cache.HashtableCacheProvider</property> <!-- org.hibernate.cache.EhCacheProvider --> | <property name="hibernate.connection.datasource">java:/JbpmDS</property> | <property name="hibernate.transaction.factory_class">org.hibernate.transaction.JTATransactionFactory</property> | <property name="hibernate.transaction.manager_lookup_class">org.hibernate.transaction.JBossTransactionManagerLookup</property> | <property name="jta.UserTransaction">java:comp/UserTransaction</property> | ... | ... | </hibernate-configuration> | | | View the original post : http://www.jboss.com/index.html?module=bb&op=viewtopic&p=4126589#... Reply to the post : http://www.jboss.com/index.html?module=bb&op=posting&mode=reply&a...