[Performance Tuning] - jboss 5.1.0: performance drops after one hour and strange GC behaviour
by Matt Darwin
Matt Darwin [https://community.jboss.org/people/mattdarwin] created the discussion
"jboss 5.1.0: performance drops after one hour and strange GC behaviour"
To view the discussion, visit: https://community.jboss.org/message/832880#832880
--------------------------------------------------------------
We upgraded our software from jboss 4.0.5GA to 5.1.0GA and noticed that after one hour or so (or 90 minutes in some cases) performance drops dramatically.
At the same moment, the garbage collector logs show minor garbage collection times jumping from 0.01s to ~1.5s, with the amount of the heap being cleared each time reducing from ~400MB before to ~300MB after. (see GC viewer graph 1)
https://community.jboss.org/servlet/JiveServlet/showImage/2-832880-21301/... https://community.jboss.org/servlet/JiveServlet/downloadImage/2-832880-21...
We think these are both symptoms of the the same underlying root cause.
jvm settings are:
-server -Xms2048m -Xmx2048m -XX:NewSize=384m -XX:MaxNewSize=384m -XX:SurvivorRatio=4 -XX:MinHeapFreeRatio=11 -XX:PermSize=80m -verbose:gc -XX:+PrintGCDateStamps -XX:+PrintGCDetails -XX:+DisableExplicitGC -Djava.awt.headless=TRUE -DUseSunHttpHandler=TRUE -Dsun.net.client.defaultConnectTimeout=25000 -Dsun.net.client.defaultReadTimeout=50000 -Dfile.encoding=UTF-8 -Dvzzv.log.dir=${ercorebatch.log.dir} -Xloggc:${ercorebatch.log.dir}/gc.log -Duser.language=it -Duser.region=IT -Duser.country=IT -DVFjavaWL=er.core.it
The production environment is T5220 or T2000 hardware, with 32 bit SPARC, running a Solaris 10 virtual machine. jboss 5.0.1.GA, java 1.6.0_17
We set up a test environment consisting of 2 identical boxes, running the same software but one using jboss 4.0.5GA and one using jboss 5.0.1.GA. They are VMWare VMs running on a HP ProLiant DL560 Gen8 with 4 x 2.2GHz Intel Xeon CPU E5-4620 and 64GB RAM. Guest VMs are 4 vCPU, 4096MB RAM, CentOS 6.4.
We found that we could easily reproduce the problem in our environment. The box which was running on 4.0.5 ran fine, but on jboss 5.0.1GA we saw the same strange GC behaviour. Performance can't easily be tested in our environment since we don't have the same amount of load as production.
We don't think it's a memory leak, since after each major GC, the used heap size returns to the same size:
https://community.jboss.org/servlet/JiveServlet/showImage/2-832880-21302/... https://community.jboss.org/servlet/JiveServlet/downloadImage/2-832880-21...
Analysing heap dumps taken pre- and post-apocalypse, we discovered the number of the following objects was different:
org.jboss.virtual.plugins.context.file.FileSystemContext
during the first hour, there are about 8 of them, and after the apocalypse hits, we see between 100 and 800.
Other than that, the heap dumps look quite similar, and the top objects are either java or jboss objects (ie no application classes)
Setting -Djboss.vfs.forceVfsJar=true on our test environment fixed the problem (ie the strange GC behaviour disappeared) but when applied in production, both the strange GC pattern and the performance problem remained - although the GC times didn't increase so much (to 0.3 seconds rather than 1.5 seconds).
In our test environment, we then deployed the same software in jboss 5.1.0 and found the same behaviour as with 5.0.1.
So the conclusions at this point are that there is something happening in jboss 5.x around the 60 / 90 minute mark which has an impact on both garbage collection and performance.
--------------------------------------------------------------
Reply to this message by going to Community
[https://community.jboss.org/message/832880#832880]
Start a new discussion in Performance Tuning at Community
[https://community.jboss.org/choose-container!input.jspa?contentType=1&con...]
11 years, 3 months
[jBPM] - where to set "update" in databaseschema
by Thomas Colditz
Thomas Colditz [https://community.jboss.org/people/fellowtom] created the discussion
"where to set "update" in databaseschema"
To view the discussion, visit: https://community.jboss.org/message/832618#832618
--------------------------------------------------------------
Hi Community,
I simply want to setup jBPM with embedded H2 database. It works, that it isn't an inmem db. But everytime the engine is startet again, all content of db is overwritten.
I think the problem is an "create"-statement somewhere, where an "update" should be inserted. But I just dont know where...
Here's sample code:
public static void main(String[] args) {
try {
RuntimeManager manager = getRuntimeManager("processDefinition/simpleTestProcess.bpmn");
RuntimeEngine runtime = manager.getRuntimeEngine(EmptyContext.get());
KieSession ksession = runtime.getKieSession();
ksession.startProcess("serviceTestProcess");
} catch (Throwable t) {
t.printStackTrace();
}
}
private static RuntimeManager getRuntimeManager(String process) {
JBPMHelper.startH2Server();
Properties properties = new Properties();
PoolingDataSource pds = new PoolingDataSource();
pds.setUniqueName(properties.getProperty("persistence.datasource.name", "jdbc/jbpm-ds"));
pds.setClassName("bitronix.tm.resource.jdbc.lrc.LrcXADataSource");
pds.setMaxPoolSize(5);
pds.setAllowLocalTransactions(true);
pds.getDriverProperties().put("user", properties.getProperty("persistence.datasource.user", "sa"));
pds.getDriverProperties().put("password", properties.getProperty("persistence.datasource.password", "sa"));
pds.getDriverProperties().put("url", properties.getProperty("persistence.datasource.url", "jdbc:h2:~/JBPM/process_jbpm;MVCC=TRUE"));
pds.getDriverProperties().put("driverClassName", properties.getProperty("persistence.datasource.driverClassName", "org.h2.Driver"));
pds.init();
RuntimeEnvironment environment = RuntimeEnvironmentBuilder.getDefault()
.addAsset(ResourceFactory.newClassPathResource(process), ResourceType.BPMN2)
.get();
return RuntimeManagerFactory.Factory.get().newSingletonRuntimeManager(environment);
}
Please let me know, where/how to fix the problem.
With kind regards,
Tom
--------------------------------------------------------------
Reply to this message by going to Community
[https://community.jboss.org/message/832618#832618]
Start a new discussion in jBPM at Community
[https://community.jboss.org/choose-container!input.jspa?contentType=1&con...]
11 years, 3 months
[JBoss Remoting] - Error connecting to jmx for server JBoss 7.1 Runtime Server
by Pavel Garanin
Pavel Garanin [https://community.jboss.org/people/loki6999] created the discussion
"Error connecting to jmx for server JBoss 7.1 Runtime Server"
To view the discussion, visit: https://community.jboss.org/message/832867#832867
--------------------------------------------------------------
HI all, i hav problam with conn to jmx from eclips. Jboss server is started but uf open log list i see next
Error connecting to jmx for server JBoss 7.1 Runtime Server
if open to mor information will be se next cod Error
org.jboss.tools.jmx.core.JMXException: Unable to reach JBoss instance. Please ensure your server is up and exposes its management ports via the -Djboss.bind.address.management=yourwebsite.com system property
at org.jboss.ide.eclipse.as.jmx.integration.JBoss71ServerConnection.createConnection(JBoss71ServerConnection.java:87)
at org.jboss.ide.eclipse.as.jmx.integration.JBossServerConnection.run(JBossServerConnection.java:143)
at org.jboss.ide.eclipse.as.jmx.integration.JBossServerConnection.run(JBossServerConnection.java:127)
at org.jboss.ide.eclipse.as.jmx.integration.JBossServerConnection.run(JBossServerConnection.java:116)
at org.jboss.ide.eclipse.as.jmx.integration.JBossServerConnection.connectToStartedServer(JBossServerConnection.java:233)
at org.jboss.ide.eclipse.as.jmx.integration.JBossServerConnection$1.run(JBossServerConnection.java:225)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:53)
Caused by: java.lang.RuntimeException: Operation failed with status WAITING
at org.jboss.remoting3.jmx.RemotingConnector.connect(RemotingConnector.java:155)
at javax.management.remote.JMXConnectorFactory.connect(Unknown Source)
at org.jboss.ide.eclipse.as.jmx.integration.JBoss71ServerConnection.createConnection(JBoss71ServerConnection.java:71)
... 6 more
Wat i mast do ?
P.S. Sorri for my English
--------------------------------------------------------------
Reply to this message by going to Community
[https://community.jboss.org/message/832867#832867]
Start a new discussion in JBoss Remoting at Community
[https://community.jboss.org/choose-container!input.jspa?contentType=1&con...]
11 years, 3 months
