[
https://issues.jboss.org/browse/RF-13250?page=com.atlassian.jira.plugin.s...
]
Juraj Húska edited comment on RF-13250 at 2/19/14 11:58 AM:
------------------------------------------------------------
I have reproduced the issue with the description provided by community also with RichFaces
5.x version.
The reproducer can be found at [
this|https://github.com/richfaces/richfaces/tree/RF-13250]
branch. Test script will start an Arquillian test, which will start JBoss AS 7.1.1.Final
instance with 256Mb max heap size. It will then try to simulate 4 users (not
simultaneous), receiving push events. Another script is in the meantime making invalid
push requests causing the heap exceeding its allowed size.
Steps to reproduce:
# checkout referenced branch
# issue:
{code}
cd examples/push-demo/
mvn clean verify -Dtest.timeout=2160000
{code}
# from another terminal window issue:
{code}
cd examples/push-demo/
bash malformedPushRequestScript.sh
{code}
# where {{-Dtest.timeout}} is timeout for running the test in milliseconds, e.g. 2160000
== 6 hours, I was able to reproduce it in 4 hours
# after e.g. 4 hours check that the test output contains {{OOM exception}}
This OOM exceptions which can be found in the server log:
{code}
16:05:28,635 ERROR
[org.apache.catalina.core.ContainerBase.[jboss.web].[default-host].[/push].[Faces
Servlet]] (http--127.0.0.1-8080-3) Servlet.service() for servlet Faces Servlet threw
exception: java.lang.OutOfMemoryError: GC overhead limit exceeded
at java.util.Arrays.copyOfRange(Arrays.java:2694) [rt.jar:1.7.0_45]
at java.lang.String.<init>(String.java:203) [rt.jar:1.7.0_45]
at java.lang.String.substring(String.java:1913) [rt.jar:1.7.0_45]
at java.lang.String.trim(String.java:2732) [rt.jar:1.7.0_45]
at com.sun.faces.facelets.util.DevTools.writeStart(DevTools.java:419)
[jsf-impl-2.1.7-jbossorg-2.jar:]
at com.sun.faces.facelets.util.DevTools.writeComponent(DevTools.java:245)
[jsf-impl-2.1.7-jbossorg-2.jar:]
at com.sun.faces.facelets.util.DevTools.writeComponent(DevTools.java:264)
[jsf-impl-2.1.7-jbossorg-2.jar:]
at com.sun.faces.facelets.util.DevTools.writeComponent(DevTools.java:264)
[jsf-impl-2.1.7-jbossorg-2.jar:]
at com.sun.faces.facelets.util.DevTools.debugHtml(DevTools.java:128)
[jsf-impl-2.1.7-jbossorg-2.jar:]
at com.sun.faces.renderkit.RenderKitUtils.renderHtmlErrorPage(RenderKitUtils.java:1159)
[jsf-impl-2.1.7-jbossorg-2.jar:]
at com.sun.faces.context.ExceptionHandlerImpl.throwIt(ExceptionHandlerImpl.java:273)
[jsf-impl-2.1.7-jbossorg-2.jar:]
at com.sun.faces.context.ExceptionHandlerImpl.handle(ExceptionHandlerImpl.java:142)
[jsf-impl-2.1.7-jbossorg-2.jar:]
at com.sun.faces.lifecycle.Phase.doPhase(Phase.java:119)
[jsf-impl-2.1.7-jbossorg-2.jar:]
at com.sun.faces.lifecycle.LifecycleImpl.render(LifecycleImpl.java:139)
[jsf-impl-2.1.7-jbossorg-2.jar:]
at javax.faces.webapp.FacesServlet.service(FacesServlet.java:594)
[jboss-jsf-api_2.1_spec-2.0.1.Final.jar:2.0.1.Final]
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:329)
[jbossweb-7.0.13.Final.jar:]
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248)
[jbossweb-7.0.13.Final.jar:]
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:275)
[jbossweb-7.0.13.Final.jar:]
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:161)
[jbossweb-7.0.13.Final.jar:]
at
org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:153)
[jboss-as-web-7.1.1.Final.jar:7.1.1.Final]
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:155)
[jbossweb-7.0.13.Final.jar:]
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
[jbossweb-7.0.13.Final.jar:]
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
[jbossweb-7.0.13.Final.jar:]
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:368)
[jbossweb-7.0.13.Final.jar:]
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:877)
[jbossweb-7.0.13.Final.jar:]
at
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:671)
[jbossweb-7.0.13.Final.jar:]
at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:930)
[jbossweb-7.0.13.Final.jar:]
at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_45]
{code}
and
{code}
6:07:41,281 WARN [org.hornetq.core.remoting.server.impl.RemotingServiceImpl]
(hornetq-failure-check-thread) GC overhead limit exceeded: java.lang.OutOfMemoryError: GC
overhead limit exceeded
{code}.
was (Author: jhuska):
I have reproduced the issue with the description provided by community.
The reproducer can be found at [
this|https://github.com/richfaces/richfaces/tree/RF-13250]
branch. Test script will start an Arquillian test, which will start JBoss AS 7.1.1.Final
instance with 256Mb max heap size. It will then try to simulate 4 users (not
simultaneous), receiving push events. Another script is in the meantime making invalid
push requests causing the heap exceeding its allowed size.
Steps to reproduce:
# checkout referenced branch
# issue:
{code}
cd examples/push-demo/
mvn clean verify -Dtest.timeout=2160000
{code}
# from another terminal window issue:
{code}
cd examples/push-demo/
bash malformedPushRequestScript.sh
{code}
# where {{-Dtest.timeout}} is timeout for running the test in milliseconds, e.g. 2160000
== 6 hours, I was able to reproduce it in 4 hours
# after e.g. 4 hours check that the test output contains {{OOM exception}}
This OOM exceptions which can be found in the server log:
{code}
16:05:28,635 ERROR
[org.apache.catalina.core.ContainerBase.[jboss.web].[default-host].[/push].[Faces
Servlet]] (http--127.0.0.1-8080-3) Servlet.service() for servlet Faces Servlet threw
exception: java.lang.OutOfMemoryError: GC overhead limit exceeded
at java.util.Arrays.copyOfRange(Arrays.java:2694) [rt.jar:1.7.0_45]
at java.lang.String.<init>(String.java:203) [rt.jar:1.7.0_45]
at java.lang.String.substring(String.java:1913) [rt.jar:1.7.0_45]
at java.lang.String.trim(String.java:2732) [rt.jar:1.7.0_45]
at com.sun.faces.facelets.util.DevTools.writeStart(DevTools.java:419)
[jsf-impl-2.1.7-jbossorg-2.jar:]
at com.sun.faces.facelets.util.DevTools.writeComponent(DevTools.java:245)
[jsf-impl-2.1.7-jbossorg-2.jar:]
at com.sun.faces.facelets.util.DevTools.writeComponent(DevTools.java:264)
[jsf-impl-2.1.7-jbossorg-2.jar:]
at com.sun.faces.facelets.util.DevTools.writeComponent(DevTools.java:264)
[jsf-impl-2.1.7-jbossorg-2.jar:]
at com.sun.faces.facelets.util.DevTools.debugHtml(DevTools.java:128)
[jsf-impl-2.1.7-jbossorg-2.jar:]
at com.sun.faces.renderkit.RenderKitUtils.renderHtmlErrorPage(RenderKitUtils.java:1159)
[jsf-impl-2.1.7-jbossorg-2.jar:]
at com.sun.faces.context.ExceptionHandlerImpl.throwIt(ExceptionHandlerImpl.java:273)
[jsf-impl-2.1.7-jbossorg-2.jar:]
at com.sun.faces.context.ExceptionHandlerImpl.handle(ExceptionHandlerImpl.java:142)
[jsf-impl-2.1.7-jbossorg-2.jar:]
at com.sun.faces.lifecycle.Phase.doPhase(Phase.java:119)
[jsf-impl-2.1.7-jbossorg-2.jar:]
at com.sun.faces.lifecycle.LifecycleImpl.render(LifecycleImpl.java:139)
[jsf-impl-2.1.7-jbossorg-2.jar:]
at javax.faces.webapp.FacesServlet.service(FacesServlet.java:594)
[jboss-jsf-api_2.1_spec-2.0.1.Final.jar:2.0.1.Final]
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:329)
[jbossweb-7.0.13.Final.jar:]
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:248)
[jbossweb-7.0.13.Final.jar:]
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:275)
[jbossweb-7.0.13.Final.jar:]
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:161)
[jbossweb-7.0.13.Final.jar:]
at
org.jboss.as.web.security.SecurityContextAssociationValve.invoke(SecurityContextAssociationValve.java:153)
[jboss-as-web-7.1.1.Final.jar:7.1.1.Final]
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:155)
[jbossweb-7.0.13.Final.jar:]
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
[jbossweb-7.0.13.Final.jar:]
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
[jbossweb-7.0.13.Final.jar:]
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:368)
[jbossweb-7.0.13.Final.jar:]
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:877)
[jbossweb-7.0.13.Final.jar:]
at
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:671)
[jbossweb-7.0.13.Final.jar:]
at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:930)
[jbossweb-7.0.13.Final.jar:]
at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_45]
{code}
and
{code}
6:07:41,281 WARN [org.hornetq.core.remoting.server.impl.RemotingServiceImpl]
(hornetq-failure-check-thread) GC overhead limit exceeded: java.lang.OutOfMemoryError: GC
overhead limit exceeded
{code}.
Extreme memory usage in RF4.3.4.Final and not in RF4.3.3.Final
--------------------------------------------------------------
Key: RF-13250
URL:
https://issues.jboss.org/browse/RF-13250
Project: RichFaces
Issue Type: Bug
Security Level: Public(Everyone can see)
Affects Versions: 4.3.4, 4.3.5
Environment: Gentoo Linux, Tomcat 7.0.39, MyFaces 2.1.12, Tomahawk 1.1.14,
RichFaces 4.3.4, APR 1.4.5
Reporter: Milo van der Zee
Assignee: Juraj Húska
Labels: memoryleak
Attachments: rf.patch
Hello,
I did an upgrade from RF 4.3.3.Final to 4.3.4.Final and the application started to crash
with 'Out Off Memory' errors. I changed the POM back to 4.3.3.Final and the
problem is gone.
I also started seeing this message lot's of times:
{{WARN org.atmosphere.cpr.AtmosphereResponse - Committed error code 400}}
I don't know if that has anything to do with the error. I set
{{org.atmosphere.cpr.sessionSupport}} to {{true}} and I did not see the message again. But
still the application went out-of-memory.
In the crashed system heap dump I see a lot of:
- AtomicBoolean (751.000, 15.0MB)
- ConcurrentLinkedQueue
- AtmospereRequest$Builder (60.042, 13.8MB)
To me it looks like it has something to do with Atmosphere. Any ideas?
Thanks,
Milo van der Zee
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:
http://www.atlassian.com/software/jira