<div dir="ltr">Hi Mo,<div><br></div><div>the PR has been merged, and it should improve the situation a bit </div><div><br></div><div>PS: next will be removing SimplePush from the cartridge</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Jun 18, 2015 at 5:17 PM, Matthias Wessendorf <span dir="ltr"><<a href="mailto:matzew@apache.org" target="_blank">matzew@apache.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi ,<div><br></div><div><br></div><div><br></div><div>[1] <a href="https://github.com/aerogear/openshift-origin-cartridge-aerogear-push/pull/18" target="_blank">https://github.com/aerogear/openshift-origin-cartridge-aerogear-push/pull/18</a></div><div class="gmail_extra"><br><div class="gmail_quote"><span class="">On Thu, Jun 18, 2015 at 4:57 PM, mo <span dir="ltr"><<a href="mailto:michi.oshima@gmail.com" target="_blank">michi.oshima@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">Thanks, Matthias. I take your reply to mean "No, one shouldn't have to<br>
increase JVM heap size."<br></blockquote><div><br></div></span><div>yeah, if you really want to, you can try tweaking the jvm heap size (as long as you still use a function of the max memory available on the gear)</div>
<div><br></div><div><br></div><div>But also please review the changes done in </div><div><a href="https://github.com/aerogear/openshift-origin-cartridge-aerogear-push/pull/18" target="_blank">https://github.com/aerogear/openshift-origin-cartridge-aerogear-push/pull/18</a><br></div><div><br></div><div>You could port them over to your instance. Makes sense ?</div><div><br></div><div>More coming soon.</div><div><div class="h5"><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<br>
Let me list some more parameters, in the hope that you might spot something<br>
obvious that we can correct on our side. It's been difficult to<br>
troubleshoot this, because when the problem happens we can't even SSH into<br>
the server. I believe whatever the problem is, it's exhausting resources on<br>
the server.<br>
<br>
Parameters:<br>
<br>
1. Deployed on OpenShift using the cartridge found here:<br>
<a href="https://github.com/aerogear/openshift-origin-cartridge-aerogear-push" rel="noreferrer" target="_blank">https://github.com/aerogear/openshift-origin-cartridge-aerogear-push</a><br>
<<a href="https://github.com/aerogear/openshift-origin-cartridge-aerogear-push" rel="noreferrer" target="_blank">https://github.com/aerogear/openshift-origin-cartridge-aerogear-push</a>><br>
2. AeroGear UnifiedPush Server 1.0.3 and WildFly, MySQL 5.5, Medium gear.<br>
3. One application is defined with one variant (simple-push), 131<br>
installations registered.<br>
4. We are using all default settings. We haven't customized the JVM max<br>
heap size, for example. The server log tells me "-Xmx512m".<br>
<br>
Here are the reproduction steps. This happened reliably two days ago. We<br>
couldn't reproduce this yesterday after a fresh restart of AeroGear.<br>
<br>
1. Logged into AeroGear as admin<br>
2. Select "Send Push"<br>
3. Select an application<br>
4. Hit "Send Push Notification", multiple times one after another. About 10<br>
consecutive messages would cause OutOfMemoryError on our server.<br>
<br>
Here's a relevant snippet of the server log:<br>
<br>
[0m [0m17:03:29,511 INFO [PushNotificationSenderEndpoint] (default<br>
task-28) Message submitted to PushNetworks for further processing<br>
[0m [0m17:03:29,513 INFO [JPAPushMessageInformationDao] (EJB default - 6)<br>
Processing send request with &apos;[alert=, criteria=[aliases=null,<br>
deviceTypes=null, categories=null, variants=null], time-to-live=-1]&apos;<br>
payload<br>
[0m [31m17:03:29,837 ERROR [org.jboss.as.ejb3.invocation] (EJB default - 6)<br>
JBAS014134: EJB Invocation failed on component SenderServiceImpl for method<br>
public abstract void<br>
org.jboss.aerogear.unifiedpush.message.SenderService.send(org.jboss.aerogear.unifiedpush.api.PushApplication,org.jboss.aerogear.unifiedpush.message.UnifiedPushMessage):<br>
javax.ejb.EJBException: JBAS014580: Unexpected Error<br>
at<br>
org.jboss.as.ejb3.tx.CMTTxInterceptor.handleExceptionInOurTx(CMTTxInterceptor.java:187)<br>
[wildfly-ejb3-8.1.0.Final.jar:8.1.0.Final]<br>
at<br>
org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:275)<br>
[wildfly-ejb3-8.1.0.Final.jar:8.1.0.Final]<br>
<br>
.<br>
.<br>
.<br>
<br>
[wildfly-ejb3-8.1.0.Final.jar:8.1.0.Final]<br>
at<br>
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)<br>
[rt.jar:1.7.0_79]<br>
at<br>
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)<br>
[rt.jar:1.7.0_79]<br>
at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_79]<br>
at org.jboss.threads.JBossThread.run(JBossThread.java:122)<br>
Caused by: java.lang.OutOfMemoryError: unable to create new native thread<br>
at java.lang.Thread.start0(Native Method) [rt.jar:1.7.0_79]<br>
at java.lang.Thread.start(Thread.java:714) [rt.jar:1.7.0_79]<br>
at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:1056)<br>
[jsse.jar:1.7.0_79]<br>
at<br>
sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1332)<br>
[jsse.jar:1.7.0_79]<br>
at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1359)<br>
[jsse.jar:1.7.0_79]<br>
.<br>
.<br>
.<br>
<br>
org.jboss.aerogear.unifiedpush.message.sender.SimplePushNotificationSender.put(SimplePushNotificationSender.java:111)<br>
[unifiedpush-push-1.0.3.jar:1.0.3]<br>
at<br>
org.jboss.aerogear.unifiedpush.message.sender.SimplePushNotificationSender.sendPushMessage(SimplePushNotificationSender.java:65)<br>
[unifiedpush-push-1.0.3.jar:1.0.3]<br>
at<br>
org.jboss.aerogear.unifiedpush.message.SenderServiceImpl.send(SenderServiceImpl.java:110)<br>
[unifiedpush-push-1.0.3.jar:1.0.3]<br>
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)<br>
[rt.jar:1.7.0_79]<br>
at<br>
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)<br>
[rt.jar:1.7.0_79]<br>
at<br>
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)<br>
[rt.jar:1.7.0_79]<br>
at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_79]<br>
at<br>
org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52)<br>
<br>
.<br>
.<br>
.<br>
<br>
at<br>
org.jboss.as.ejb3.component.interceptors.NonPooledEJBComponentInstanceAssociatingInterceptor.processInvocation(NonPooledEJBComponentInstanceAssociatingInterceptor.java:59)<br>
[wildfly-ejb3-8.1.0.Final.jar:8.1.0.Final]<br>
at<br>
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:309)<br>
at<br>
org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:273)<br>
[wildfly-ejb3-8.1.0.Final.jar:8.1.0.Final]<br>
... 38 more<br>
<br>
<br>
<br>
<br>
--<br>
View this message in context: <a href="http://aerogear-users.1116366.n5.nabble.com/Default-heap-size-and-OOM-tp56p58.html" rel="noreferrer" target="_blank">http://aerogear-users.1116366.n5.nabble.com/Default-heap-size-and-OOM-tp56p58.html</a><br>
<div><div>Sent from the aerogear-users mailing list archive at Nabble.com.<br>
<br>
_______________________________________________<br>
Aerogear-users mailing list<br>
<a href="mailto:Aerogear-users@lists.jboss.org" target="_blank">Aerogear-users@lists.jboss.org</a><br>
<a href="https://lists.jboss.org/mailman/listinfo/aerogear-users" rel="noreferrer" target="_blank">https://lists.jboss.org/mailman/listinfo/aerogear-users</a><br>
</div></div></blockquote></div></div></div><br><br clear="all"><span class=""><div><br></div>-- <br><div>Matthias Wessendorf <br><br>blog: <a href="http://matthiaswessendorf.wordpress.com/" target="_blank">http://matthiaswessendorf.wordpress.com/</a><br>sessions: <a href="http://www.slideshare.net/mwessendorf" target="_blank">http://www.slideshare.net/mwessendorf</a><br>twitter: <a href="http://twitter.com/mwessendorf" target="_blank">http://twitter.com/mwessendorf</a></div>
</span></div></div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature">Matthias Wessendorf <br><br>blog: <a href="http://matthiaswessendorf.wordpress.com/" target="_blank">http://matthiaswessendorf.wordpress.com/</a><br>sessions: <a href="http://www.slideshare.net/mwessendorf" target="_blank">http://www.slideshare.net/mwessendorf</a><br>twitter: <a href="http://twitter.com/mwessendorf" target="_blank">http://twitter.com/mwessendorf</a></div>
</div>