Hi all :)
We encounter an issue since yesterday on our aerogear server running in
production for several months on OpenShift Online (
OPENSHIFT_AEROGEAR_PUSH_VERSION=1.0.3 ) :
Management interface would report the handshake error as well, and none of
all our iOS pushes, whatever the `application`, whatever the `variant`,
would work.
We're looking for what can go wrong in order to fix it. We still have both
RAM and disk available, and a `gear restart` would not help in the matter.
Here's what the stacktrace looks like in the logs, can anybody help ?
```
ERROR [com.notnoop.apns.internal.ApnsConnectionImpl] (EJB default - 4)
Couldn't send message after 3 retries.Message(Id=1; Token=<TOKEN>;
Payload={"<some_payload_property>":"<some numeric
value>","aps":{"alert":"<The notification
text>","badge":-1}}):
javax.net.ssl.SSLHandshakeException:
sun.security.validator.ValidatorException: No trusted certificate found
at sun.security.ssl.Alerts.getSSLException(Alerts.java:192)
[jsse.jar:1.7.0_85]
at sun.security.ssl.SSLSocketImpl.fatal(SSLSocketImpl.java:1916)
[jsse.jar:1.7.0_85]
at sun.security.ssl.Handshaker.fatalSE(Handshaker.java:279)
[jsse.jar:1.7.0_85]
at sun.security.ssl.Handshaker.fatalSE(Handshaker.java:273)
[jsse.jar:1.7.0_85]
at
sun.security.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1469)
[jsse.jar:1.7.0_85]
at
sun.security.ssl.ClientHandshaker.processMessage(ClientHandshaker.java:213)
[jsse.jar:1.7.0_85]
at sun.security.ssl.Handshaker.processLoop(Handshaker.java:913)
[jsse.jar:1.7.0_85]
at sun.security.ssl.Handshaker.process_record(Handshaker.java:849)
[jsse.jar:1.7.0_85]
at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:1035)
[jsse.jar:1.7.0_85]
at
sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1344)
[jsse.jar:1.7.0_85]
at sun.security.ssl.SSLSocketImpl.writeRecord(SSLSocketImpl.java:721)
[jsse.jar:1.7.0_85]
at sun.security.ssl.AppOutputStream.write(AppOutputStream.java:122)
[jsse.jar:1.7.0_85]
at java.io.OutputStream.write(OutputStream.java:75) [rt.jar:1.7.0_85]
at
com.notnoop.apns.internal.ApnsConnectionImpl.sendMessage(ApnsConnectionImpl.java:322)
[apns-1.0.0.Beta5.jar:]
at
com.notnoop.apns.internal.ApnsConnectionImpl.sendMessage(ApnsConnectionImpl.java:310)
[apns-1.0.0.Beta5.jar:]
at
com.notnoop.apns.internal.ApnsServiceImpl.push(ApnsServiceImpl.java:46)
[apns-1.0.0.Beta5.jar:]
at
com.notnoop.apns.internal.AbstractApnsService.push(AbstractApnsService.java:102)
[apns-1.0.0.Beta5.jar:]
at
com.notnoop.apns.internal.ApnsServiceImpl.push(ApnsServiceImpl.java:36)
[apns-1.0.0.Beta5.jar:]
at
org.jboss.aerogear.unifiedpush.message.sender.APNsPushNotificationSender.sendPushMessage(APNsPushNotificationSender.java:109)
[unifiedpush-push-1.0.3.jar:1.0.3]
at
org.jboss.aerogear.unifiedpush.message.SenderServiceImpl.send(SenderServiceImpl.java:116)
[unifiedpush-push-1.0.3.jar:1.0.3]
at sun.reflect.GeneratedMethodAccessor149.invoke(Unknown Source)
[:1.7.0_85]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[rt.jar:1.7.0_85]
at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_85]
at
org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52)
at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:309)
at
org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53)
at
org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63)
at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:309)
at
org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:407)
at
org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:82)
[wildfly-weld-8.1.0.Final.jar:8.1.0.Final]
at
org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:93)
[wildfly-weld-8.1.0.Final.jar:8.1.0.Final]
at
org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63)
at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:309)
at
org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53)
at
org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63)
at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:309)
at
org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43)
[wildfly-ejb3-8.1.0.Final.jar:8.1.0.Final]
at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:309)
at
org.jboss.as.jpa.interceptor.SBInvocationInterceptor.processInvocation(SBInvocationInterceptor.java:47)
[wildfly-jpa-8.1.0.Final.jar:8.1.0.Final]
at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:309)
at
org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:407)
at
org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:55)
[weld-core-impl-2.1.2.Final.jar:2014-01-09 09:23]
at
org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:83)
[wildfly-weld-8.1.0.Final.jar:8.1.0.Final]
at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:309)
at
org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45)
[wildfly-ee-8.1.0.Final.jar:8.1.0.Final]
at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:309)
at
org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21)
at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:309)
at
org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)
at
org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53)
at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:309)
at
org.jboss.as.ejb3.component.interceptors.NonPooledEJBComponentInstanceAssociatingInterceptor.processInvocation(NonPooledEJBComponentInstanceAssociatingInterceptor.java:59)
[wildfly-ejb3-8.1.0.Final.jar:8.1.0.Final]
at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:309)
at
org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:273)
[wildfly-ejb3-8.1.0.Final.jar:8.1.0.Final]
at
org.jboss.as.ejb3.tx.CMTTxInterceptor.required(CMTTxInterceptor.java:340)
[wildfly-ejb3-8.1.0.Final.jar:8.1.0.Final]
at
org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:239)
[wildfly-ejb3-8.1.0.Final.jar:8.1.0.Final]
at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:309)
at
org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41)
[wildfly-ejb3-8.1.0.Final.jar:8.1.0.Final]
at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:309)
at
org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:43)
[wildfly-ejb3-8.1.0.Final.jar:8.1.0.Final]
at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:309)
at
org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:95)
[wildfly-ejb3-8.1.0.Final.jar:8.1.0.Final]
at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:309)
at
org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64)
[wildfly-ejb3-8.1.0.Final.jar:8.1.0.Final]
at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:309)
at
org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59)
[wildfly-ejb3-8.1.0.Final.jar:8.1.0.Final]
at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:309)
at
org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50)
at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:309)
at
org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:55)
[wildfly-ejb3-8.1.0.Final.jar:8.1.0.Final]
at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:309)
at
org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64)
at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:309)
at
org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:326)
at
org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:448)
at
org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:61)
at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:309)
at
org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:326)
at
org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80)
at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:309)
at
org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)
at
org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:185)
at
org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182)
at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:309)
at
org.jboss.as.ejb3.component.interceptors.LogDiagnosticContextRecoveryInterceptor.processInvocation(LogDiagnosticContextRecoveryInterceptor.java:79)
[wildfly-ejb3-8.1.0.Final.jar:8.1.0.Final]
at
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:309)
at
org.jboss.as.ejb3.component.interceptors.AsyncFutureInterceptorFactory$1$2.runInvocation(AsyncFutureInterceptorFactory.java:97)
[wildfly-ejb3-8.1.0.Final.jar:8.1.0.Final]
at
org.jboss.as.ejb3.component.interceptors.AsyncInvocationTask.run(AsyncInvocationTask.java:73)
[wildfly-ejb3-8.1.0.Final.jar:8.1.0.Final]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[rt.jar:1.7.0_85]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[rt.jar:1.7.0_85]
at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_85]
at org.jboss.threads.JBossThread.run(JBossThread.java:122)
Caused by: sun.security.validator.ValidatorException: No trusted
certificate found
at
sun.security.validator.SimpleValidator.buildTrustedChain(SimpleValidator.java:394)
[rt.jar:1.7.0_85]
at
sun.security.validator.SimpleValidator.engineValidate(SimpleValidator.java:134)
[rt.jar:1.7.0_85]
at sun.security.validator.Validator.validate(Validator.java:260)
[rt.jar:1.7.0_85]
at
sun.security.ssl.X509TrustManagerImpl.validate(X509TrustManagerImpl.java:326)
[jsse.jar:1.7.0_85]
at
sun.security.ssl.X509TrustManagerImpl.checkTrusted(X509TrustManagerImpl.java:231)
[jsse.jar:1.7.0_85]
at
sun.security.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:126)
[jsse.jar:1.7.0_85]
at
sun.security.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1451)
[jsse.jar:1.7.0_85]
... 87 more
2015-11-05 04:32:39,596 WARNING [APNsPushNotificationSender] (EJB default -
4) Error on 'ios' delivery
2015-11-05 04:40:00,169 WARN
[org.hibernate.hql.internal.ast.QueryTranslatorImpl] (default task-26)
HHH000104: firstResult/maxResults specified with collection fetch; applying
in memory!
2015-11-05 04:40:21,553 WARN
[org.hibernate.hql.internal.ast.QueryTranslatorImpl] (default task-30)
HHH000104: firstResult/maxResults specified with collection fetch; applying
in memory!
2015-11-05 04:40:26,675 WARN
[org.hibernate.hql.internal.ast.QueryTranslatorImpl] (default task-33)
HHH000104: firstResult/maxResults specified with collection fetch; applying
in memory!
2015-11-05 04:40:28,864 WARN
[org.hibernate.hql.internal.ast.QueryTranslatorImpl] (default task-34)
HHH000104: firstResult/maxResults specified with collection fetch; applying
in memory!
2015-11-05 04:40:30,969 WARN
[org.hibernate.hql.internal.ast.QueryTranslatorImpl] (default task-37)
HHH000104: firstResult/maxResults specified with collection fetch; applying
in memory!
2015-11-05 04:40:33,150 WARN
[org.hibernate.hql.internal.ast.QueryTranslatorImpl] (default task-36)
HHH000104: firstResult/maxResults specified with collection fetch; applying
in memory!
2015-11-05 04:40:36,375 WARN
[org.hibernate.hql.internal.ast.QueryTranslatorImpl] (default task-39)
HHH000104: firstResult/maxResults specified with collection fetch; applying
in memory!
2015-11-05 04:40:43,324 WARN
[org.hibernate.hql.internal.ast.QueryTranslatorImpl] (default task-43)
HHH000104: firstResult/maxResults specified with collection fetch; applying
in memory!
2015-11-05 04:40:46,273 WARN
[org.hibernate.hql.internal.ast.QueryTranslatorImpl] (default task-41)
HHH000104: firstResult/maxResults specified with collection fetch; applying
in memory!
2015-11-05 04:40:48,448 WARN
[org.hibernate.hql.internal.ast.QueryTranslatorImpl] (default task-40)
HHH000104: firstResult/maxResults specified with collection fetch; applying
in memory!
2015-11-05 04:40:50,514 WARN
[org.hibernate.hql.internal.ast.QueryTranslatorImpl] (default task-42)
HHH000104: firstResult/maxResults specified with collection fetch; applying
in memory!
2015-11-05 04:40:52,733 WARN
[org.hibernate.hql.internal.ast.QueryTranslatorImpl] (default task-45)
HHH000104: firstResult/maxResults specified with collection fetch; applying
in memory!
2015-11-05 04:40:55,093 WARN
[org.hibernate.hql.internal.ast.QueryTranslatorImpl] (default task-46)
HHH000104: firstResult/maxResults specified with collection fetch; applying
in memory!
2015-11-05 04:40:56,742 WARN
[org.hibernate.hql.internal.ast.QueryTranslatorImpl] (default task-44)
HHH000104: firstResult/maxResults specified with collection fetch; applying
in memory!
2015-11-05 04:40:58,947 WARN
[org.hibernate.hql.internal.ast.QueryTranslatorImpl] (default task-51)
HHH000104: firstResult/maxResults specified with collection fetch; applying
in memory!
2015-11-05 04:41:01,469 WARN
[org.hibernate.hql.internal.ast.QueryTranslatorImpl] (default task-50)
HHH000104: firstResult/maxResults specified with collection fetch; applying
in memory!
2015-11-05 04:41:03,297 WARN
[org.hibernate.hql.internal.ast.QueryTranslatorImpl] (default task-52)
HHH000104: firstResult/maxResults specified with collection fetch; applying
in memory!
2015-11-05 04:41:09,376 WARN
[org.hibernate.hql.internal.ast.QueryTranslatorImpl] (default task-55)
HHH000104: firstResult/maxResults specified with collection fetch; applying
in memory!
--
Florian TRAVERSE
Software Architect
Allocab, votre chauffeur sur-mesure
M. +33 6 12 39 66 50
A. 7 impasse Charles Petit, 75011 Paris
W.
www.allocab.com
E. florian.traverse(a)allocab.com