<div dir="ltr">+9001 </div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, May 31, 2017 at 11:46 AM, Summers Pittman <span dir="ltr"><<a href="mailto:supittma@redhat.com" target="_blank">supittma@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="auto"><div><div class="h5"><div><br><div class="gmail_extra"><br><div class="gmail_quote">On May 30, 2017 3:23 PM, "Matthias Wessendorf" <<a href="mailto:matzew@apache.org" target="_blank">matzew@apache.org</a>> wrote:<br type="attribution"><blockquote class="m_-4612158071525063545quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote"><div class="m_-4612158071525063545quoted-text">On Tue, May 30, 2017 at 2:06 PM, Summers Pittman <span dir="ltr"><<a href="mailto:supittma@redhat.com" target="_blank">supittma@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote"><span class="m_-4612158071525063545m_5617558415323111340gmail-">On Wed, May 24, 2017 at 4:30 AM, Matthias Wessendorf <span dir="ltr"><<a href="mailto:matzew@apache.org" target="_blank">matzew@apache.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hi,<div><br></div><div>we do have a problem w/ our current metrics processing. It's complicated (lot's of CDI events and two different JMS messaging approaches...) and also slow (JPQL/JDBC) and it does consume a lot of memory and processing time. This is leading to bugs (incorrect stats) and eventually causes down times, due to heavy processing.</div><div><br></div><div>I'd like to dramatically simplify our metrics processing... to something like:</div><div>Success -> could connect to 3rd party, to deliver tokens</div><div>Failure -> something went wrong when talking to 3rd party service.</div><div><br></div><div><br></div><div><div>Right now we do have metrics on push delivery:</div><div>Pending -> the submission to the 3rd party provider is in flight</div><div>Success -> we were able to connect, and could deliver *something*</div><div>Failure -> something obvious, like invalid certificate (APNs), no connection to 3rd party possible, etc</div><div><br></div><div>Besides that, we also do a count on targeted devices. I think there is not really a huge value. For instance if APNs rejects some tokens, we do not track those, we just show how many tokens our DB did find, not more. We don't show any of real interest. We could improve this (see below), but I doubt that the current implementation is able to handle this well.<br></div><div><br></div><div>Also, on Android/FCM the numbers are even worse. We do, internally, leverage their topics, so we usually end up sending exactly one push to FCM, regardless of how many Android device-tokens we have in the DB. The counter says 1 (one), because the server did target one topic (not n devices).</div><div><br></div><div>So, for now, I'd like to dramatically simplify the code, and go with the above Success/Failure solution.</div><div><br></div><div>However, I honestly think in the long run, we should get something pluggable, that allows us to process the metrics independently, outside of the UPS code base. I think my previous Kafka mail is addressing this partially: The actual response and details about the push job should be logged to some Kafka system, and an independent process should be able to process those. </div><div><br></div><div>This will give us much more freedom and flexibility. Perhaps also, in the future, we want some different stats, and something like Prometheus /Grafana:</div><div><a href="https://prometheus.io/docs/visualization/grafana/" target="_blank">https://prometheus.io/docs/vis<wbr>ualization/grafana/</a></div></div><div><br></div><div>A more flexible system, with independent metrics 'calculation' processing will help us here.</div><div><br></div><div>Any thoughts?</div><span class="m_-4612158071525063545m_5617558415323111340gmail-m_-6753415648040266237HOEnZb"><font color="#888888"><div><br></div></font></span></div></blockquote><div><br></div></span><div>What if we remove the current metrics UI</div></div></div></div></blockquote><div><br></div></div><div>For sanity, we are also simplifying the UI:</div><div><a href="https://issues.jboss.org/browse/AGPUSH-2090" target="_blank">https://issues.jboss.org/brows<wbr>e/AGPUSH-2090</a><br></div><div class="m_-4612158071525063545quoted-text"><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div> and replace them with webhooks that emit events?</div></div></div></div></blockquote><div><br></div></div><div>In the long run, I am open to anything else. I think I mainly care about the actual push delivery and the events that we will be submitting to a centralized data hub/pipeline, such as Kafka.</div><div><br></div><div>From there, a consumer process (written in what ever language) can offer webhooks etc</div><div class="m_-4612158071525063545quoted-text"><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div> It lets us add events easily, somewhat simplifies debugging, and gives integrators a lot more control and hooks into our process. We can even turn the current metrics into a microservice project as an example. (Doubly so when we get Keycloak broken out and properly integrated)</div></div></div></div></blockquote><div><br></div></div><div>the overall idea is to break the server in to a more modular system:</div><div>* push-sender.war</div><div>* metrics-processor.war (or jar)</div><div>* device-regitration.war </div><div>* UI process </div><div><br></div><div>I think decoupled keycloak would be also key to this, or what do you mean ? </div><div class="m_-4612158071525063545quoted-text"><div></div></div></div></div></div></blockquote></div></div></div></div></div><div dir="auto">What I meant was it is easier to secure services with a decoupled keycloak. </div><span class=""><div dir="auto"><div class="gmail_extra"><div class="gmail_quote"><blockquote class="m_-4612158071525063545quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div class="m_-4612158071525063545quoted-text"><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><span class="m_-4612158071525063545m_5617558415323111340gmail-"><div dir="ltr"><span class="m_-4612158071525063545m_5617558415323111340gmail-m_-6753415648040266237HOEnZb"><font color="#888888"><div></div><div>-Matthias</div><div><br></div><div><div><br clear="all"><div><br></div>-- <br><div class="m_-4612158071525063545m_5617558415323111340gmail-m_-6753415648040266237m_-3919581038439744647gmail-m_7852728415273694341gmail_signature"><div dir="ltr"><div>Matthias Wessendorf <br><br>blog: <a href="http://matthiaswessendorf.wordpress.com/" target="_blank">http://matthiaswessendorf.word<wbr>press.com/</a><br>twitter: <a href="http://twitter.com/mwessendorf" target="_blank">http://twitter.com/mwessendorf</a><wbr>a</div></div></div>
</div></div></font></span></div>
<br></span><span class="m_-4612158071525063545m_5617558415323111340gmail-">______________________________<wbr>_________________<br>
aerogear-dev mailing list<br>
<a href="mailto:aerogear-dev@lists.jboss.org" target="_blank">aerogear-dev@lists.jboss.org</a><br>
<a href="https://lists.jboss.org/mailman/listinfo/aerogear-dev" rel="noreferrer" target="_blank">https://lists.jboss.org/mailma<wbr>n/listinfo/aerogear-dev</a><br></span></blockquote></div><br></div></div>
<br>______________________________<wbr>_________________<br>
aerogear-dev mailing list<br>
<a href="mailto:aerogear-dev@lists.jboss.org" target="_blank">aerogear-dev@lists.jboss.org</a><br>
<a href="https://lists.jboss.org/mailman/listinfo/aerogear-dev" rel="noreferrer" target="_blank">https://lists.jboss.org/mailma<wbr>n/listinfo/aerogear-dev</a><br></blockquote></div></div><div class="m_-4612158071525063545quoted-text"><br><br clear="all"><div><br></div>-- <br><div class="m_-4612158071525063545m_5617558415323111340gmail_signature"><div dir="ltr"><div>Matthias Wessendorf <br><br>blog: <a href="http://matthiaswessendorf.wordpress.com/" target="_blank">http://matthiaswessendorf.word<wbr>press.com/</a><br>twitter: <a href="http://twitter.com/mwessendorf" target="_blank">http://twitter.com/mwessendorf</a></div></div></div>
</div></div></div>
<br>______________________________<wbr>_________________<br>
aerogear-dev mailing list<br>
<a href="mailto:aerogear-dev@lists.jboss.org" target="_blank">aerogear-dev@lists.jboss.org</a><br>
<a href="https://lists.jboss.org/mailman/listinfo/aerogear-dev" rel="noreferrer" target="_blank">https://lists.jboss.org/mailma<wbr>n/listinfo/aerogear-dev</a><br></blockquote></div><br></div></div></span></div>
<br>______________________________<wbr>_________________<br>
aerogear-dev mailing list<br>
<a href="mailto:aerogear-dev@lists.jboss.org">aerogear-dev@lists.jboss.org</a><br>
<a href="https://lists.jboss.org/mailman/listinfo/aerogear-dev" rel="noreferrer" target="_blank">https://lists.jboss.org/<wbr>mailman/listinfo/aerogear-dev</a><br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div>Matthias Wessendorf <br><br>blog: <a href="http://matthiaswessendorf.wordpress.com/" target="_blank">http://matthiaswessendorf.wordpress.com/</a><br>twitter: <a href="http://twitter.com/mwessendorf" target="_blank">http://twitter.com/mwessendorf</a></div></div></div>
</div>