[Hawkular-dev] Collecting PV usage ?

[Matt Wringe]

----- Original Message -----
> From: "Matt Wringe" <mwringe at redhat.com>
> To: "Discussions around Hawkular development" <hawkular-dev at lists.jboss.org>
> Cc: "John Mazzitelli" <mazz at redhat.com>
> Sent: Friday, 10 February, 2017 11:45:32 AM
> Subject: Re: [Hawkular-dev] Collecting PV usage ?
> 
> ----- Original Message -----
> > From: "Thomas Heute" <theute at redhat.com>
> > To: "John Mazzitelli" <mazz at redhat.com>
> > Cc: "Discussions around Hawkular development"
> > <hawkular-dev at lists.jboss.org>
> > Sent: Friday, 10 February, 2017 7:55:46 AM
> > Subject: Re: [Hawkular-dev] Collecting PV usage ?
> > 
> > 
> > 
> > On Fri, Feb 10, 2017 at 1:36 PM, John Mazzitelli < mazz at redhat.com > wrote:
> > 
> > 
> > No. It is on the list though:
> > 
> > https://github.com/hawkular/hawkular-openshift-agent/issues/110
> > 
> > I don't think they are collected by Heapster today
> 
> Heapster collects a bunch of filesystem data, I believe its pulling in all
> volumes being used which should include PVs.
> 
> It includes the usage and limit for each of the volumes being used.
> 
> > 
> > I honestly don't know where to get these persistent volume stats (or any of
> > the low level stats) - but I believe its just prometheus data so we should
> > be able to get it if we just know the correct URLs. But so far we've been
> > concentrating on app metrics coming from user's pods so we haven't worked
> > on
> > that yet.
> > 
> > Right. I haven't found evidence of a prometheus endpoint yet.
> 
> The main prometheus endpoint for each node should be found here
> 
> curl -k -H "Authorization: Bearer $ADMIN_TOKEN" -X GET
> https://${NODE_IP}:10250/metrics

If we want to collect things like cpu/memory/etc for the pods directly instead of using heapster, this should be the endpoint to use as well.

> The summary endpoint (not Prometheus but json based) that Heapster uses and
> contains volume information, can be found here:
> 
> reset;curl -k -H "Authorization: Bearer $ADMIN_TOKEN" -X POST -d
> '{"num_stats":1}' https://${NODE_IP}:10250/stats/summary
> 
> I think you can get the same information from the prometheus endpoint here
> that you can from the summary one, but it might be a bit tricky to parse
> things out. But it could also be possible that the summary endpoint is
> including new information.
> 
> > 
> > It doesn't seem straightforward, but an important data to expose. I'm
> > afraid
> > that it will depend on the storage solution being used (to see the actual
> > usage)
> > 
> > 
> > Thomas
> > 
> > 
> > 
> > 
> > ----- Original Message -----
> > > Mazz,
> > > 
> > > in your metric collection adventure for HOSA have you met a way to see
> > > the
> > > usage of PVs attached to a pod ?
> > > User should know (be able to visualize) how much of the PVs are used and
> > > then be alerted if it reach a certain %.
> > > 
> > > Thomas
> > > 
> > 
> > 
> > _______________________________________________
> > hawkular-dev mailing list
> > hawkular-dev at lists.jboss.org
> > https://lists.jboss.org/mailman/listinfo/hawkular-dev
> > 
>