Recommended Grafana dashboard (Prometheus)?
guyromb opened this issue · 8 comments
At the moment I am unable to find a Grafana dashboard that works with the metrics exporter. It seems like it missing common query functions.
I tried to use this template too to get additional metrics:
https://github.com/rama-nallamilli/kafka-prometheus-monitoring/blob/master/prometheus-jmx-exporter/confd/templates/kafka.yml.tmpl
With this Grafana template:
https://github.com/rama-nallamilli/kafka-prometheus-monitoring/edit/master/dashboards/Kafka.json
but no results
I'm on the lookout too, passively :)
I'm also eager to see how #259 affects our Kafka monoitoring, but we haven't rolled it out. The readme for https://github.com/google-cloud-tools/kafka-minion mentions a Grafana dashboard. @weeco any status on that?
Sure, I want to release a new version of Kafka Minion which contains some more metrics about topic configuration. Once that's done I'll offer a dashboard. You can expect stuff like this:
I am not sure if this is something @guyromb is looking for. He was probably looking for a dashboard to monitor Kafka itself, rather than the consumer group lags. We could share our dashboard on this soon as well.
That's awesome @weeco
What are the recommended adjustments to make this work using this repo configurations? I would like to have something (even minimal monitoring) working
You need to run https://github.com/google-cloud-tools/kafka-minion which is an alternative to LinkedIn's burrow. Solsson opened a PR for it on this repo: #259 . We've got a helm chart for it, but it's not done yet.
@guyromb I recommend you start with kafka-minion then, and report any issues in #259. Consumer lag monitoring says a lot about kafka health. Kafka-minion means one layer (and scrape interval) less than with Burrow because it's developed for use with Prometheus / Openmetrics.
At Yolean we use the generic dashboards from Prometheus Operator quite a lot too. You'll have graphs for memory and CPU for example.
@guyromb @solsson I added the suggested Grafana dashboard for Kafka Minion. See: https://github.com/cloudworkz/kafka-minion or https://grafana.com/dashboards/10083