miguno/wirbelsturm

Add support for riemann?

Closed this issue · 3 comments

Would you be interested in me adding support for Riemann, perhaps on the current metrics VM and also adding Riemann monitoring for Kafka, Zookeeper, e.t.c.?

(See my comment on your ELK question (#14) for additional context.)

I don't have any hands-on experience with Riemann apart from being aware that it exists and a little bit about what it does. :-) I do like that Riemann can integrate with Graphite, which is already bundled in the default Wirbelsturm setup.

Riemann does sound interesting to me, but I think the question of whether it would ultimately be bundled out of the box with Wirbelsturm depends a bit on what the eventual Riemann setup would look like. How would you anticipate that setup to be like?

The tricky part I see with adding Riemann is that I think it would require changes to the other modules to support them. For example, to report Kafka metrics to Riemann requires adding an extra jar and some configuration to the puppet-kafka module. However if the user doesn't want Riemann, then we don't want to add Riemann config to the deployed Kafka machine.

I'm not sure if it would be possible or desirable to make a puppet-riemann module reach into the Kafka, Storm, and Zookeeper modules and modify their config or run another tool like riemann-zookeeper to send metrics to Riemann.

I have a feeling that working on #14 first would be easier and could show how best to approach Riemann or whether it's actually appropriate to be included in Wirbelsturm.

I have a feeling that working on #14 first would be easier and could show how best to approach Riemann or whether it's actually appropriate to be included in Wirbelsturm.

I agree, Daniel. I'll close this ticket for the time being (as it was more a question that is now answered). If needed, we can later create a new one for actually adding Riemann support.