collectd-rabbitmq

A collected plugin, written in python, to collect statistics from RabbitMQ. Requires that the rabbitmq management plugin is installed.

This has been amended from the NYTimes version to add host_separators for our current collectd setup. This means that it sends the metrics to graphite under the hostname.

We currently send collectd metrics using the hostname THIS_HOSTNAME so we needed to swap this out to this format. By adding a hostname in the script with THIS.HOSTNAME it will replace the . with _.

This plugin now gets the hostname of the server its running on and then replaces the hostname when sending to graphite or whichever location to THIS.HOST to THIS_HOST.

Amendments

'''
Add metric seperator for hostname and add variable for hostname '''

mqhostname = socket.gethostname()

host_separator = "_"
metric_separator = "."

'''
End Metric Seperator
'''

vhost_name = mqhostname
vhost_name.replace('.', host_separator)

Installation

Place the rabbitmq.py file in the plugins directory for collect. Each of these statistics have thier own custom entery in collectd's type database. To add these types run:

cat config/types.db.custom >> /usr/share/collectd/types.db

Configuration

This plugin supports a small amount of configuration options:

Username: The rabbitmq user. Defaults to guest.
Password: The rabbitmq user password. Defaults to guest.
Realm: The http realm for authentication. Defaults to RabbitMQ Management.
Host: The hostname that the rabbitmq server running on. Defaults to localhost.
Port: The port that the rabbitmq server is listening on. Defaults to 15672.
Ignore: The queue to ignore, matching by Regex. See example.

Example Configuration

LoadPlugin python
<Plugin python>
  ModulePath "/mnt/projects/collectd-rabbitmq/"
  LogTraces true
  Interactive false
  Import rabbitmq
  <Module rabbitmq>
    Username "guest"
    Password "guest"
    Realm "RabbitMQ Management"
    Host "localhost"
    Port "15672"
	<Ignore "queue">
	  Regex "amq-gen-.*"
	  Regex "tmp-.*"
	</Ignore>
  </Module>
</Plugin>

Nodes

For each node the following statistics are gathered:

disk_free_limit
fd_total
fd_used
mem_limit
mem_used
proc_total
proc_used
processors
run_queue
sockets_total
sockets_used

Queues

For each queue in each vhost the following statistics are gathered:

NOTE: The / vhost name is sent as default

message_stats
- deliver_get
- deliver_get_details
  - rate
- get
- get_details
  - rate
- publish
- publish_details
  - rate
- redeliver
- redeliver_details
  - rate
messages
messages_details
- rate
messages_ready
messages_ready_details
- rate
messages_unacknowledged
messages_unacknowledged_details
- rate
memory
consumers

Exchanges

For each exchange in each vhost the following statistics are gathered: