Prometheus metric library for OpenComputers

This is a Lua library that can be used with OpenComputers in Minecraft to keep track of metrics and push them to Prometheus Pushgateway.

Installation

oppm register https://github.com/gelraen/OpenComputers-prometheus
oppm install prometheus

Quick start guide

Example rc script:

-- Initialize with pushgateway endpoint and a set of grouping labels:
local prometheus = prometheus.init("http://localhost:9091/metrics", {player="someone"})

--[[ Callback that is called once with a single argument - `Prometheus` object
that will contain a bunch of metrics.

Return value will be passed as is to `update` callback.
]]
local function init(prom)
  return {
    count=prom:counter("test_counter", "Test counter", {"foo"}),
  }
end

--[[ Callback that will be called on timer to update metric values.

The only argument is the value returned by `init` callback.
]]
local function update(metrics)
  metrics.count:inc(1, {"a"})
  metrics.count:inc(2, {"b"})
end

function start()
  --[[ Every 60 seconds push new set of metric values. Labels passed in second
  argument are merged together with labels passed to prometheus.init() to create
  a set of grouping labels. This set is the going to be used in Pushgateway
  endpoint URL.
  ]]
  prometheus:timer(60, {job="foobar"}, init, update)
end

function stop()
  prometheus:stop()
end

API reference

init()

syntax: require("prometheus").init(pushgateway_url, [grouping_labels])

Initializes the module.

pushgateway_url is the address of pushgateway to use, e.g. "http://localhost:9091/metrics". If your pushgateway is on the local network (that is, you're not accessing it over public internet), be sure to remove it's address from a blacklist in OpenComputers config on your server.
grouping_labels is an optional dict with global gropuing labels - they end up in the full URL when metrics are pushed to pushgateway.

Returns a prometheusFactory object that should be used to configure periodic pushes.

Example:

local prometheus = require("prometheus").init("http://localhost:9091/metrics", {player="yourname"})

prometheusFactory:timer()

syntax: prometheus:timer(interval, grouping_labels, init_cb, update_cb, [prefix])

Starts a periodic push of metrics.

Metrics are pushed with PUT HTTP method, so every push will completely replace all metrics pushed earlier with the same grouping labels. That is, you don't have to worry about cleaning up stale values in multi-dimensional metrics, just reset() and populate the metric from scratch.

interval is the push interval in seconds.
grouping_labels is a dict with additional grouping labels. It gets merged with grouping_labels passed to init(); if job label is not present - it gets added automatically; and then the final list together with pushgateway_url gets transformed into full URL used to push metrics.
init_cb is a function that gets called once, with a new prometheus object as a single argument. This callback can create metrics using methods described below and return a value that is passed to update_cb.
update_cb is a callback that is called before every push to update metric values.
prefix is an optional string to prefix metric names with.

Example:

prometheus:timer(1, {job="foobar"}, function(prom)
  return {
    count=prom:counter("test_counter", "Test counter", {"foo"}),
  }
end, function(metrics)
  metrics.count:inc(1, {"a"})
  metrics.count:inc(2, {"b"})
end)

prometheusFactory:stop()

syntax: prometheus:stop()

Stops any periodic pushes started before.

API inherited from nginx-lua-prometheus

I haven't got around yet to updating examples and cleaning up references to Nginx, but it still provides a lot of information that applies to this OpenComputers library.

prometheus:counter()

syntax: prometheus:counter(name, description, label_names)

Registers a counter. Should be called once from the init_by_lua section.

name is the name of the metric.
description is the text description that will be presented to Prometheus along with the metric. Optional (pass nil if you still need to define label names).
label_names is an array of label names for the metric. Optional.

Naming section of Prometheus documentation provides good guidelines on choosing metric and label names.

Returns a counter object that can later be incremented.

Example:

init_by_lua '
  prometheus = require("prometheus").init("prometheus_metrics")
  metric_bytes = prometheus:counter(
    "nginx_http_request_size_bytes", "Total size of incoming requests")
  metric_requests = prometheus:counter(
    "nginx_http_requests_total", "Number of HTTP requests", {"host", "status"})
';

prometheus:gauge()

syntax: prometheus:gauge(name, description, label_names)

Registers a gauge. Should be called once from the init_by_lua section.

name is the name of the metric.
description is the text description that will be presented to Prometheus along with the metric. Optional (pass nil if you still need to define label names).
label_names is an array of label names for the metric. Optional.

Returns a gauge object that can later be set.

Example:

init_by_lua '
  prometheus = require("prometheus").init("prometheus_metrics")
  metric_connections = prometheus:gauge(
    "nginx_http_connections", "Number of HTTP connections", {"state"})
';

prometheus:histogram()

syntax: prometheus:histogram(name, description, label_names, buckets)

Registers a histogram. Should be called once from the init_by_lua section.

name is the name of the metric.
description is the text description. Optional.
label_names is an array of label names for the metric. Optional.
buckets is an array of numbers defining bucket boundaries. Optional, defaults to 20 latency buckets covering a range from 5ms to 10s (in seconds).

Returns a histogram object that can later be used to record samples.

Example:

init_by_lua '
  prometheus = require("prometheus").init("prometheus_metrics")
  metric_latency = prometheus:histogram(
    "nginx_http_request_duration_seconds", "HTTP request latency", {"host"})
  metric_response_sizes = prometheus:histogram(
    "nginx_http_response_size_bytes", "Size of HTTP responses", nil,
    {10,100,1000,10000,100000,1000000})
';

prometheus:metric_data()

syntax: prometheus:metric_data()

Returns metric data as an array of strings.

counter:inc()

syntax: counter:inc(value, label_values)

Increments a previously registered counter. This is usually called from log_by_lua globally or per server/location.

value is a value that should be added to the counter. Defaults to 1.
label_values is an array of label values.

The number of label values should match the number of label names defined when the counter was registered using prometheus:counter(). No label values should be provided for counters with no labels. Non-printable characters will be stripped from label values.

Example:

log_by_lua '
  metric_bytes:inc(tonumber(ngx.var.request_length))
  metric_requests:inc(1, {ngx.var.server_name, ngx.var.status})
';

counter:del()

syntax: counter:del(label_values)

Delete a previously registered counter. This is usually called when you don't need to observe such counter (or a metric with specific label values in this counter) any more. If this counter has labels, you have to pass label_values to delete the specific metric of this counter. If you want to delete all the metrics of a counter with labels, you should call Counter:reset().

label_values is an array of label values.

counter:reset()

syntax: counter:reset()

Delete all metrics for a previously registered counter. If this counter have no labels, it is just the same as Counter:del() function. If this counter have labels, it will delete all the metrics with different label values.

gauge:set()

syntax: gauge:set(value, label_values)

Sets the current value of a previously registered gauge. This could be called from log_by_lua globally or per server/location to modify a gauge on each request, or from content_by_lua just before prometheus::collect() to return a real-time value.

value is a value that the gauge should be set to. Required.
label_values is an array of label values.

gauge:inc()

syntax: gauge:inc(value, label_values)

Increments or decrements a previously registered gauge. This is usually called when you want to observe the real-time value of a metric that can both be increased and decreased.

value is a value that should be added to the gauge. It could be a negative value when you need to decrease the value of the gauge. Defaults to 1.
label_values is an array of label values.

The number of label values should match the number of label names defined when the gauge was registered using prometheus:gauge(). No label values should be provided for gauges with no labels. Non-printable characters will be stripped from label values.

gauge:del()

syntax: gauge:del(label_values)

Delete a previously registered gauge. This is usually called when you don't need to observe such gauge (or a metric with specific label values in this gauge) any more. If this gauge has labels, you have to pass label_values to delete the specific metric of this gauge. If you want to delete all the metrics of a gauge with labels, you should call Gauge:reset().

label_values is an array of label values.

gauge:reset()

syntax: gauge:reset()

Delete all metrics for a previously registered gauge. If this gauge have no labels, it is just the same as Gauge:del() function. If this gauge have labels, it will delete all the metrics with different label values.

histogram:observe()

syntax: histogram:observe(value, label_values)

Records a value in a previously registered histogram. Usually called from log_by_lua globally or per server/location.

value is a value that should be recorded. Required.
label_values is an array of label values.

Example:

log_by_lua '
  metric_latency:observe(tonumber(ngx.var.request_time), {ngx.var.server_name})
  metric_response_sizes:observe(tonumber(ngx.var.bytes_sent))
';

Built-in metrics

The module increments the metric_errors_total metric if it encounters an error (for example, when lua_shared_dict becomes full). You might want to configure an alert on that metric.

Credits

Created and maintained by Anton Tolchanov (@knyar)
Metrix prefix support contributed by david birdsong (@davidbirdsong)
Gauge support contributed by Cosmo Petrich (@cosmopetrich)
Adapted to OpenComputers by Max Ignatenko (@gelraen)

License

Licensed under MIT license.

imax9000/OpenComputers-prometheus

Prometheus metric library for OpenComputers

Installation

Quick start guide

API reference

init()

prometheusFactory:timer()

prometheusFactory:stop()

API inherited from nginx-lua-prometheus

prometheus:counter()

prometheus:gauge()

prometheus:histogram()

prometheus:metric_data()

counter:inc()

counter:del()

counter:reset()

gauge:set()

gauge:inc()

gauge:del()

gauge:reset()

histogram:observe()

Built-in metrics

Credits

License