Ansible Fluentd Role

This role installs and configures Fluentd v2.x on a Debian-based server from official Treasure Data repositories.

Requirements

This role requires Ansible 1.7 or higher and platform requirements are listed in the metadata file.

Features

install fluentd
install fluentd plugins
full fluentd configuration over role variables (fluentd_plugins, fluentd_sources, fluentd_matches, fluentd_system, fluentd_includes)

Examples

- name: deploy fluentd server
  hosts: fluentd_server
  sudo: yes

  roles:
    - role: clickfreak.fluentd
      fluentd_plugins:
        - fluent-plugin-elasticsearch
        - fluent-plugin-forest
        - fluent-plugin-exclude-filter

      fluentd_sources:
        - comment: "live debugging agent"
          type: "debug_agent"
          params:
            - bind: "127.0.0.1"
            - port: "24230"

        - comment: "Syslog input"
          type: "syslog"
          params:
            - port: "5140"
            - bind: "{{ ansible_default_ipv4.address }}"
            - tag: "syslog"

      fluentd_matches:
        - comment: "match tag=debug.** and dump to console"
          match: "debug.**"
          type: stdout

        - comment: "send all data from net equipment to elasticsearch and files"
          match: "**"
          type: "copy"
          params:
            - store:
              - type: elasticsearch
              - logstash_format: "true"
              - host: "127.0.0.1"
              - port: "9200"
            - store:
              - type: file
              - path: /var/log/td-agent/all_logs
              - time_slice_format: "%Y-%m-%d"
              - time_slice_wait: "1m"
              - append: "true"

      fluentd_system:
        - log_level: "error"

      fluentd_includes:
        - "/etc/td-agent/conf.d/*"

Dependencies

python, python-apt on target hosts. You can use ansible to install it :)

Author Information

Konstantin Novakovsky / Selectel LLC