Filter if same value of a specific key exists in event logs
fluentd >= 0.12.2
gem install fluent-plugin-unique-filter
(In some cases use fluent-gem
or td-agent-gem
instead of gem command)
<filter exmaple>
@type unique
key user_id
</filter>
Example: expire interval configuable
<filter exmaple>
@type unique
key user_id
expire_interval 10m
</filter>
Example: reset uniquness check in every hour
<filter exmaple>
@type unique
key user_id
expire_interval 1h
expire_starts_on_day
</filter>
Bug reports and pull requests are welcome on GitHub at https://github.com/holysugar/fluent-plugin-unique-filter .