/fluent-bit-go-gcs

Fluent-Bit output plugin for Google Cloud Storage

Primary LanguageGoApache License 2.0Apache-2.0

fluent-bit gcs output plugin

This plugin works with fluent-bit's go plugin interface. You can use fluent-bit-go-gcs to ship logs into GCP Storage.

The configuration typically looks like:

Fluent-Bit --> Google Cloud Storage <-- Google Cloud BigQuery

Usage

$ fluent-bit -e /path/to/built/out_gcs.so -c fluent-bit.conf

Prerequisites

  • Go 1.13+
  • gcc (for cgo)

Building

Library:

$ make

Container Image:

$ make build

Configuration Options

Key Description Default value Note
Credential Path of GCP credential - Mandatory parameter
Bucket Bucket name of GCS - Mandatory parameter
Prefix Prefix of GCS key - Mandatory parameter
Region Region of GCS - Mandatory parameter

Example:

add this section to fluent-bit.conf

[Output]
    Name 		gcs
    Match 		*
    Credential  /path/to/sharedcredentialfile
    Bucket      yourbucketname
    Prefix 		yourgcsprefixname
    Region 		europe-west1