aws/aws-for-fluent-bit

Not able to see Application logs in Cloud watch

Opened this issue · 1 comments

Added the config map for the AWS EKS Fargate cluster

Kindly find the map below
kind: Namespace
apiVersion: v1
metadata:
name: aws-observability
labels:
aws-observability: enabled

kind: ConfigMap
apiVersion: v1
metadata:
name: aws-logging
namespace: aws-observability
data:

output.conf: |
[OUTPUT]
Name cloudwatch_logs
Match *
region ap-south-1
log_group_name fluent-bit-cloudwatch
log_stream_prefix from-fluent-bit-
auto_create_group true

able to see the Kubectl pods logs on the cloud watch.
But the logs which we stored on CONTAINERS "var/log/containers" in not visible in cloudwatch.

Also there is not method specified on document to add custom input.
https://docs.aws.amazon.com/eks/latest/userguide/fargate-logging.html#fargate-logging-test-application
Which container dir the logs should be pushed in so that fluent bit pulls them.

able to see the Kubectl pods logs on the cloud watch.

The built-in Fluent Bit only collects these logs, nothing more. You can't add custom inputs.

But the logs which we stored on CONTAINERS "var/log/containers" in not visible in cloudwatch.

Then you want this: