awslabs/amazon-kinesis-agent

send some static columns (for example - host)

slmzig opened this issue · 1 comments

Business problem.
In my case we have thousand of servers with files. In source files we have not got information about server name and we can not add it. And on the kinesis analytics side we need to know what server the event come from and make a decision based on this information. So it would be great to add serverName to the event.
I need this feature in CSVTOJSON processor.

hey @slmzig,
please have a look at https://aws.amazon.com/premiumsupport/knowledge-center/kinesis-data-firehose-agent-ec2-metadata/ . there is an option for exporting ec2 metadata(privateIp, availabilityZone, instanceId, instanceType, accountId, amiId, region, and metadataTimestamp) along logs.

However not sure about adding "custom" static attribute in configuration like : service=myservice or team=myteam.
Looking for it if there is a way to achieve it. Will update here accordingly if found something.