Reads logs fom a Kafka topic and split logs according to a key
The logs topic contains json-based messages. Two key fields are used:
log_typefrom the main message (default value)_log_typein the nested json-based data withinmessage(default value)
If their value is application (default value), then the nested json is extracted to the main message and the field is tested.
{
"log_type":"application",
"message":"{\"_log_type\":\"audit\",\"message\":\"Hello World from app !\"}"
}If their value is audit, then the message is routed to the auditlogs topic.
{
"log_type":"audit",
"message":"Hello World from audit !"
}