An query and alerting engine...!
Kafka Installation https://github.com/apache/kafka/blob/trunk/docker/examples/README.md
docker pull apache/kafka:latest
docker run -p 9092:9092 apache/kafka
MySql Docker
docker pull mysql
docker run --name mysql -e MYSQL_ROOT_PASSWORD=123456 -p 3308:3306 -d mysql
Create Meta Data Base
# login
mysql -p
# create database
CREATE DATABASE meta
Api key mapping
SELECT user_events.user_user_name AS user_name,
event_api_keys.event_event_id AS event_id,
api_key.api_key,
api_key.expiry_time
FROM api_key
JOIN event_api_keys ON api_key.id = event_api_keys.api_keys_id
JOIN user_events ON user_events.events_event_id = event_api_keys.event_event_id
WHERE api_key='51018598c935462189a4941d57388456';
Send Log => Pulish to kafka for validation => store data into clickhouse once validated => query data