LogMeIfYouCan LogMeIfYouCan

Real-Time Log Analysis with Kafka, Flink, InfluxDB and TimeScaleDB.

  • Simulate Logs Events and send them to Kafka
  • Process Logs with Flink
  • Count number of Log Events with Window
  • Page Latency Statistics
  • Introduce Watermark technique for event-time processing
  • Load log measurements to InfluxDB
  • Load log measurements to TimescaleDB
  • Add Docker Compose
  • Join Log Stream from both Web Server and Application Server
  • Alert errors, anomaly or suspect trends to separate topics in Kafka