VRA is a TypeScript crawler that can get information on room vacancy from a list of Airbnb room numbers, then, ideally, analyze this data through the use of microservices such as Kibana. Helm artifacts were used for most of the structure of the project.
Project started as docker-compose, became a GKE cluster with manually configured builds, which then were readapted into custom Helm charts, then resignated into using Helm artifacts with custom values due to intercommunication issues, but lost a considerable amount of control in the way.
-
Prepare a Docker environment with kubectl and helm
-
Execute the script:
./setup.sh -
Access Kibana on http://localhost:5601/
-
Prepare the metrics and go to the Discover page
Project uses a local version of kube-prometheus-stack with Prometheus, Grafana, AlertManager and more.
Helm artifacts from elastic for Elastic Search, Kibana, FileBeat and MetricBeat also were used.
-
Connection between Crawler, Filebeats and Logstash
-
Slow environment
-
Deprecated microservices and configurations
-
Outdated discussions and absurd amount of different approaches
Logging In The Cloud-Native Age
How to Deploy the Elastic Stack on Kubernetes
Deploying the ELK Stack on Kubernetes with Helm
Deploy Logstash and Filebeat On Kubernetes With ECK and SSL
Enabling Observability in Kubernetes with Prometheus, Elasticsearch, and Grafana