/distributed-scrapper

Microservices based distributed scrapper for fetching categorized Wikipedia content. Used for testing mircorservices intresting solutions.

Primary LanguageGoMIT LicenseMIT

distributed-scrapper

Microservices based distributed scrapper for fetching categorized Wikipedia content. Used for testing mircorservices intresting solutions. Used: - Go - Kafka - RabbitMQ - Istio - Darp - CocroachDB - NoSQL (to choose)

TODO

  • Golang opentelemetry and other metrics
  • CocraochDB optimization
  • Kafka deployment with kafka-ui
  • K8s/Helm deployt with charts
  • Istio
  • Darp
  • Keycloak
  • Cassandra vs CocrachDB vs MongoDB
  • Telepresence test