/clicky-state-intake

Python application to pull data from Clicky.com and push to a Kafka topic.

Primary LanguagePython

Clicky Stats Intake

This is a python application that polls Clicky.com site statistics API and pushes those stats in JSON form to a Kafka topic.

It is only meant to be sample code at the moment.

It is also meant to run in Marathon as a Docker container.

Building the Dockerfile

In order to build the docker container run these commands:

$ git clone git@github.com:admintome/clicky-state-intake.git
$ cd clicky-state-intake/
$ docker build -t site-stats-intake .

Then to run:

docker run -it --rm --name intake --env SITE_ID="{your clicky site_id" --env SITEKEY="{your clicky sitekey}" --env KAFKA_BROKERS="192.168.1.x:port" site-stats-intake

Deploy to Marathon

Create a new application:

{
  "id": "site-stats-intake",
  "cmd": null,
  "cpus": 1,
  "mem": 128,
  "disk": 0,
  "instances": 1,
  "container": {
    "docker": {
      "image": "admintome/site-stats-intake"
    },
    "type": "DOCKER"
  },
  "networks": [
    {
      "mode": "host"
    }
  ],
  "env": {
    "KAFKA_BROKERS": "192.168.1.x:port",
    "SITE_ID": "{your site_id}",
    "SITEKEY": "{your sitekey}"
  }
}

For more infomation checkout my articles:

Kafka Python Tutorial for Fast Data Architecture Kafka Tutorial for Fast Data Architecture