dev-stack

Developer repo to setup the geovistory stack, consisting of:

Postgres Server (including seeded database for toolbox)
3 Kafka brokers with schema registry (redpanda)
Kafka connect (including Postgres source connector, Postgres sink connector, RDF sink connector)
Toolbox streams apps (10)
Toolbox server
Toolbox client
Fuseki

System requirements

Docker (and docker-compose)
10 GB RAM assigned to docker
4 CPUs assigned to docker
100 GB disk space assigned to docker

Build and start stack

If you start the first time or you want to apply changes to the docker setup, call this command:

bash scripts/build

This should start all layers of the stack.

It takes 2-3 min to initialize the database. Observe the progres:

docker logs geov_dev-postgres-1 --follow

See the status of the running containers in Docker Desktop (only on Mac/Win) or with docker ps.

See the status of kafka connect and kafka streams in the Redpanda Console (find link in console after bash scripts/build).

Stop stack

Stop the stack without removing the containers:

bash scripts/down

Start stack

Start the stopped containers:

bash scripts/up

Cleanup volumes

bash scripts/down does not remove the volumes (data of database etc.). It just stops the containers (and frees resources on your computer). Sometimes it is useful to start with a clean installation of the entire stack or one component. In this situation it is necessary to remove one ore more volumes.

To remove all volumes having "geov_dev" in the name, run:

bash scripts/remove-volumes

This command will not remove used volumes. To delete them, first stop the stack.

To remove an individual volume you can first list all volumes:

docker volume ls -f "name=geov_dev"

And then remove the volume by its name (here fuseki):