/kubequeue

Copy/paste framework for a simple job distributed job queue with Kubernetes

Primary LanguagePython

kubequeue

  1. Install kubectl
  2. Add your function to tasks.py, see add_one for example
  3. Configure cluster-start.sh parameters (including CLUSTER_ID)
  4. Configure IMAGE_NAME in image-build.sh and worker.yaml
  5. Add dependencies to Dockerfile
  6. Run ./image-build.sh
  7. Run ./cluster-start.sh
  8. Run ./kube-start.sh
  9. Change the TASK and ARGS parameters to your input task/arguments in submit.py.
  10. Replace print(outputs) with whatever you want to do with your outputs.
  11. Run python3 submit.py and wait!