Cilantro is a scheduling framework for performance-aware allocation of resources among competing jobs. Unlike other schedulers, which require jobs to state resource demands, Cilantro applies online-learning to dynamically allocate resources optimizing for the user stated objective. Objectives may be defined on individual utilities reported by jobs, such as latency and throughput SLOs.
For more details, please refer to our OSDI 2023 paper.
Below we link to two examples of running Cilantro on Kubernetes clusters. These experiments were used in our paper.
This experiment borrows the hotel-reservation benchmark from Deathstarbench to demonstrate the application of cilantro to an application composed of many microservices. Cilantro can optimize the end-to-end performance of the application by individually controlling the resource allocation of each microservice. See Section 6.2 in the paper for more details.
Please follow experiments/microservices/README.md for instructions on how to run this experiment.
This experiment evaluates Cilantro’s multi-tenant policies (Section 4.1.2 in the paper) on a 1000 CPU cluster shared by 20 users. Please refer to Section 6.1 in the paper for more details.
Please follow experiments/cluster_sharing/README.md for instructions on how to run this experiment.
./cilantrocontains the core Cilantro code base../cilantro/policiescontains implementations Cilantro's policies and other baselines../cilantro/backendscontains different event sources (gRPC, Kubernetes, timer) supported in Cilantro../cilantro/learnerscontains implementations of different online learning algorithms used in Cilantro../cilantro/schedulercontains the main scheduler loop.
./experimentscontains the code for running Cilantro experiments presented in our paper.- cilantro-workloads is a sister repository that contains the workloads used in our paper. These workloads are already compiled and pushed to Cilantro's ECR repository.
- If you'd like to build your own image for Cilantro, please refer to
./eks/README.mdfor instructions on how to create your own image registry on AWS ECR and build/push cilantro images to it. ./README_DEV.mdcontains instructions for developers who want to modify and extend Cilantro.
Coming soon!