c0t3d0s0/spark-cluster-api-operator

Use Kubernetes to autoscale your spark clusters.

Spark Cluster API Operator

This operator is designed to be called from Spark to integrate with the cluster API

External Code

• Kubicorn
• Cluster API Operator
• Spark with the POC changes mostly inside (xecutorPodsAllocator,ExecutorAllocationManager)

Link to Slides from Strata 2019 London