crossplane-contrib/provider-kubernetes

Scalability: support --max-reconcile-rate arg

gberche-orange opened this issue · 0 comments

What problem are you facing?

From https://crossplane.slack.com/archives/CEG3T90A1/p1647335790153809?thread_ts=1647335364.461669&cid=CEG3T90A1:

I'm observing that a single XRC with a composition provisionning 4 kubernetes provider Objects is taking ~30-60s to become ready on a fresh empty K8S cluster. When there is an set of existing 300 XRCs already reconciled, then a new XRC reconciles in 30 minutes on my cluster.
I'm running latest versions (crossplane 1.6.4 with helm provider 0.10 and kubernes provider 0.10.0) with the --max-reconcile-rate=100 arg in the helm chart args.

How could Crossplane help solve your problem?

From crossplane/crossplane#2595 (comment), the helm and kubernetes providers don't yet support the max reconcile rate option.

Support for the --max-reconcile-rate would enable concurrent parallel processing of kubernetes provider Object MRs