Issue: `mariadb-operator-(webhook)` stuck in starting workers, watching certificates

Question

Issue: `mariadb-operator-(webhook)` stuck in starting workers, watching certificates

Closed this issue 3 months ago · 1 comments

Operator/webhook stalled at starting workers/starting certificate watcher
After installing the mariadb-operator (with custom configuration),

The mariadb-operator-webhook-... pod is at "Starting certificate watcher"
The mariadb-operator-... pod is at Starting workers.
And there is no progress after that. There is no indication as to what is causing the stall, even with logLevel=debug.

Here are the relevant logs:

Logs for `mariadb-operator`

❯ kubectl logs --since=1h pod/mariadb-operator-694cf97594-bsfb9
{"level":"info","ts":1717776229.1040246,"logger":"setup","msg":"Watching all namespaces"}
{"level":"info","ts":1717776229.1043713,"logger":"setup","msg":"Discovery info"}
{"level":"info","ts":1717776229.1043768,"logger":"setup","msg":"Enterprise","enterprise":false}
{"level":"info","ts":1717776229.110317,"logger":"setup","msg":"Resources","ServiceMonitor":false,"SecurityContextConstrainsts":false}
{"level":"info","ts":1717776229.1134164,"logger":"setup","msg":"Starting manager"}
{"level":"info","ts":1717776229.1134765,"logger":"controller-runtime.metrics","msg":"Starting metrics server"}
{"level":"info","ts":1717776229.1135268,"msg":"starting server","kind":"health probe","addr":"[::]:8081"}
{"level":"info","ts":1717776229.1135433,"logger":"controller-runtime.metrics","msg":"Serving metrics server","bindAddress":":8080","secure":false}
{"level":"info","ts":1717776229.2140713,"msg":"Starting EventSource","controller":"maxscale","controllerGroup":"k8s.mariadb.com","controllerKind":"MaxScale","source":"kind source: *v1alpha1.MaxScale"}
{"level":"info","ts":1717776229.2140725,"msg":"Starting EventSource","controller":"mariadb","controllerGroup":"k8s.mariadb.com","controllerKind":"MariaDB","source":"kind source: *v1alpha1.MariaDB"}
{"level":"info","ts":1717776229.2141042,"msg":"Starting EventSource","controller":"mariadb","controllerGroup":"k8s.mariadb.com","controllerKind":"MariaDB","source":"kind source: *v1alpha1.MaxScale"}
{"level":"info","ts":1717776229.214111,"msg":"Starting EventSource","controller":"mariadb","controllerGroup":"k8s.mariadb.com","controllerKind":"MariaDB","source":"kind source: *v1alpha1.Connection"}
{"level":"info","ts":1717776229.2141132,"msg":"Starting EventSource","controller":"backup","controllerGroup":"k8s.mariadb.com","controllerKind":"Backup","source":"kind source: *v1alpha1.Backup"}
{"level":"info","ts":1717776229.2141294,"msg":"Starting EventSource","controller":"backup","controllerGroup":"k8s.mariadb.com","controllerKind":"Backup","source":"kind source: *v1.CronJob"}
{"level":"info","ts":1717776229.214134,"msg":"Starting EventSource","controller":"backup","controllerGroup":"k8s.mariadb.com","controllerKind":"Backup","source":"kind source: *v1.Job"}
{"level":"info","ts":1717776229.2141297,"msg":"Starting EventSource","controller":"restore","controllerGroup":"k8s.mariadb.com","controllerKind":"Restore","source":"kind source: *v1alpha1.Restore"}
{"level":"info","ts":1717776229.21412,"msg":"Starting EventSource","controller":"mariadb","controllerGroup":"k8s.mariadb.com","controllerKind":"MariaDB","source":"kind source: *v1alpha1.Restore"}
{"level":"info","ts":1717776229.2141564,"msg":"Starting EventSource","controller":"restore","controllerGroup":"k8s.mariadb.com","controllerKind":"Restore","source":"kind source: *v1.Job"}
{"level":"info","ts":1717776229.2141604,"msg":"Starting EventSource","controller":"mariadb","controllerGroup":"k8s.mariadb.com","controllerKind":"MariaDB","source":"kind source: *v1alpha1.User"}
{"level":"info","ts":1717776229.2141547,"msg":"Starting EventSource","controller":"connection","controllerGroup":"k8s.mariadb.com","controllerKind":"Connection","source":"kind source: *v1alpha1.Connection"}
{"level":"info","ts":1717776229.2141712,"msg":"Starting EventSource","controller":"mariadb","controllerGroup":"k8s.mariadb.com","controllerKind":"MariaDB","source":"kind source: *v1alpha1.Grant"}
{"level":"info","ts":1717776229.2141771,"msg":"Starting EventSource","controller":"connection","controllerGroup":"k8s.mariadb.com","controllerKind":"Connection","source":"kind source: *v1.Secret"}
{"level":"info","ts":1717776229.2141798,"msg":"Starting EventSource","controller":"mariadb","controllerGroup":"k8s.mariadb.com","controllerKind":"MariaDB","source":"kind source: *v1.ConfigMap"}
{"level":"info","ts":1717776229.2141402,"msg":"Starting EventSource","controller":"backup","controllerGroup":"k8s.mariadb.com","controllerKind":"Backup","source":"kind source: *v1.PersistentVolumeClaim"}
{"level":"info","ts":1717776229.214189,"msg":"Starting EventSource","controller":"statefulset","controllerGroup":"apps","controllerKind":"StatefulSet","source":"kind source: *v1.StatefulSet"}
{"level":"info","ts":1717776229.2141936,"msg":"Starting EventSource","controller":"sqljob","controllerGroup":"k8s.mariadb.com","controllerKind":"SqlJob","source":"kind source: *v1alpha1.SqlJob"}
{"level":"info","ts":1717776229.214091,"msg":"Starting EventSource","controller":"maxscale","controllerGroup":"k8s.mariadb.com","controllerKind":"MaxScale","source":"kind source: *v1alpha1.User"}
{"level":"info","ts":1717776229.2142134,"msg":"Starting EventSource","controller":"sqljob","controllerGroup":"k8s.mariadb.com","controllerKind":"SqlJob","source":"kind source: *v1.ConfigMap"}
{"level":"info","ts":1717776229.214212,"msg":"Starting EventSource","controller":"user","controllerGroup":"k8s.mariadb.com","controllerKind":"User","source":"kind source: *v1alpha1.User"}
{"level":"info","ts":1717776229.2142222,"msg":"Starting EventSource","controller":"sqljob","controllerGroup":"k8s.mariadb.com","controllerKind":"SqlJob","source":"kind source: *v1.CronJob"}
{"level":"info","ts":1717776229.2142296,"msg":"Starting EventSource","controller":"user","controllerGroup":"k8s.mariadb.com","controllerKind":"User","source":"kind source: *v1.Secret"}
{"level":"info","ts":1717776229.214204,"msg":"Starting Controller","controller":"statefulset","controllerGroup":"apps","controllerKind":"StatefulSet"}
{"level":"info","ts":1717776229.2142372,"msg":"Starting Controller","controller":"user","controllerGroup":"k8s.mariadb.com","controllerKind":"User"}
{"level":"info","ts":1717776229.2142024,"msg":"Starting Controller","controller":"backup","controllerGroup":"k8s.mariadb.com","controllerKind":"Backup"}
{"level":"info","ts":1717776229.2141924,"msg":"Starting EventSource","controller":"connection","controllerGroup":"k8s.mariadb.com","controllerKind":"Connection","source":"kind source: *v1.Secret"}
{"level":"info","ts":1717776229.2142308,"msg":"Starting EventSource","controller":"sqljob","controllerGroup":"k8s.mariadb.com","controllerKind":"SqlJob","source":"kind source: *v1.Job"}
{"level":"info","ts":1717776229.2142582,"msg":"Starting Controller","controller":"connection","controllerGroup":"k8s.mariadb.com","controllerKind":"Connection"}
{"level":"info","ts":1717776229.2142603,"msg":"Starting Controller","controller":"sqljob","controllerGroup":"k8s.mariadb.com","controllerKind":"SqlJob"}
{"level":"info","ts":1717776229.2141643,"msg":"Starting Controller","controller":"restore","controllerGroup":"k8s.mariadb.com","controllerKind":"Restore"}
{"level":"info","ts":1717776229.2142725,"msg":"Starting EventSource","controller":"grant","controllerGroup":"k8s.mariadb.com","controllerKind":"Grant","source":"kind source: *v1alpha1.Grant"}
{"level":"info","ts":1717776229.2142315,"msg":"Starting EventSource","controller":"maxscale","controllerGroup":"k8s.mariadb.com","controllerKind":"MaxScale","source":"kind source: *v1alpha1.Grant"}
{"level":"info","ts":1717776229.214282,"msg":"Starting EventSource","controller":"grant","controllerGroup":"k8s.mariadb.com","controllerKind":"Grant","source":"kind source: *v1alpha1.User"}
{"level":"info","ts":1717776229.2142868,"msg":"Starting Controller","controller":"grant","controllerGroup":"k8s.mariadb.com","controllerKind":"Grant"}
{"level":"info","ts":1717776229.2142894,"msg":"Starting EventSource","controller":"maxscale","controllerGroup":"k8s.mariadb.com","controllerKind":"MaxScale","source":"kind source: *v1alpha1.Connection"}
{"level":"info","ts":1717776229.2143002,"msg":"Starting EventSource","controller":"maxscale","controllerGroup":"k8s.mariadb.com","controllerKind":"MaxScale","source":"kind source: *v1.Secret"}
{"level":"info","ts":1717776229.2143075,"msg":"Starting EventSource","controller":"pod","controllerGroup":"","controllerKind":"Pod","source":"kind source: *v1.Pod"}
{"level":"info","ts":1717776229.2143085,"msg":"Starting EventSource","controller":"maxscale","controllerGroup":"k8s.mariadb.com","controllerKind":"MaxScale","source":"kind source: *v1.Service"}
{"level":"info","ts":1717776229.2143135,"msg":"Starting Controller","controller":"pod","controllerGroup":"","controllerKind":"Pod"}
{"level":"info","ts":1717776229.21432,"msg":"Starting EventSource","controller":"maxscale","controllerGroup":"k8s.mariadb.com","controllerKind":"MaxScale","source":"kind source: *v1.PodDisruptionBudget"}
{"level":"info","ts":1717776229.2143044,"msg":"Starting EventSource","controller":"mariadb","controllerGroup":"k8s.mariadb.com","controllerKind":"MariaDB","source":"kind source: *v1.Service"}
{"level":"info","ts":1717776229.2143285,"msg":"Starting EventSource","controller":"maxscale","controllerGroup":"k8s.mariadb.com","controllerKind":"MaxScale","source":"kind source: *v1.StatefulSet"}
{"level":"info","ts":1717776229.2143314,"msg":"Starting EventSource","controller":"pod","controllerGroup":"","controllerKind":"Pod","source":"kind source: *v1.Pod"}
{"level":"info","ts":1717776229.2143488,"msg":"Starting EventSource","controller":"mariadb","controllerGroup":"k8s.mariadb.com","controllerKind":"MariaDB","source":"kind source: *v1.Secret"}
{"level":"info","ts":1717776229.214337,"msg":"Starting EventSource","controller":"maxscale","controllerGroup":"k8s.mariadb.com","controllerKind":"MaxScale","source":"kind source: *v1.Deployment"}
{"level":"info","ts":1717776229.2143571,"msg":"Starting EventSource","controller":"mariadb","controllerGroup":"k8s.mariadb.com","controllerKind":"MariaDB","source":"kind source: *v1.Event"}
{"level":"info","ts":1717776229.2143502,"msg":"Starting Controller","controller":"pod","controllerGroup":"","controllerKind":"Pod"}
{"level":"info","ts":1717776229.2143662,"msg":"Starting EventSource","controller":"maxscale","controllerGroup":"k8s.mariadb.com","controllerKind":"MaxScale","source":"kind source: *v1.Secret"}
{"level":"info","ts":1717776229.2143693,"msg":"Starting EventSource","controller":"mariadb","controllerGroup":"k8s.mariadb.com","controllerKind":"MariaDB","source":"kind source: *v1.ServiceAccount"}
{"level":"info","ts":1717776229.2143788,"msg":"Starting EventSource","controller":"mariadb","controllerGroup":"k8s.mariadb.com","controllerKind":"MariaDB","source":"kind source: *v1.StatefulSet"}
{"level":"info","ts":1717776229.2143824,"msg":"Starting EventSource","controller":"mariadb","controllerGroup":"k8s.mariadb.com","controllerKind":"MariaDB","source":"kind source: *v1.Deployment"}
{"level":"info","ts":1717776229.2143874,"msg":"Starting EventSource","controller":"mariadb","controllerGroup":"k8s.mariadb.com","controllerKind":"MariaDB","source":"kind source: *v1.PodDisruptionBudget"}
{"level":"info","ts":1717776229.214352,"msg":"Starting EventSource","controller":"database","controllerGroup":"k8s.mariadb.com","controllerKind":"Database","source":"kind source: *v1alpha1.Database"}
{"level":"info","ts":1717776229.2143981,"msg":"Starting Controller","controller":"database","controllerGroup":"k8s.mariadb.com","controllerKind":"Database"}
{"level":"info","ts":1717776229.2144034,"msg":"Starting EventSource","controller":"mariadb","controllerGroup":"k8s.mariadb.com","controllerKind":"MariaDB","source":"kind source: *v1.Role"}
{"level":"info","ts":1717776229.2144103,"msg":"Starting EventSource","controller":"mariadb","controllerGroup":"k8s.mariadb.com","controllerKind":"MariaDB","source":"kind source: *v1.RoleBinding"}
{"level":"info","ts":1717776229.2143736,"msg":"Starting Controller","controller":"maxscale","controllerGroup":"k8s.mariadb.com","controllerKind":"MaxScale"}
{"level":"info","ts":1717776229.2144146,"msg":"Starting EventSource","controller":"mariadb","controllerGroup":"k8s.mariadb.com","controllerKind":"MariaDB","source":"kind source: *v1.ClusterRoleBinding"}
{"level":"info","ts":1717776229.214419,"msg":"Starting EventSource","controller":"mariadb","controllerGroup":"k8s.mariadb.com","controllerKind":"MariaDB","source":"kind source: *v1.ConfigMap"}
{"level":"info","ts":1717776229.2144246,"msg":"Starting EventSource","controller":"mariadb","controllerGroup":"k8s.mariadb.com","controllerKind":"MariaDB","source":"kind source: *v1.Secret"}
{"level":"info","ts":1717776229.2144291,"msg":"Starting Controller","controller":"mariadb","controllerGroup":"k8s.mariadb.com","controllerKind":"MariaDB"}
{"level":"info","ts":1717776229.3167892,"msg":"Starting workers","controller":"grant","controllerGroup":"k8s.mariadb.com","controllerKind":"Grant","worker count":1}
{"level":"info","ts":1717776229.3189883,"msg":"Starting workers","controller":"user","controllerGroup":"k8s.mariadb.com","controllerKind":"User","worker count":1}
{"level":"info","ts":1717776229.319068,"msg":"Starting workers","controller":"restore","controllerGroup":"k8s.mariadb.com","controllerKind":"Restore","worker count":1}
{"level":"info","ts":1717776229.3213458,"msg":"Starting workers","controller":"statefulset","controllerGroup":"apps","controllerKind":"StatefulSet","worker count":1}
{"level":"info","ts":1717776229.3213801,"msg":"Starting workers","controller":"database","controllerGroup":"k8s.mariadb.com","controllerKind":"Database","worker count":1}
{"level":"info","ts":1717776229.32357,"msg":"Starting workers","controller":"backup","controllerGroup":"k8s.mariadb.com","controllerKind":"Backup","worker count":1}
{"level":"info","ts":1717776229.3269382,"msg":"Starting workers","controller":"pod","controllerGroup":"","controllerKind":"Pod","worker count":1}
{"level":"info","ts":1717776229.326942,"msg":"Starting workers","controller":"sqljob","controllerGroup":"k8s.mariadb.com","controllerKind":"SqlJob","worker count":1}
{"level":"info","ts":1717776229.3270452,"msg":"Starting workers","controller":"connection","controllerGroup":"k8s.mariadb.com","controllerKind":"Connection","worker count":1}
{"level":"info","ts":1717776229.3270624,"msg":"Starting workers","controller":"maxscale","controllerGroup":"k8s.mariadb.com","controllerKind":"MaxScale","worker count":1}
{"level":"info","ts":1717776229.3270729,"msg":"Starting workers","controller":"pod","controllerGroup":"","controllerKind":"Pod","worker count":1}
{"level":"info","ts":1717776229.327095,"msg":"Starting workers","controller":"mariadb","controllerGroup":"k8s.mariadb.com","controllerKind":"MariaDB","worker count":1}

Logs for `mariadb-operator-webhook`

❯ kubectl logs --since=1h pod/mariadb-operator-webhook-7b78b4857b-ws682
{"level":"info","ts":1717776229.0652354,"logger":"setup","msg":"Validating certs"}
{"level":"info","ts":1717776229.0657084,"logger":"controller-runtime.builder","msg":"Registering a mutating webhook","GVK":"k8s.mariadb.com/v1alpha1, Kind=MariaDB","path":"/mutate-k8s-mariadb-com-v1alpha1-mariadb"}
{"level":"info","ts":1717776229.0657833,"logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/mutate-k8s-mariadb-com-v1alpha1-mariadb"}
{"level":"info","ts":1717776229.0658076,"logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"k8s.mariadb.com/v1alpha1, Kind=MariaDB","path":"/validate-k8s-mariadb-com-v1alpha1-mariadb"}
{"level":"info","ts":1717776229.0658407,"logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-k8s-mariadb-com-v1alpha1-mariadb"}
{"level":"info","ts":1717776229.0658653,"logger":"controller-runtime.builder","msg":"skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called","GVK":"k8s.mariadb.com/v1alpha1, Kind=MaxScale"}
{"level":"info","ts":1717776229.065888,"logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"k8s.mariadb.com/v1alpha1, Kind=MaxScale","path":"/validate-k8s-mariadb-com-v1alpha1-maxscale"}
{"level":"info","ts":1717776229.0659168,"logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-k8s-mariadb-com-v1alpha1-maxscale"}
{"level":"info","ts":1717776229.065937,"logger":"controller-runtime.builder","msg":"skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called","GVK":"k8s.mariadb.com/v1alpha1, Kind=Backup"}
{"level":"info","ts":1717776229.065952,"logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"k8s.mariadb.com/v1alpha1, Kind=Backup","path":"/validate-k8s-mariadb-com-v1alpha1-backup"}
{"level":"info","ts":1717776229.065971,"logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-k8s-mariadb-com-v1alpha1-backup"}
{"level":"info","ts":1717776229.0659883,"logger":"controller-runtime.builder","msg":"skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called","GVK":"k8s.mariadb.com/v1alpha1, Kind=Restore"}
{"level":"info","ts":1717776229.0660045,"logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"k8s.mariadb.com/v1alpha1, Kind=Restore","path":"/validate-k8s-mariadb-com-v1alpha1-restore"}
{"level":"info","ts":1717776229.066028,"logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-k8s-mariadb-com-v1alpha1-restore"}
{"level":"info","ts":1717776229.066049,"logger":"controller-runtime.builder","msg":"skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called","GVK":"k8s.mariadb.com/v1alpha1, Kind=User"}
{"level":"info","ts":1717776229.066063,"logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"k8s.mariadb.com/v1alpha1, Kind=User","path":"/validate-k8s-mariadb-com-v1alpha1-user"}
{"level":"info","ts":1717776229.066086,"logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-k8s-mariadb-com-v1alpha1-user"}
{"level":"info","ts":1717776229.0661066,"logger":"controller-runtime.builder","msg":"skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called","GVK":"k8s.mariadb.com/v1alpha1, Kind=Grant"}
{"level":"info","ts":1717776229.066123,"logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"k8s.mariadb.com/v1alpha1, Kind=Grant","path":"/validate-k8s-mariadb-com-v1alpha1-grant"}
{"level":"info","ts":1717776229.066146,"logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-k8s-mariadb-com-v1alpha1-grant"}
{"level":"info","ts":1717776229.0661612,"logger":"controller-runtime.builder","msg":"skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called","GVK":"k8s.mariadb.com/v1alpha1, Kind=Database"}
{"level":"info","ts":1717776229.0661783,"logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"k8s.mariadb.com/v1alpha1, Kind=Database","path":"/validate-k8s-mariadb-com-v1alpha1-database"}
{"level":"info","ts":1717776229.0661995,"logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-k8s-mariadb-com-v1alpha1-database"}
{"level":"info","ts":1717776229.0662193,"logger":"controller-runtime.builder","msg":"skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called","GVK":"k8s.mariadb.com/v1alpha1, Kind=Connection"}
{"level":"info","ts":1717776229.066234,"logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"k8s.mariadb.com/v1alpha1, Kind=Connection","path":"/validate-k8s-mariadb-com-v1alpha1-connection"}
{"level":"info","ts":1717776229.0662596,"logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-k8s-mariadb-com-v1alpha1-connection"}
{"level":"info","ts":1717776229.0662768,"logger":"controller-runtime.builder","msg":"skip registering a mutating webhook, object does not implement admission.Defaulter or WithDefaulter wasn't called","GVK":"k8s.mariadb.com/v1alpha1, Kind=SqlJob"}
{"level":"info","ts":1717776229.066291,"logger":"controller-runtime.builder","msg":"Registering a validating webhook","GVK":"k8s.mariadb.com/v1alpha1, Kind=SqlJob","path":"/validate-k8s-mariadb-com-v1alpha1-sqljob"}
{"level":"info","ts":1717776229.066324,"logger":"controller-runtime.webhook","msg":"Registering webhook","path":"/validate-k8s-mariadb-com-v1alpha1-sqljob"}
{"level":"info","ts":1717776229.0663393,"logger":"setup","msg":"Starting manager"}
{"level":"info","ts":1717776229.066548,"logger":"controller-runtime.metrics","msg":"Starting metrics server"}
{"level":"info","ts":1717776229.066599,"msg":"starting server","kind":"health probe","addr":"[::]:8081"}
{"level":"info","ts":1717776229.0666537,"logger":"controller-runtime.webhook","msg":"Starting webhook server"}
{"level":"info","ts":1717776229.066671,"logger":"controller-runtime.metrics","msg":"Serving metrics server","bindAddress":":8080","secure":false}
{"level":"info","ts":1717776229.0670788,"logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate"}
{"level":"info","ts":1717776229.0671113,"logger":"controller-runtime.webhook","msg":"Serving webhook server","host":"","port":9443}
{"level":"info","ts":1717776229.0671806,"logger":"controller-runtime.certwatcher","msg":"Starting certificate watcher"}

Expected behaviour
Either the worker pods are deployed or there is an error message indicating why they could not be deployed.

Environment details:

Kubernetes version: 1.28.8
Kubernetes distribution: Vanilla
mariadb-operator version: 0.29.0
Install method: helm
Install flavor: minimal with --set webhook.cert.certManager.enabled=true and --set logLevel=debug.

Documentation

I acknowledge that I have read the relevant documentation.

Answer 1 · 2024-06-13T21:37:20.000Z

Issue was with using old API version from before the 0.0.26 release, updating the API prevents the mysterious stalls.

It would be helpful if the operator throws error messages instead of giving no indication of what went wrong.