solo-io/skv2

Bring parity between `make run-tests` and CI commands

Opened this issue · 0 comments

nikolasmatt commented

Problem

Tests pass in CI but fail using the make run-tests command locally.

CI uses the REMOTE_CLUSTER_CONTEXT=kind-skv2-test-remote PATH="$(pwd)/_output/.bin:$PATH" go test ./... to run tests and all the tests pass, but make run-tests uses a ginkgo command and different tests fail every time.

This is likely because make run-tests randomizes the test execution order and the CI command doesn't.

Desired Outcomes

  • Update the command that CI and/or make use to be the same and include execution order randomization.
  • Make sure make run-tests succeeds when run locally