kudobuilder/kuttl

[Bug?] kuttl is not validating the TestStep file

chipzoller opened this issue · 0 comments

What happened:

Kuttl does not validate the structure and contents of a TestStep file which allows invalid fields to be specified. This is especially a problem when a user misspells a field. For example, a user may accidentally type errors (plural) rather than error which results in kuttl saying nothing about the mistake. This can lead to false assumptions and wasted time troubleshooting test case development.

What you expected to happen:

I expect kuttl to throw an error if a user specifies invalid fields in a TestStep (or any) file.

How to reproduce it (as minimally and precisely as possible):

Create this file as 01-apply.yaml

apiVersion: kuttl.dev/v1beta1
kind: TestStep
foo:
- foo.yaml
apply:
- cpol.yaml

Note that foo[] is not valid per the struct of the TestStep object, yet kuttl proceeds with using it anyway.

Anything else we need to know?:

Environment:

  • Kubernetes version (use kubectl version):
  • KUTTL version (use kubectl kuttl version): 0.14
  • Cloud provider or hardware configuration:
  • OS (e.g. from /etc/os-release):
  • Kernel (e.g. uname -a):
  • Install tools:
  • Others: