[Bug?] kuttl is not validating the TestStep file
chipzoller opened this issue · 0 comments
What happened:
Kuttl does not validate the structure and contents of a TestStep file which allows invalid fields to be specified. This is especially a problem when a user misspells a field. For example, a user may accidentally type errors
(plural) rather than error
which results in kuttl saying nothing about the mistake. This can lead to false assumptions and wasted time troubleshooting test case development.
What you expected to happen:
I expect kuttl to throw an error if a user specifies invalid fields in a TestStep (or any) file.
How to reproduce it (as minimally and precisely as possible):
Create this file as 01-apply.yaml
apiVersion: kuttl.dev/v1beta1
kind: TestStep
foo:
- foo.yaml
apply:
- cpol.yaml
Note that foo[]
is not valid per the struct of the TestStep object, yet kuttl proceeds with using it anyway.
Anything else we need to know?:
Environment:
- Kubernetes version (use
kubectl version
): - KUTTL version (use
kubectl kuttl version
): 0.14 - Cloud provider or hardware configuration:
- OS (e.g. from /etc/os-release):
- Kernel (e.g.
uname -a
): - Install tools:
- Others: