Improve Performance Test "Slow" Checker
jdn5126 opened this issue · 1 comments
jdn5126 commented
What would you like to be added:
The VPC CNI performance integration test has a slow performance checker here: https://github.com/aws/amazon-vpc-cni-k8s/blob/master/scripts/lib/performance_tests.sh#L32
The check fails whenever the current run latency differs by more than 25% from previous runs. This can lead to failures for fast runs, as the variance is high. We need to add a better checker here.
Why is this needed:
To improve test stability.
github-actions commented
⚠️ COMMENT VISIBILITY WARNING⚠️
Comments on closed issues are hard for our team to see.
If you need more assistance, please open a new issue that references this one.
If you wish to keep having a conversation with other community members under this issue feel free to do so.