Automatic retry on CI for flaky tests

[soumya92]

Ideally the setup would be some form of whitelist of tests that are known to be flaky.
test.sh runs individual tests, so it should be able to retry the failing tests many times without adding significantly to the overall test duration.