Shopify/active_shipping

Run all integration tests... somewhere

Opened this issue · 0 comments

Problem

On any given CI run we skip over 100 tests:
job__1465_1_-_shopify_active_shipping_-_travis_ci

These are tests that need some kind of credential for a third party carrier that we cannot share.

We need to run these tests, and have a way that's low friction for developers to assure the build is green.

Solutions

As @Shopify employees, we at least need a way to run these tests and share our private credentials. Consider something like:

  • EJSON file with credentials in the project.
  • Shared dev config with shipping credentials in the env.
  • A private CircleCI instance with our credentials.
  • Something else?

Doesn't solve the problem for open source contributions really. Though we can support contributors with broken tests. But we need to in some way run these tests more reliably.