Benchmark the PRs that have been merged since we forked

Question

Benchmark the PRs that have been merged since we forked

Closed this issue 5 years ago · 3 comments

I made #208 for introducing automated testing, however that might be too much work to get done for the next release. This issue is to track manually running benchmarks for PRs that have been merged since we forked. We're close to releasing the next RC release, and this is one of the last things to do!

PRs to benchmark:

#17 (added benchmarks in #211; no change in performance)
#194 (reported below)
#195 (covered by Record builds from an object; no change in performance)
#206 (reported below)

Going forward, I would like to do the performance testing before a PR is merged, whether that is automatic or we have to do it manually.

Answer 1 · 2020-12-14T00:39:43.000Z

Regression due to #210 (see benchmark code in #211):

Answer 2 · 2020-12-14T00:40:22.000Z

Regression due to #206 (see benchmark code in #211):

Answer 3 · 2020-12-14T13:29:21.000Z

I've made separate issues for each performance regression.