tingerrr/typst-test

BUG: flaky CI tests when importing package

Closed this issue · 2 comments

Otto-AA commented

Description

The tests randomly fail in the CI. This does not happen when previously running typst compile (which likely caches the required packages).

Steps to Reproduce the Problem

See: https://github.com/Otto-AA/tt-flaky-mre

Create multiple test cases importing linguify and let them run in github actions (I did not yet test it with other packages, but I guess it is the same. Could also be related to the use of WASM by linguify).

#import "@preview/linguify:0.4.1": linguify, set-database

Test

Expected Behavior

Test should not be flaky and should not depend on previously running typst compile.

Actual Behavior

Several errors occur seemingly random, sometimes the tests also pass.

  • error: failed to decompress package (failed to unpack /home/runner/.cache/typst/packages/preview/linguify/0.4.1/typst.toml)
  • error: file not found (searched at /home/runner/.cache/typst/packages/preview/linguify/0.4.1/typst.toml)
  • error: failed to load WebAssembly module (unexpected end-of-file (at offset 0x23be1))

Context

  • Platform: Ubuntu 22.04 (Github actions)
  • Version: ci-semi-stable
tingerrr commented

This is a byproduct of the lack of locking from concurrent package downloads, see #16, this is essentially fixed on main, but the rewrite is unfortunately not fully finished.

As you noted yourself, this can be fixed with caching, i.e. by running typst or by extension typst-test on a single test which depends on all packages required once before running the others:

- run: |
  typst-test run dummy-test
  typst-test run
Otto-AA commented

Thanks, that explains it. I guess I need to improve my issue searching skills ^^

Closing, as it's already fixed on main.