cardano-foundation/cardano-wallet

Flaky test: Compare Wallet impl. with Specification

jonathanknowles opened this issue · 2 comments

jonathanknowles commented

Please ensure:

  • This is actually a flaky test already present in the code and not caused by your PR.

Context

https://hydra.iohk.io/build/13887987/nixlog/1/tail

Seen on CI for:
#3247

Relevant team discussions

https://element.adrestia.iohkdev.io/#/room/!pVmOFJiBkItJMNTmCR:adrestia.iohkdev.io/$-unJ0isT24cCiJETY75z3G2eWQYSDYEiGXxZb-eRWao?via=adrestia.iohkdev.io

Job name

https://hydra.iohk.io/build/13887987/nixlog/1/tail

Test case name(s)

Compare Wallet impl. with Specification

Error message

Failures:

  test/unit/Cardano/Wallet/Primitive/ModelSpec.hs:201:9: 
  1) Cardano.Wallet.Primitive.Model, Compare Wallet impl. with Specification, Lemma 3.2 - dom u ⋪ updateUTxO b u = new b
       Insufficient coverage (after 6400 tests):
         71.00% utxo ≠ ∅ 
         
         Only 71.00% utxo ≠ ∅ , but expected 75.00%

  To rerun use: --match "/Cardano.Wallet.Primitive.Model/Compare Wallet impl. with Specification/Lemma 3.2 - dom u \8938 updateUTxO b u = new b/"

Randomized with seed 1367156704

Build link

https://hydra.iohk.io/build/13887987

Anviking commented

Link has expired, but I presume this is fixed, or it hasn't been seen again for a while at least