investigate fairy-stockfish playing strength

Question

investigate fairy-stockfish playing strength

niklasf opened this issue 3 years ago · 2 comments

https://lichess.org/forum/lichess-feedback/suspiciously-weak-play-of-lichess-engine-level-5
https://lichess.org/forum/lichess-feedback/did-stock-fish-just-get-harder#10

Answer 1 · 2021-09-16T13:09:11.000Z

There are at least 3 factors that can play a role here:

Currently fishnet uses Fairy-SF without NNUE. This costs at least 250 Elo if I remember correctly.
Fairy-SF is considerably slower than official SF, which makes it ~150 Elo weaker. With NNUE the speed difference is lower compared to classical evaluation.
The switch back from UCI_Elo to Skill Level likely resulted in slighly different difficulty settings, but I have not checked.

Answer 2 · 2021-09-27T13:02:24.000Z

Thanks. fishnet not using Fairy-Stockfish to its full potential is not new, so I just wanted to make sure there isn't any unintentional regression between fishnet versions. But I did not find any major difference compared to fishnet v2.3.0.