symflower/eval-dev-quality

Test for pulling Ollama model is flaky

Opened this issue · 2 comments

Not sure if directly related but when I try to run make test localy on our main branch the following test fails: cmd/eval-dev-quality/cmd TestEvaluateExecute/Model_filter/Ollama/Pulled_Model

Local version of ollama is 0.1.34 will update and try again

Running make install-all did solve the problem for me locally. Will take a look at this Bug.