ax-llm/ax

Can't run examples with ollama or gemini

Closed this issue · 2 comments

sanguino commented

  • I'm submitting a ...
    [X] bug report
    [ ] feature request
    [ ] question about the decisions made in the repository
    [ ] question about how to use this project

  • Summary

I was unable to successfully execute any examples using gemini or ollama. I tried changing the ollama path as suggested in another issue, but in both cases, I encountered the same issue. For example, when running the agents or chain of thought examples, I frequently see this message:
User: Instructions: Output must include: Reason:, Answer:
But eventually, it ends with the following error:

throw new Error(`Unable to fix validation error: ${err?.message}`);
      ^

Error: Unable to fix validation error: Output must include: `Reason:`, `Answer:`
  • Other information (e.g. detailed explanation, stack traces, related issues, suggestions how to fix, links for us to have context, eg. StackOverflow, personal fork, etc.)

This issue occurs consistently with the provided examples. I attempted to follow solutions mentioned in related issues but was unable to resolve the problem. Additional context or suggestions to fix this would be greatly appreciated.

dosco commented
  • ollama, gemini, issues fixed.
  • validation type issue fixed
  • User: Instructions: Output must include: Reason:, Answer: error fixed
sanguino commented

Great!

I just tried three examples with Ollama, and they worked perfectly.

Thank you!