MineDojo/Voyager

Implement a way test local models

bennmann opened this issue · 6 comments

bennmann commented

Hello,

Wonderful work on Voyager.

Please consider added local model support (instead of openai package - using something like Python requests package to a localhost local model using openai completion elements).

I believe Voyager is a superb way to measure future Large Language models against one another using the Minecraft diamond challenge.

Please consider a collaboration with Eleuther AI on locally hosted LLM evaluation via Voyager

https://github.com/EleutherAI/lm-evaluation-harness

github-actions commented

This issue is stale because it has been open for 30 days with no activity.

bennmann commented

Please reconsider this issue in light of Llama 3 8B and 70B.

  • 👍1
github-actions commented

This issue is stale because it has been open for 30 days with no activity.

Khaogamermain01 commented

Any updates on this?

github-actions commented

This issue is stale because it has been open for 30 days with no activity.

github-actions commented

This issue was closed because it has been inactive for 14 days since being marked as stale.