Other models
Opened this issue · 1 comments
Mugariya commented
Hello,
Can we use models other than Vicuna and ChatGPT?
l-salewski commented
Hello @Mugariya,
yes, our evaluation code can be used with other models as well!
As a starting point I would recommend looking here for the configurations of the LLMs that we used. Similarly, you will find their implementations here.
Once you implemented the model that you would like to study, you should be able to override the hydra config of the model.llm key.
Best,
Leonard