[lve-tools] More CLI tooling for model transfer and model evaluation
Opened this issue · 0 comments
mbalunovic commented
We should expand upon the tooling we already have and add at least:
- Model transfer: A script to transfer existing LVE to another model (including adapting prompt and checker using some default adapters)
- Model evaluation: While LVE Repository's primary purpose is not evaluation, we should have a script which evaluates a model (e.g. some custom model) on a set of LVEs that were not necessarily written for this model