tcapelle/llm_recipes

note to self: add gen_kwargs

Opened this issue · 0 comments

phoebusai commented

See: https://github.com/EleutherAI/lm-evaluation-harness/blob/7411947112117e0339fe207fb620a70bcec22690/lm_eval/__main__.py#L129-L136

add ability to modify temperature, top_k, top_p, and most relevant = repetition_penalty 🫠

llm_recipes/eval_harness/run.py

Line 21 in cf5b38b