recommended conf
raingart opened this issue · 1 comments
raingart commented
recommended conf
Muennighoff commented
For temp, top_k, top_p, I'd just try a bit and use what works best; no recommended setting but don't expect it to be very different from other LMs.
I don't quite follow your example - if you clearly paste the prompt and model response I can take a look