Input your own gen_top_p, gen_top_k parameters
YukiSakuma opened this issue · 2 comments
YukiSakuma commented
In the replicate demo you are already able to manually input the seed but I would like also to be able to input your own gen_top_p, gen_top_k parameters. For example for the same seed and prompt I want to be able to try different gen_top_p, gen_top_k values and compare the results.
kuprel commented
Yeah that makes sense. Right now it's arbitrarily set at k=50. Do you have any intuition on what varying k would do?
kuprel commented
You can now input your own top_k value