vicgalle/gpt-j-api

Logprobs?

leonhuene opened this issue · 2 comments

Is it possible to retrieve logprobs?

Is it possible to retrieve logprobs?

Hi, @leonhuene , it is planned on my roadmap. However, in the next few days I go on holiday so maybe this is going to take a while

No worries! Super grateful you made this, thank you so much.