Gumbel Sample
pranoyr opened this issue · 4 comments
pranoyr commented
Since top_k threshold is 0.9 , gumbel sample will always take the indice with max probability, right? I guess temperature has no effect here?
So , the sampling here is argmax only?
lucidrains commented
@pranoyr a gumbel noise is added
pranoyr commented
Got it . I did something wrong!
lucidrains commented
it is my bad, as typically one sets the k value. I'll correct this soon, that function has bad naming
pranoyr commented
Thank you for your reply 👍.