certik/fastGPT

Show the words as they are computed

certik opened this issue · 0 comments

The decoding is done across tokens, but we can wait until there is a space or punctuation, and print it.