pecanjk/transformers-stream-generator
This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.
PythonMIT
Watchers
No one’s watching this repository yet.
This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.
PythonMIT
No one’s watching this repository yet.