token-stream
There are 4 repositories under token-stream topic.
begin/parsers-compilers
Lexers, tokenizers, parsers, compilers, renderers, stringifiers... What's the difference, and how do they work?
vberlier/tokenstream
A versatile token stream for handwritten parsers.
kristofferv98/openai-voicestream
OpenAI VoiceStream: Real-time text-to-speech library for processing text and token streams using the OpenAI API. Supports multiple voices and thread-safe audio generation.