token-counter

There are 2 repositories under token-counter topic.

johannschopplich/tokenx
📐 GPT token estimation and context size utilities without a full tokenizer
Language:TypeScript19 1 01
flexchar/tiktoken-counter
Tiktoken-counter as standalone API
Language:Python2 1 01