adamyedidia/anthropic-tokenizer
Approximation of the Claude 3 tokenizer by inspecting generation stream
Python
No issues in this repository yet.
Approximation of the Claude 3 tokenizer by inspecting generation stream
Python
No issues in this repository yet.