/tiktoken-php

A PHP implementation of OpenAI's BPE tokenizer tiktoken.

Primary LanguagePHPMIT LicenseMIT

Watchers