/tiktoken-php

a clone of python tiktoken but for PHP! fast BPE tokeniser for use with OpenAI's models.

Primary LanguagePHPMIT LicenseMIT

Watchers

No one’s watching this repository yet.