huggingface/tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
RustApache-2.0
Stargazers
- ajbouh
- alexandonianMIT CSAIL
- alexwenAustin, TX
- aniruddhakalDublin, Ireland
- assimelhaGothenburg, Sweden
- benjismithPortland, OR
- BogdanDidenkoWebSpellChecker
- ck37Harvard Medical School, Mass General Hospital
- datawaslost@SpokenAAC
- dginev@KWARC
- djurkisPrague
- elonmuskceo
- epwalshCentral Oregon
- harrisonpim@climatepolicyradar
- julien-c@huggingface
- kernelmachineSeattle, WA
- LysandreJikHugging Face
- mapmeld@determined-ai
- mfuntowicz@huggingface
- miweru
- monologg@bhsn-ai
- myleottNew York, NY
- n1t0@huggingface
- nadesaiNew York City
- phtullyFireEye
- Pierrci@huggingface
- schrepflerHuddle Gaming Inc.
- sharavsambuuMurun, Khuvsgul, Mongolia
- shoaroraMercari
- spate141Chicago
- stefan-itNear Munich, Germany
- thinline72@lucidworks
- thomwolf@huggingface
- tokestermwCresta
- tscholak@ServiceNow
- VictorSanh@huggingface