huggingface/tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
RustApache-2.0
Watchers
- aladdinwangShanghai, China
- bloodbare@nuclia
- bradjonescaNew York
- Btibert3PlatformQ
- cluo
- data-man@contour-terminal
- dcavarIndiana University
- EmilyWitko
- ericxsun@cins-china
- fzhang612
- honoodBeijing, China
- hyperdrivenope
- ibrahimishagEnsol Biosciences Inc
- jhcloos
- julien-c@huggingface
- krampstudio@huggingface
- kuccelloCredit Karma
- lelayfSpark Space
- liuzl<-Baidu/Tencent/MSRA
- mbofb
- mfuntowicz@huggingface
- michalwolsNew York
- MistShiBei Jing
- MKhalusovaUnstructured.io
- n1t0@huggingface
- Narsil@huggingface
- nicexw
- okumura
- rain1024@undertheseanlp
- siddkStanford
- splade
- take-cheezeAzumino, Japan
- tempbottleSingapore
- yangjihengBeidouclass EduTech Inc.
- ydshiehParis
- zebrajackpungke