OpenLMLab/ParallelTokenizer
Use the tokenizer in parallel to achieve superior acceleration
PythonApache-2.0
Stargazers
- 00INDEXShanghai AI Laboratory
- gaoyang07Shanghai AI Lab
- jojuo123
- KYLN24Fudan University
- lxr-tech
- NLPJCLSUDA-LA
- Spico197Soochow University
- VPeterVThe Hong Kong University of Science and Technology (HKUST)
- xiami2019Fudan University&Sun Yat-Sen University
- yhccFudan NLP
- YWMditto
- yzhangcsSoochow University
- zigzagcai@Intel