/ParallelTokenizer

Use the tokenizer in parallel to achieve superior acceleration

Primary LanguagePythonApache License 2.0Apache-2.0

ParallelTokenizer

Use the tokenizer in parallel to achieve superior acceleration