/WordPieceTokenizer

WordPiece tokenizer for dotnet (eg with ML.Net)

Primary LanguageC#MIT LicenseMIT

Stargazers