WordPiece tokenizer for dotnet (eg with ML.Net)
Primary LanguageC#MIT LicenseMIT
WordPieceTokenizer for dotnet