Port of 'rust-tokenizer' to C#/.NET
vermorel opened this issue · 0 comments
vermorel commented
Hello! Thanks for publishing rust-tokenizers in the first place! FYI, we have reached our first milestone in porting rust-tokenizers to C#/.NET at https://github.com/Lokad/Tokenizers/ This lib is published under an MIT-style license. This may be of interest to this community. Feel free to close this issue.