edirgarcia/bpe_sharp

An implementation of a Byte-Pair Encoding tokenizer in C#

C#MIT