Aaron-LHR/Scaffold-BPE

Scaffold-BPE: Enhancing Byte Pair Encoding with Simple and Effective Scaffold Token Removal