/tokenizer-adapter

A simple tool for adapting a pretrained Huggingface model to a new vocabulary with (almost) no training.

Primary LanguagePythonApache License 2.0Apache-2.0

Stargazers