/alphabetical_probe

Experimental code which trains 26 linear probes to detect the presence of alphabetic letters in GPT-J token strings, given their embeddings. Exploring the resulting vector arithmetic and its impact on GPT-J spelling abilities

Primary LanguageJupyter Notebook

No issues in this repository yet.