Induction heads
Primary LanguagePython
Causal scrubbing experiments on induction heads in various transformers.