Phylliida/mamba_interp

Various stuff in progress for mamba interpretability

mamba_interp

Various stuff in progress for mamba interpretability.

This is my "dev" repo where I dump experiments as I do them, if you're looking for Mamba interp related tools I'd recommend looking at my MambaLens library.

Credit:

• First names dataset
• Mamba minimal
• Mamba
• Transformer Lens