AlignmentResearch/tuned-lens
Tools for understanding how transformer predictions are built layer-by-layer
PythonMIT
Issues
- 0
Reproducing table 1 in the paper
#132 opened by Nicole-Nobili - 0
Drop python 3.9 support
#131 opened by levmckinney - 0
Fix silent failure when training runs out of data
#113 opened by levmckinney - 1
- 0
- 2
- 2
- 0
tuned lens for llama
#122 opened by chuckhope - 0
- 0
Better errors when artifact loading fails
#37 opened by levmckinney - 0
Add documentation on uploading lenses
#114 opened by levmckinney - 3
Improve logging during training
#86 opened by levmckinney - 2
Training downloads the entire pile
#20 opened by levmckinney - 1
Support TransformerLens
#61 opened by UlisseMini - 3
Support showing logit/tuned lens predictions in the middle of layers (e.g. after attention/before MLP)
#104 opened by williamrs-openai - 1
Remove extraneous options from Eval Script
#90 opened by levmckinney - 2
Check pointing and resuming from checkpoints
#79 opened by levmckinney - 1
Unembeding hashes are broken
#89 opened by levmckinney - 0
Checkpointing crashes with ZeRO optimizer
#96 opened by norabelrose - 0
Add flag to specify dtype
#93 opened by levmckinney - 0
- 1
Support RMSNorm
#70 opened by levmckinney - 0
Fix the notebooks
#50 opened by levmckinney - 0
Remove spearmanr
#62 opened by levmckinney - 1
- 2
Clean up the training code
#66 opened by levmckinney - 0
Refactor Argument Parsers
#41 opened by levmckinney - 0
Fix tokenization freeze
#60 opened by levmckinney - 0
Code coverage reports are not working
#68 opened by levmckinney - 1
- 1
Lenses should use the Decoder class
#42 opened by levmckinney - 0
Something upstream appears to have broken the get_transformer_layers function.
#57 opened by levmckinney - 0
- 2
Prediction depth
#72 opened by levmckinney - 0
- 1
- 1
Upgrade to support torch 2.0
#14 opened by levmckinney - 1
- 1
Problems running the notebook on GPU
#53 opened by svenschultze - 4
What's 'white_box'?
#49 opened by dbl001 - 1
Make lenses available on hugging face
#17 opened by levmckinney - 0
Remove the ProbeDict class
#9 opened by levmckinney - 2
Can not pull the docker image, is it public?
#39 opened by xszheng2020 - 2
- 0
- 0
Create simple way to play with trained lenses
#18 opened by levmckinney - 0
Make it easier to download pretrained lenses
#28 opened by levmckinney - 1
Setup PyPI release CI
#6 opened by levmckinney - 1
Resolve failing CI tests on main
#11 opened by levmckinney - 1
Create Dockerfile
#7 opened by levmckinney