tmalsburg/llm_surprisal
Simple tool for generating tokens with open source transformers and/or calculate per-token surprisal.
Python
Issues
- 0
Include some n-gram models (as baseline)?
#6 opened by tmalsburg - 0
Support larger XGLM and Bloom models
#5 opened by tmalsburg - 1
- 1
- 1
- 0
Include first token's surprisal
#1 opened by tmalsburg