zouharvi/tokenization-scorer
Simple-to-use scoring function for arbitrarily tokenized texts.
PythonMIT
Issues
- 1
seq_len gives generator has no len error
#5 opened by AnnaWegmann - 1
Memory efficiency
#3 opened by zouharvi
Simple-to-use scoring function for arbitrarily tokenized texts.
PythonMIT