kjappelbaum/gptchem

set logit biases for classification

kjappelbaum opened this issue · 1 comments

kjappelbaum commented

put all tokens expect the ones needed for the classes and end of sequence to -100.

perhaps also explore tuning this for imbalanced data