zphang/minimal-gpt-neox-20b

Output is the same as input

huey2531 opened this issue · 2 comments

huey2531 commented

Ran the model to generate some text using the example you provided
However the output is exact the same as my input and is repeated 10 times

Evaluation seems to work fine

StellaAthena commented

That happens sometimes. Have you tried entering varying input strings? What about ones that come from the evaluation dataset you’re using?

huey2531 commented

you're right. minimal-gpt-neox seems to repeat itself quite often.
it's fully working now