Errors when run train_psquare.py

Question

Errors when run train_psquare.py

xhc19930714 opened this issue 3 years ago · 2 comments

xhc19930714 commented 3 years ago

It indicates that token indice is longer than the specified maximum sequence length for GPT(512). Where should I fix this problem? my GPU is 2 rtx3090. Probably large enough to run your model?

Answer 1 · 2021-04-23T02:21:00.000Z

@xhc19930714 Sorry for the late response. The error means that your input sequence should be pruned into 512 tokens (the maximum length which GPT2 can acccept), or you may turn into other models to find a better one.

I suggest pruning your data to aovid too long sequence.

Answer 2 · 2021-05-27T02:21:21.000Z

Closed since there is no more activity.