patil-suraj/question_generation

Unable to train ProphetNet

anmol4210 opened this issue · 0 comments

Hi,
I'm trying to train e2e QG using microsoft prophetnet. I have changed tokenizer and model. My training runs fine for fist 22 steps but then all of a sudden it stops giving the error 'RuntimeError: CUDA error: device-side assert triggered'

model = ProphetNetForConditionalGeneration.from_pretrained('microsoft/prophetnet-large-uncased-squad-qg')
tokenizer = ProphetNetTokenizer.from_pretrained('microsoft/prophetnet-large-uncased-squad-qg')

Can anyone please help me where else do I have to make changes.
Anyone help would be helpful
Thanks in advance