affjljoo3581/GPT2

bidirectional training in GPT2

lytum opened this issue · 1 comments

lytum commented

thanks for the sharing and code. May I ask you if there is method to fine tune the pre-trained GPT2 in bidirectional training or hybrid (uni- and bidirectional training together)? Thanks for any tips.

affjljoo3581 commented

I'm sorry that I couldn't give any tips for that.