how do I train gpt-2 using multiple encoding files?

Question

how do I train gpt-2 using multiple encoding files?

ca3games opened this issue 4 years ago · 1 comments

Hi, I just got gpt-2 working under google collab.

I have two questions:
How much epochs do I need to let it run?
How do I train gpt-2 using multiple encoding files?

Many thanks.

Answer 1 · 2020-12-02T23:53:15.000Z

Those are much more complex than what you'll find on google. The only way to do what you are asking is to hire a data scientist, will run you about $75,000 on average. No less than $65,000.00 USD.