ETA on pytorch training code?

Question

ETA on pytorch training code?

NtaylorOX opened this issue 3 years ago · 4 comments

Hope it is okay to add this as an issue - this is amazing work and would love to see the training implementation in pytorch. I see it is in the works, and wondered if this is still the case and whether an ETA is on the horizon?

Answer 1 · 2022-01-10T16:06:58.000Z

Hello @NtaylorOX
Thanks for your interest!
As far as I know, no one (including me) has this item on their high-priority todo so it's hard to share with you a hard ETA. A loose (and more reasonable) horizon would be a few weeks.
In the meantime, you should feel free to either:

use the tf implementation
adapt the single task fine-tuning codebase (there some non trivial work involved) and contributed a PR!

Answer 2 · 2022-07-11T17:16:00.000Z

Hi @VictorSanh , I was wondering if there is any plan to publish the pytorch training code.

Answer 3 · 2022-07-12T07:52:57.000Z

thanks @ari9dam for the ping! Priorities changed a (big) bit since last time, and at the moment, there is no plan of officially extending the T0 replication codebase to PyTorch unfortunately.