Downloadable Training Data

Question

Downloadable Training Data

djl11 opened this issue 4 years ago · 4 comments

It would be very useful to have the training data returned from generate_data_parallel.py script available to download, for both the pile and packed cases.

I appreciate this may be a large amount of memory, and therefore difficult to host, so there is no expectation of course!
But it would avoid people needing to run the costly data generation process locally in order to experiment with the training.

Answer 1 · 2021-04-13T11:58:19.000Z

Hi, I upload the link of data we generated here. Hopefully it would be helpful.

Answer 2 · 2021-04-13T13:18:26.000Z

Great, thanks a lot!

Answer 3 · 2021-04-22T13:45:57.000Z

Hey, quick heads up. The links in the table for the README are mis-matched. The pile links leads to packed data, and vice versa. Also a small type for the word "this" beforehand. Both should be easy to fix! :)

Answer 4 · 2021-04-23T12:25:58.000Z

Thank you for reminding me!