dhlee347/pytorchic-bert

any sample dataset for pre-training?

Closed this issue · 1 comments

any sample dataset for pre-training?

You have to make your own dataset (for example, using web crawling) (Toronto Book Corpus is not served online any longer)