Closed this issue 2 months ago · 1 comments
hi arthors,
can you open source the pipeline code on pretraining?
appreciate it.!
Hi,
Thanks for your comment. You should find every piece of code necessary in this repo for pretraining (main_pretraining.py) and finetuning (main_linear.py)