nicoboou/chadavit

training code

Closed this issue · 1 comments

shunliu01 commented

hi arthors,

can you open source the pipeline code on pretraining?

appreciate it.!

nicoboou commented

Hi,

Thanks for your comment. You should find every piece of code necessary in this repo for pretraining (main_pretraining.py) and finetuning (main_linear.py)