Missing python dependencies for running pretrain tutorial
morphpiece opened this issue · 1 comments
morphpiece commented
While running the pretraining tutorial, I was asked to install following pythong dependencies. Probably they will be needed for any pretraining job, so it might be useful to point it out in the tutorial.
- tensorboard
- tokenizers
- requests
- huggingface_hub
- litdata