allenai/dolma

Progress Bar may use more resources than necessary

soldni opened this issue · 0 comments

soldni commented

from @dirkgr:

When I have a console window open that watches dolma tokens, it literally takes 1.5 cores permanently on my Mac.