Could you please provide the training log?
Closed this issue · 4 comments
felixfuu commented
Could you please provide the training log?
zwcolin commented
felixfuu commented
felixfuu commented
zwcolin commented
Loss Log _ TokenCompose – Weights & Biases.pdf
Due to administrative settings it seems that there are some glitches in viewing the log. I attached the downloaded report from the report page with all the curves (note that I set an EMA smoothing with a factor of 0.5 for better illustration purposes).