Lightning-Universe/lightning-transformers

Shuffle support

mahnerak opened this issue 2 years ago · 2 comments

mahnerak commented 2 years ago

After looking the codebase I've discovered there's no shuffling while training.
Is there any reason for it?

https://github.com/Lightning-AI/lightning-transformers/blob/f439c954fd085499ddde4ed27f927ba70d079595/lightning_transformers/core/data.py#L174-L181

Borda commented 2 years ago

@SeanNaren, mind checking this out? 🦦

Borda commented 2 years ago

closing in favor of #298