/litdata

Streamline data pipelines for AI. Process datasets across 1000s of machines, and optimize data for blazing fast model training.

Primary LanguagePythonApache License 2.0Apache-2.0

Watchers