occiglot/curated-web-data

A collection of "good and bad" Web domains for LLM pretraining data

Apache-2.0