This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.
Primary LanguagePython