lightning llama
sri9s opened this issue · 1 comments
sri9s commented
Are there lightning data and trainer modules available for llama?
aniketmaurya commented
trainer version is available here - https://github.com/Lightning-AI/lit-gpt/blob/main/pretrain/openwebtext_trainer.py