AdrianBZG/LLM-distributed-finetune
Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the training on multiple AWS GPU instances
PythonMIT
Issues
- 0
Fine-tune Falcon-40B with QLoRA
#1 opened by colorzhang