hdotking/distributed_learning

Some techniques for training ml model with distributed elements.

Distributed Training Techniques

See NER_MultiGPU_QLoRa.ipynb to see how to train LLM quantised adapters on multiple GPUs to adapt it to the AI domain.