Lightning-AI/lit-llama
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
PythonApache-2.0
Watchers
- a24ibrahUniversity of Waterloo
- adelarsqSpassu
- angadnSpindle AI
- awaelchliLightning AI
- BordaLightning.ai | Grid.ai
- brataoEscavador
- cnkanwei
- damaruBangalore
- danielpclark6ft Dan(TM)
- eaubin
- ishandutta2007India
- lantigaLightning AI
- leeoniya@grafana
- leoxzhaoMasterClass
- levitationSimplify / Macrotec LLC
- likethecognacNYC
- manu-chauhan
- marioluca
- mioliniSentientWave Inc.
- ofirkrisTap
- pineking@Unisound @unisound-ail
- QingsongYaoSalesforce
- QubitiumEarth/Epoch 3
- rasbt@Lightning-AI , University of Wisconsin-Madison
- rentackaJapan
- robertDouglassComplex Earth
- shantanusharmaSharma Labs
- skwaitGrid.ai
- srikanthnadella
- sukuyaRakuten Group Inc.
- tfburlingameGlobal Public Safety
- tiendung
- vgoklaniNew York, NY
- williamFalconLightning AI
- xuzhm
- yz5548Halliburton