DanGuge's Stars
alibaba/ChatLearn
OpenRLHF/OpenRLHF
An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral)
sgl-project/sglang
SGLang is a fast serving framework for large language models and vision language models.
NVIDIA/apex
A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
unslothai/unsloth
Finetune Llama 3.1, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory
AnswerDotAI/fsdp_qlora
Training LLMs with QLoRA + FSDP
ModelTC/lightllm
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
mosaicml/llm-foundry
LLM training code for Databricks foundation models
zhuzilin/ring-flash-attention
Ring attention implementation with flash attention
RulinShao/LightSeq
Official repository for LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers
cuda-mode/resource-stream
CUDA related news and material links
karpathy/nn-zero-to-hero
Neural Networks: Zero to Hero
liguodongiot/llm-action
本项目旨在分享大模型相关技术原理以及实战经验。
lucidrains/denoising-diffusion-pytorch
Implementation of Denoising Diffusion Probabilistic Model in Pytorch
cuda-mode/lectures
Material for cuda-mode lectures
karpathy/LLM101n
LLM101n: Let's build a Storyteller
karpathy/nanoGPT
The simplest, fastest repository for training/finetuning medium-sized GPTs.
THUDM/GLM-4
GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型
state-spaces/mamba
Mamba SSM architecture
BradyFU/Awesome-Multimodal-Large-Language-Models
:sparkles::sparkles:Latest Advances on Multimodal Large Language Models
boyu-ai/Hands-on-RL
https://hrl.boyuai.com/
haotian-liu/LLaVA
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
karpathy/micrograd
A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API
srush/Triton-Puzzles
Puzzles for learning Triton
hehonghui/awesome-english-ebooks
经济学人(含音频)、纽约客、卫报、连线、大西洋月刊等英语杂志免费下载,支持epub、mobi、pdf格式, 每周更新
huggingface/peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
karpathy/llm.c
LLM training in simple, raw C/CUDA
triton-lang/triton
Development repository for the Triton language and compiler
openai/whisper
Robust Speech Recognition via Large-Scale Weak Supervision
comfyanonymous/ComfyUI
The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.