DanGuge

DanGuge's Stars

• alibaba/ChatLearn

  Language:Python816

• OpenRLHF/OpenRLHF

  An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral)

  Language:Python2k191

• sgl-project/sglang

  SGLang is a fast serving framework for large language models and vision language models.

  Language:Python4.8k320

• NVIDIA/apex

  A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

  Language:Python8.3k1.4k

• unslothai/unsloth

  Finetune Llama 3.1, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

  Language:Python15k1k

• AnswerDotAI/fsdp_qlora

  Training LLMs with QLoRA + FSDP

  Language:Jupyter Notebook1.4k183

• ModelTC/lightllm

  LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

  Language:Python2.3k188

• mosaicml/llm-foundry

  LLM training code for Databricks foundation models

  Language:Python3.9k518

• zhuzilin/ring-flash-attention

  Ring attention implementation with flash attention

  Language:Python50434

• RulinShao/LightSeq

  Official repository for LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers

  Language:Python1808

• cuda-mode/resource-stream

  CUDA related news and material links

  1k65

• karpathy/nn-zero-to-hero

  Neural Networks: Zero to Hero

  Language:Jupyter Notebook11.4k1.4k

• liguodongiot/llm-action

  本项目旨在分享大模型相关技术原理以及实战经验。

  Language:HTML8.8k863

• lucidrains/denoising-diffusion-pytorch

  Implementation of Denoising Diffusion Probabilistic Model in Pytorch

  Language:Python7.8k986

• cuda-mode/lectures

  Material for cuda-mode lectures

  Language:Jupyter Notebook2.3k231

• karpathy/LLM101n

  LLM101n: Let's build a Storyteller

  27.8k1.5k

• karpathy/nanoGPT

  The simplest, fastest repository for training/finetuning medium-sized GPTs.

  Language:Python36k5.6k

• THUDM/GLM-4

  GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型

  Language:Python4.4k339

• state-spaces/mamba

  Mamba SSM architecture

  Language:Python12.4k1k

• BradyFU/Awesome-Multimodal-Large-Language-Models

  :sparkles::sparkles:Latest Advances on Multimodal Large Language Models

  11.5k745

• boyu-ai/Hands-on-RL

  https://hrl.boyuai.com/

  Language:Jupyter Notebook2.3k509

• haotian-liu/LLaVA

  [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

  Language:Python19k2.1k

• karpathy/micrograd

  A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

  Language:Jupyter Notebook9.9k1.4k

• srush/Triton-Puzzles

  Puzzles for learning Triton

  Language:Jupyter Notebook94058

• hehonghui/awesome-english-ebooks

  经济学人(含音频)、纽约客、卫报、连线、大西洋月刊等英语杂志免费下载,支持epub、mobi、pdf格式, 每周更新

  Language:CSS20.7k1.6k

• huggingface/peft

  🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

  Language:Python15.7k1.5k

• karpathy/llm.c

  LLM training in simple, raw C/CUDA

  Language:Cuda23k2.6k

• triton-lang/triton

  Development repository for the Triton language and compiler

  Language:C++12.4k1.5k

• openai/whisper

  Robust Speech Recognition via Large-Scale Weak Supervision

  Language:Python66.9k7.9k

• comfyanonymous/ComfyUI

  The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.

  Language:Python49k5.2k