ZhaiFeiyue

ZhaiFeiyue's Stars

• yanfeich/Samples

  Language:C++12

• chenzomi12/AISystem

  AISystem 主要是指AI系统，包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术

  Language:Jupyter Notebook10.4k1.5k

• Mooler0410/LLMsPracticalGuide

  A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)

  9.3k705

• xdit-project/xDiT

  xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) on multi-GPU Clusters

  Language:Python48240

• FasterDecoding/Medusa

  Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

  Language:Jupyter Notebook2.2k150

• karpathy/llm.c

  LLM training in simple, raw C/CUDA

  Language:Cuda23.3k2.6k

• zhuzilin/ring-flash-attention

  Ring attention implementation with flash attention

  Language:Python52939

• hahnyuan/LLM-Viewer

  Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline model in a user-friendly interface.

  Language:Python27532

• MichaelKim0407/tutorial-pip-package

  Tutorial on how to create your own pip package

  Language:Python11414

• huggingface/tgi-gaudi

  Large Language Model Text Generation Inference on Habana Gaudi

  Language:Python2439

• meta-llama/llama

  Inference code for Llama models

  Language:Python55.5k9.5k

• microsoft/Megatron-DeepSpeed

  Ongoing research training transformer language models at scale, including: BERT & GPT-2

  Language:Python1.8k337

• huggingface/optimum-habana

  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)

  Language:Python144180

• huggingface/optimum

  🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

  Language:Python2.5k441