bliu3650

bliu3650's Stars

• pytorch/pytorch

  Tensors and Dynamic neural networks in Python with strong GPU acceleration

  Language:Python85.9k1.8k48.1k23.1k

• microsoft/DeepSpeed

  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

  Language:Python36.2k3492.9k4.2k

• tatsu-lab/stanford_alpaca

  Code and documentation to train Stanford's Alpaca models, and generate the data.

  Language:Python29.7k3442714.1k

• huggingface/peft

  🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

  Language:Python17k1111.1k1.7k

• horovod/horovod

  Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

  Language:Python14.3k3342.2k2.2k

• PKU-YuanGroup/Open-Sora-Plan

  This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

  Language:Python11.8k1543681k

• NVIDIA/Megatron-LM

  Ongoing research training transformer models at scale

  Language:Python11.1k1678202.5k

• artidoro/qlora

  QLoRA: Efficient Finetuning of Quantized LLMs

  Language:Jupyter Notebook10.2k84250825

• microsoft/DeepSpeedExamples

  Example models using DeepSpeed

  Language:Python6.2k755461.1k

• kuangliu/pytorch-cifar

  95.47% on CIFAR10 with PyTorch

  Language:Python6.1k951362.2k

• yangjianxin1/Firefly

  Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

  Language:Python6k54281537

• NVIDIA/FasterTransformer

  Transformer related optimization, including BERT, GPT

  Language:C++6k63625895

• mindspore-ai/mindspore

  MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.

  Language:C++4.4k148281717

• bytedance/byteps

  A high performance and generic framework for distributed DNN training

  Language:Python3.7k84267493

• NVIDIA/nccl

  Optimized primitives for collective multi-GPU communication

  Language:C++3.4k1521.4k847

• Alpha-VLLM/LLaMA2-Accessory

  An Open-source Toolkit for LLM Development

  Language:Python2.8k37138176

• microsoft/Megatron-DeepSpeed

  Ongoing research training transformer language models at scale, including: BERT & GPT-2

  Language:Python2k25185345

• Xilinx/Vitis-AI

  Vitis AI is Xilinx’s development stack for AI inference on Xilinx hardware platforms, including both edge devices and Alveo cards.

  Language:Python1.5k781.4k640

• NVIDIA/nccl-tests

  NCCL Tests

  Language:Cuda96426240255

• pytorch/benchmark

  TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.

  Language:Python895253912294

• pytorch/kineto

  A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.

  Language:HTML75526218171

• OpenGVLab/OmniQuant

  [ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.

  Language:Python753178858

• microsoft/msccl

  Microsoft Collective Communication Library

  Language:C++330122830

• facebookresearch/HolisticTraceAnalysis

  A library to analyze PyTorch traces.

  Language:Python320185946

• bytedance/flux

  A fast communication-overlapping library for tensor parallelism on GPUs.

  Language:C++27082624

• pytorch/tensorpipe

  A tensor-aware point-to-point communication primitive for machine learning

  Language:C++252579675

• intel/handwritten-chinese-ocr-samples

  End-to-end model training and deployment reference for handwritten Chinese text recognition, and can also be extended to other languages.

  Language:Python15151532

• microsoft/msccl-tools

  Synthesizer for optimal collective communication algorithms

  Language:Python10192125

• PKU-YuanGroup/Open-Sora-Dataset

  Language:Python98866

• aws-neuron/aws-neuron-parallelcluster-samples

  Language:Shell222886