suxi1314

suxi1314's Stars

• hkust-nlp/deita

  Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]

  Language:Python48127

• ray-project/ray-llm

  RayLLM - LLMs on Ray

  Language:Python1.2k93

• ModelTC/lightllm

  LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

  Language:Python2.5k198

• cupbop/CuPBoP

  A framework that support executing unmodified CUDA source code on non-NVIDIA devices.

  Language:C++9611

• bytedance/ByteTransformer

  optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052

  Language:C++45536

• vitrun/FasterTransformer

  Transformer related optimization, including BERT, GPT

  55

• qwopqwop200/GPTQ-for-LLaMa

  4 bits quantization of LLaMA using GPTQ

  Language:Python3k459

• cameronfr/FasterTransformer

  Transformer related optimization, including BERT, GPT

  Language:C++154

• wangzhaode/mnn-llm

  llm deploy project based mnn.

  Language:C++1.4k159

• salesforce/CodeGen

  CodeGen is a family of open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.

  Language:Python4.9k381

• THUDM/FasterTransformer

  Transformer related optimization, including BERT, GPT

  Language:C++3913

• liangwq/Chatglm_lora_multi-gpu

  chatglm多gpu用deepspeed和

  Language:Python39961

• microsoft/DeepSpeed-MII

  MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

  Language:Python1.9k175

• huggingface/transformers-bloom-inference

  Fast Inference Solutions for BLOOM

  Language:Python557113

• EleutherAI/gpt-neox

  An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

  Language:Python6.9k1k

• HabanaAI/Model-References

  Reference models for Intel(R) Gaudi(R) AI Accelerator

  Language:Jupyter Notebook15379

• microsoft/Megatron-DeepSpeed

  Ongoing research training transformer language models at scale, including: BERT & GPT-2

  Language:Python1.9k342

• jadore801120/attention-is-all-you-need-pytorch

  A PyTorch implementation of the Transformer model in "Attention is All You Need".

  Language:Python8.8k2k

• exaloop/codon

  A high-performance, zero-overhead, extensible Python compiler using LLVM

  Language:C++15.1k520

• triton-lang/triton

  Development repository for the Triton language and compiler

  Language:C++13.1k1.6k

• chenfei-wu/TaskMatrix

  Language:Python34.5k3.3k

• NVIDIA/nccl

  Optimized primitives for collective multi-GPU communication

  Language:C++3.2k804

• jkjung-avt/tensorrt_demos

  TensorRT MODNet, YOLOv4, YOLOv3, SSD, MTCNN, and GoogLeNet

  Language:Python1.7k547

• microsoft/onnxruntime

  ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

  Language:C++14.4k2.9k

• CompVis/stable-diffusion

  A latent text-to-image diffusion model

  Language:Jupyter Notebook68k10.1k

• huggingface/diffusers

  🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

  Language:Python25.6k5.3k

• AUTOMATIC1111/stable-diffusion-webui

  Stable Diffusion web UI

  Language:Python141k26.7k

• triton-inference-server/hugectr_backend

  Language:Jupyter Notebook509

• facebookincubator/AITemplate

  AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.

  Language:Python4.5k367

• triton-inference-server/server

  The Triton Inference Server provides an optimized cloud and edge inferencing solution.

  Language:Python8.2k1.5k