xrsrke

xrsrke's Stars

• meta-llama/llama3

  The official Meta Llama 3 GitHub site

  Language:Python27.6k2302733.1k

• huggingface/lerobot

  🤗 LeRobot: Making AI for Robotics more accessible with end-to-end learning

  Language:Python7.9k85153794

• lucidrains/x-transformers

  A concise but complete full-attention transformer with a set of promising experimental features from various papers

  Language:Python4.9k57235425

• pytorch/ao

  PyTorch native quantization and sparsity for training and inference

  Language:Python1.7k44337188

• mit-han-lab/smoothquant

  [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

  Language:Python1.3k2189151

• pytorch/FBGEMM

  FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/

  Language:C++1.2k65171520

• google-research/federated

  A collection of Google research projects related to Federated Learning and Federated Analytics.

  Language:Python6962747196

• ironjr/grokfast

  Official repository for the paper "Grokfast: Accelerated Grokking by Amplifying Slow Gradients"

  Language:Python528131044

• FranxYao/Long-Context-Data-Engineering

  Implementation of paper Data Engineering for Scaling Language Models to 128K Context

  Language:Python44781729

• apple/ml-sigma-reparam

  Language:Python29413014

• usyd-fsalab/fp6_llm

  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).

  Language:Cuda22061116

• pytorch-labs/float8_experimental

  This repository contains the experimental PyTorch native float8 training UX

  Language:Python215254720

• pytorch-labs/applied-ai

  Applied AI experiments and examples for PyTorch

  Language:Python19114917

• nbasyl/LLM-FP4

  The official implementation of the EMNLP 2023 paper LLM-FP4

  Language:Python16851011

• jundaf2/INT8-Flash-Attention-FMHA-Quantization

  Language:Cuda1565517

• albanD/subclass_zoo

  Language:Jupyter Notebook152122825

• Qualcomm-AI-research/FP8-quantization

  Language:Python1277510

• athms/mad-lab

  A MAD laboratory to improve AI architecture designs 🧪

  Language:Python95227

• wimh966/outlier_suppression

  The official PyTorch implementation of the NeurIPS2022 (spotlight) paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer Language Models

  Language:Python46114

• ROCm/aotriton

  Ahead of Time (AOT) Triton Math Library

  Language:Python44101815

• google-deepmind/asyncdiloco

  Language:Jupyter Notebook39603

• Qualcomm-AI-research/outlier-free-transformers

  Language:Python37644

• arogozhnikov/adamw_bfloat16

  AdamW optimizer for bfloat16 models in pytorch 🔥.

  Language:Python30414

• thu-ml/Jetfire-INT8Training

  Language:Jupyter Notebook26423

• graphcore-research/pytorch-tensor-tracker

  Flexibly track outputs and grad-outputs of torch.nn.Module.

  Language:Python13201

• AmericanPresidentJimmyCarter/test-torch-bfloat16-vit-training

  Language:Python9301

• honglu2875/thing

  Catch your tensors in one program and quietly send to another live python session.

  Language:Python6131

• carsonpo/octomul

  Reasonably fast (compared to cublas) and relatively simple int8 tensor core gemm

  Language:Cuda5101

• huggingface/bench_cluster

  Language:Python4402

• Krishnateja244/Vanishing_Gradient

  This repository helps in understanding vanishing gradient problem with visualization

  Language:Jupyter Notebook2101