Pinned Repositories
accelerate
🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
optimum-quanto
A pytorch quantization backend for optimum
transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
accelerate
🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision
huggingface-course
Hugging Face course
huggingface.js
Utilities to use the Hugging Face hub API
NlpFromScratch
Coding and training famous nlp models from scratch
optimum
🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools
quanto
A pytorch Quantization Toolkit
SunMarc's Repositories
SunMarc/huggingface-course
Hugging Face course
SunMarc/huggingface.js
Utilities to use the Hugging Face hub API
SunMarc/NlpFromScratch
Coding and training famous nlp models from scratch
SunMarc/quanto
A pytorch Quantization Toolkit
SunMarc/accelerate
🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision
SunMarc/AutoGPTQ
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
SunMarc/bitsandbytes
8-bit CUDA functions for PyTorch
SunMarc/blog
Public repo for HF blog posts
SunMarc/notebooks
Notebooks using the Hugging Face libraries 🤗
SunMarc/optimum
🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools
SunMarc/peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
SunMarc/transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
SunMarc/candle
Minimalist ML framework for Rust
SunMarc/coding_challenge
Solving algorithm problems for fun
SunMarc/diffusers
🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch
SunMarc/diffusion-models-class
Materials for the Hugging Face Diffusion Models Course
SunMarc/exllamav2
A fast inference library for running LLMs locally on modern consumer-class GPUs
SunMarc/gpt-fast
Fast and hackable pytorch native transformer inference. Meant to be copied and modified
SunMarc/gptq
Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".
SunMarc/huggingface_hub
The official Python client for the Huggingface Hub.
SunMarc/llama-mistral
Inference code for Mistral and Mixtral hacked up into original Llama implementation
SunMarc/llm.c
LLM training in simple, raw C/CUDA
SunMarc/minimal-trainer-zoo
Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
SunMarc/optimum-benchmark
A multi-backend utility for benchmarking Transformers and Diffusers with support for hardware specific Optimum optimizations/quantization schemas
SunMarc/PiPPy
Pipeline Parallelism for PyTorch
SunMarc/pippy-device-map-playground
SunMarc/RecommenderSystem
Theory of popular recommender system
SunMarc/safetensors
Simple, safe way to store and distribute tensors
SunMarc/text-generation-inference
Large Language Model Text Generation Inference
SunMarc/xla
Enabling PyTorch on XLA Devices (e.g. Google TPU)