muellerzr

muellerzr's Stars

• huggingface/transformers

  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  Language:Python128k1.1k15k25.3k

• huggingface/datasets

  🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

  Language:Python18.6k2792.8k2.6k

• stas00/ml-engineering

  Machine Learning Engineering Open Book

  Language:Python10.1k10318593

• huggingface/accelerate

  🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

  Language:Python7.2k1001.4k847

• NVIDIA/ChatRTX

  A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM

  Language:Python2.5k5256273

• facebookresearch/schedule_free

  Schedule-Free Optimization in PyTorch

  Language:Python1.5k151948

• pytorch/torchtitan

  A native PyTorch Library for large model training

  Language:Python1.2k2889111

• microsoft/mup

  maximal update parametrization (µP)

  Language:Jupyter Notebook1.2k295887

• jiaweizzhao/GaLore

  GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

  Language:Python1.2k1741129

• anibali/docker-pytorch

  A Docker image for PyTorch

  Language:Dockerfile9582337225

• tinygrad/open-gpu-kernel-modules

  NVIDIA Linux open GPU with P2P support

  Language:C75111556

• stas00/the-art-of-debugging

  The Art of Debugging

  Language:C73416028

• pytorch/PiPPy

  Pipeline Parallelism for PyTorch

  Language:Python6533624877

• pacman100/LLM-Workshop

  LLM Workshop by Sourab Mangrulkar

  Language:Jupyter Notebook284616108

• bigcode-project/starcoder2-self-align

  StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

  Language:Python2005512

• muellerzr/minimal-trainer-zoo

  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines

  Language:Python1944113

• lucidrains/recurrent-interface-network-pytorch

  Implementation of Recurrent Interface Network (RIN), for highly efficient generation of images and video without cascading networks, in Pytorch

  Language:Python188111614

• SergioMEV/slurm-for-dummies

  A dummy's guide to setting up (and using) HPC clusters on Ubuntu 22.04LTS using Slurm and Munge. Created by the Quant Club @ UIowa.

  11431216

• LukasHedegaard/pytorch-benchmark

  Easily benchmark PyTorch model FLOPs, latency, throughput, allocated gpu memory and energy consumption

  Language:Python81479

• xrsrke/pipegoose

  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*

  Language:Python7543217

• fchollet/namex

  Clean up the public namespace of your package!

  Language:Python51313

• Youhe-Jiang/IJCAI2023-OptimalShardedDataParallel

  [IJCAI2023] An automated parallel training system that combines the advantages from both data and model parallelism. If you have any interests, please visit/star/fork https://github.com/Youhe-Jiang/OptimalShardedDataParallel

  Language:Python50104

• muellerzr/nbquarto

  Small python library solely for quick Quarto extensions

  Language:Python20133

• gnovack/distributed-training-and-deepspeed

  Language:Python13202

• muellerzr/RAG-Experiments

  My learnings (publicly) on RAG systems

  Language:Python1360

• TJ-Solergibert/transformers-in-supercomputers

  Transformers training in a supercomputer with the 🤗 Stack and Slurm

  Language:Python12200

• BenjaminBossan/pytest-guide

  Pytest guide for unittest users

  Language:Python61

• muellerzr/llama-3-8b-self-align

  StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation applied to llama 3 8b

  Language:Python6001

• muellerzr/swe-study-group

  Code for the SWE study group

  Language:Python6201

• lessw2020/hyper_efficient_optimizers

  Development of hyper efficient optimizers that can match/exceed AdamW, while using reduced memory

  Language:Python5211