divyanshk

divyanshk's Stars

• pytorch/data

  A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.

  Language:Python1.2k155

• openai/tiktoken

  tiktoken is a fast BPE tokeniser for use with OpenAI's models.

  Language:Python13k908

• google-research/tuning_playbook

  A playbook for systematically maximizing the performance of deep learning models.

  27.8k2.3k

• ServiceNow/Fast-LLM

  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research

  Language:Python12120

• facebookresearch/lingua

  Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.

  Language:Python4.4k227

• huggingface/datatrove

  Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

  Language:Python2.1k162

• facebookexperimental/triton

  Github mirror of trition-lang/triton repo.

  Language:C++184

• Jokeren/Awesome-GPU

  Awesome resources for GPUs

  52250

• pytorch-labs/gpt-fast

  Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

  Language:Python5.7k525

• pytorch-labs/tritonbench

  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.

  Language:Python755

• LambdaLabsML/distributed-training-guide

  Best practices & guides on how to write distributed pytorch training code

  Language:Python33522

• HazyResearch/ThunderKittens

  Tile primitives for speedy kernels

  Language:Cuda1.9k95

• unslothai/unsloth

  Finetune Llama 3.3, Mistral, Phi-4, Qwen 2.5 & Gemma LLMs 2-5x faster with 70% less memory

  Language:Python20.7k1.5k

• gpu-mode/resource-stream

  GPU programming related news and material links

  1.3k78

• karpathy/llama2.c

  Inference Llama 2 in one file of pure C

  Language:C17.9k2.2k

• meta-llama/llama-stack

  Composable building blocks to build Llama Apps

  Language:Python6k741

• gpu-mode/lectures

  Material for gpu-mode lectures

  Language:Jupyter Notebook3.5k352

• divyanshk/CodePlayList

  a music playlist for ComputerGeeks :p

  12

• gpu-mode/awesomeMLSys

  An ML Systems Onboarding list

  64620

• Lightning-AI/litgpt

  20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

  Language:Python11.2k1.1k

• rasbt/LLM-workshop-2024

  A 4-hour coding workshop to understand how LLMs are implemented and used

  Language:Jupyter Notebook827249

• karpathy/llm.c

  LLM training in simple, raw C/CUDA

  Language:Cuda25k2.9k

• openai/CLIP

  CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

  Language:Jupyter Notebook27k3.4k

• facebookresearch/generative-recommenders

  Repository hosting code for "Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendations" (https://arxiv.org/abs/2402.17152).

  Language:Python860157

• pytorch/torchtune

  PyTorch native post-training library

  Language:Python4.7k490

• huggingface/transformers

  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  Language:Python138k27.6k

• refuel-ai/autolabel

  Label, clean and enrich text datasets with LLMs.

  Language:Python2.1k152

• vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Language:Python33.8k5.2k

• karpathy/nanoGPT

  The simplest, fastest repository for training/finetuning medium-sized GPTs.

  Language:Python38.5k6.2k

• Lightning-AI/lit-llama

  Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

  Language:Python6k518