matthewmackay

matthewmackay's Stars

• TylerYep/torchinfo

  View model summaries in PyTorch!

  Language:Python2.7k124

• gpu-mode/awesomeMLSys

  An ML Systems Onboarding list

  63620

• hijkzzz/Awesome-LLM-Strawberry

  A collection of LLM papers, blogs, and projects, with a focus on OpenAI o1 🍓 and reasoning techniques.

  6.1k336

• cloneofsimo/insightful-nn-papers

  These papers will provide unique insightful concepts that will broaden your perspective on neural networks and deep learning

  47

• arpitingle/gpu-alpha

  High Quality Resources on GPU Programming/Architecture

  57817

• rwitten/HighPerfLLMs2024

  Language:Python26223

• karpathy/LLM101n

  LLM101n: Let's build a Storyteller

  30.9k1.7k

• google-research/tuning_playbook

  A playbook for systematically maximizing the performance of deep learning models.

  27.8k2.3k

• stanford-cs336/spring2024-lectures

  Language:Python19737

• KellerJordan/modded-nanogpt

  NanoGPT (124M) in 3.4 minutes

  Language:Python2k199

• jax-ml/coix

  Inference Combinators in JAX

  Language:Jupyter Notebook452

• google-deepmind/penzai

  A JAX research toolkit for building, editing, and visualizing neural networks.

  Language:Python1.7k55

• gpu-mode/resource-stream

  GPU programming related news and material links

  1.3k78

• karpathy/minbpe

  Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

  Language:Python9.3k879

• patrick-kidger/jaxtyping

  Type annotations and runtime checking for shape and dtype of JAX/NumPy/PyTorch/etc. arrays. https://docs.kidger.site/jaxtyping/

  Language:Python1.3k66

• justinchiu/openlogprobs

  Extract full next-token probabilities via language model APIs

  Language:Python23213

• Kinyugo/consistency_models

  A mini-library for training consistency models.

  Language:Jupyter Notebook23225

• guidance-ai/guidance

  A guidance language for controlling large language models.

  Language:Jupyter Notebook19.4k1.1k

• lucidrains/x-transformers

  A concise but complete full-attention transformer with a set of promising experimental features from various papers

  Language:Python5k430

• pytorch-labs/gpt-fast

  Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

  Language:Python5.7k521

• fferflo/einx

  Universal Tensor Operations in Einstein-Inspired Notation for Python.

  Language:Python33810

• dottxt-ai/outlines

  Structured Text Generation

  Language:Python10.3k538

• blackjax-devs/blackjax

  BlackJAX is a Bayesian Inference library designed for ease of use, speed and modularity.

  Language:Python869108

• stanfordnlp/dspy

  DSPy: The framework for programming—not prompting—language models

  Language:Python20.9k1.6k

• mlabonne/llm-course

  Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

  Language:Jupyter Notebook40.9k4.4k

• dataflowr/notebooks

  code for deep learning courses

  Language:Jupyter Notebook1.1k309

• unit8co/darts

  A python library for user-friendly forecasting and anomaly detection on time series.

  Language:Python8.2k898

• norvig/pytudes

  Python programs, usually short, of considerable difficulty, to perfect particular skills.

  Language:Jupyter Notebook23.2k2.4k

• johnma2006/mamba-minimal

  Simple, minimal implementation of the Mamba SSM in one file of PyTorch.

  Language:Python2.7k197

• state-spaces/mamba

  Mamba SSM architecture

  Language:Python13.7k1.2k