junyuanjyjy's Stars
labmlai/annotated_deep_learning_paper_implementations
🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
eugeneyan/applied-ml
📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.
naklecha/llama3-from-scratch
llama3 implementation one matrix multiplication at a time
facebookresearch/llm-transparency-tool
LLM Transparency Tool (LLM-TT), an open-source interactive toolkit for analyzing internal workings of Transformer-based language models. *Check out demo at* https://huggingface.co/spaces/facebook/llm-transparency-tool-demo
timaeus-research/devinterp
Tools for studying developmental interpretability in neural networks.
pytorch/torchtune
A Native-PyTorch Library for LLM Fine-tuning
openai/simple-evals
google-deepmind/searchless_chess
Grandmaster-Level Chess Without Search
openai/transformer-debugger
openai/lm-human-preferences
Code for the paper Fine-Tuning Language Models from Human Preferences
shap/shap
A game theoretic approach to explain the output of any machine learning model.
google/gemma_pytorch
The official PyTorch implementation of Google's Gemma models
pytorch/captum
Model interpretability and understanding for PyTorch
karpathy/minbpe
Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
afspies/attention-tutorial
Jupyter Notebook tutorial on Attention Mechanisms, Position Embeddings and Random Fourier Feature based approximations. Created for Imperial College Deep Learning Course