ryyzn9

ryyzn9's Stars

• karpathy/LLM101n

  LLM101n: Let's build a Storyteller

  29.2k2.2k01.6k

• microsoft/Swin-Transformer

  This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows".

  Language:Python13.7k1263122k

• Lightning-AI/litgpt

  20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

  Language:Python10.2k927601k

• openlm-research/open_llama

  OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset

  7.4k12191374

• pytorch-labs/gpt-fast

  Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

  Language:Python5.6k6398508

• ridgerchu/matmulfreellm

  Implementation for MatMul-free LM.

  Language:Python2.9k4331179

• pytorch/torchtitan

  A native PyTorch Library for large model training

  Language:Python2.3k37139170

• google-research/big_vision

  Official codebase used to develop Vision Transformer, SigLIP, MLP-Mixer, LiT and more.

  Language:Jupyter Notebook2.3k4156147

• SilasMarvin/lsp-ai

  LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.

  Language:Rust2.1k194572

• dabochen/spreadsheet-is-all-you-need

  A nanoGPT pipeline packed in a spreadsheet

  2k154121

• gkamradt/LLMTest_NeedleInAHaystack

  Doing simple retrieval from LLM models at various context lengths to measure accuracy

  Language:Jupyter Notebook1.5k1625152

• deepseek-ai/DeepSeek-LLM

  DeepSeek LLM: Let there be answers

  Language:Makefile1.4k243292

• alxndrTL/mamba.py

  A simple and efficient Mamba implementation in pure PyTorch and MLX.

  Language:Python93273986

• microsoft/Samba

  Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"

  Language:Python787241946

• lucidrains/linear-attention-transformer

  Transformer based on a variant of attention that is linear complexity in respect to sequence length

  Language:Python679122066

• mlfoundations/open_lm

  A repository for research on medium sized language models.

  Language:Python471216771

• minyoungg/platonic-rep

  Language:Python43912826

• kyegomez/zeta

  Build high-performance AI models with modular building blocks

  Language:Python39056037

• leobeeson/llm_benchmarks

  A collection of benchmarks and datasets for evaluating LLM.

  2582119

• lucidrains/linformer

  Implementation of Linformer for Pytorch

  Language:Python2487924

• AmeenAli/HiddenMambaAttn

  Official PyTorch Implementation of "The Hidden Attention of Mamba Models"

  Language:Python19251511

• wuch15/Fastformer

  A pytorch &keras implementation and demo of Fastformer.

  Language:Jupyter Notebook18561329

• LeapLabTHU/MLLA

  Official repository of MLLA (NeurIPS 2024)

  Language:Python1793276

• lucidrains/fast-transformer-pytorch

  Implementation of Fast Transformer in Pytorch

  Language:Python1719017

• yl4579/HiFTNet

  HiFTNet: A Fast High-Quality Neural Vocoder with Harmonic-plus-Noise Filter and Inverse Short Time Fourier Transform

  Language:Python129101010

• PeaBrane/mamba-tiny

  Simple, minimal implementation of the Mamba SSM in one pytorch file. More efficient than using for loops, but probably less efficient than using associative scans

  Language:Python945014

• alxndrTL/othello_mamba

  Evaluating the Mamba architecture on the Othello game

  Language:Python41415

• knotgrass/attention

  several types of attention modules written in PyTorch

  Language:Python403010

• fkodom/python-repo-template

  Template repo for Python projects, especially those focusing on machine learning and/or deep learning.

  Language:Python12100

• karthikncode/ParlAI

  A framework for training and evaluating AI models on a variety of openly available dialog datasets.

  Language:Python1200