balusch

balusch's Stars

• ggerganov/llama.cpp

  LLM inference in C/C++

  Language:C++70.2k5594.2k10.1k

• meta-llama/llama

  Inference code for Llama models

  Language:Python57.1k5251.1k9.6k

• lm-sys/FastChat

  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

  Language:Python37.4k3511.8k4.6k

• rasbt/LLMs-from-scratch

  Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

  Language:Jupyter Notebook37.2k4001114.8k

• aria2/aria2

  aria2 is a lightweight multi-protocol & multi-source, cross platform download utility operated in command-line. It supports HTTP/HTTPS, FTP, SFTP, BitTorrent and Metalink.

  Language:C++36.4k7421.9k3.6k

• ray-project/ray

  Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

  Language:Python34.7k47919.1k5.9k

• vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Language:Python33.1k2715.8k5k

• SerenityOS/serenity

  The Serenity Operating System 🐞

  Language:C++30.9k3514.2k3.2k

• rockerBOO/awesome-neovim

  Collections of awesome neovim plugins.

  16.6k157121750

• catppuccin/catppuccin

  😸 Soothing pastel theme for the high-spirited!

  Language:TypeScript15.6k49470280

• Dao-AILab/flash-attention

  Fast and memory-efficient exact attention

  Language:Python14.9k1231.2k1.4k

• rigtorp/awesome-modern-cpp

  A collection of resources on modern C++

  Language:HTML12k494201.2k

• srush/GPU-Puzzles

  Solve puzzles. Learn CUDA.

  Language:Jupyter Notebook10.3k19332968

• microsoft/inshellisense

  IDE style command line auto complete

  Language:TypeScript9k26139195

• cp-algorithms/cp-algorithms

  Algorithm and data structure articles for https://cp-algorithms.com (based on http://e-maxx.ru)

  Language:C++8k1053571.6k

• boyter/scc

  Sloc, Cloc and Code: scc is a very fast accurate code counter with complexity calculations and COCOMO estimates written in pure Go

  Language:Go6.9k39302265

• facebookresearch/DiT

  Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

  Language:Python6.7k4483596

• folke/which-key.nvim

  💥 Create key bindings that stick. WhichKey helps you remember your Neovim keymaps, by showing available keybindings in a popup as you type.

  Language:Lua5.6k11591180

• continue-revolution/sd-webui-segment-anything

  Segment Anything for Stable Diffusion WebUI

  Language:Python3.4k33165206

• DefTruth/Awesome-LLM-Inference

  📖A curated list of Awesome LLM/VLM Inference Papers with codes, such as FlashAttention, PagedAttention, Parallelism, etc. 🎉🎉

  3.1k1056211

• kvcache-ai/Mooncake

  Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

  Language:C++2.3k2736131

• NVIDIA/TransformerEngine

  A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.

  Language:Python2.1k33369338

• llvm/torch-mlir

  The Torch-MLIR project aims to provide first class support from the PyTorch ecosystem to the MLIR ecosystem.

  Language:C++1.4k248721517

• hao-ai-lab/LookaheadDecoding

  [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding

  Language:Python1.2k115870

• skywind3000/emake

  你见过的最简单的 GCC/CLANG 项目构建工具，定义式构建，比命令式更简单

  Language:Python8334616115

• dwmkerr/effective-shell

  Text, samples and website for my 'Effective Shell' series.

  Language:JavaScript712164781

• gpu-mode/awesomeMLSys

  An ML Systems Onboarding list

  59815019

• bloomberg/quantum

  Powerful multi-threaded coroutine dispatcher and parallel execution engine

  Language:C++581281395

• rmarx/holblocking-blogpost

  Blogpost on Head-of-Line blocking from HTTP/1 to HTTP/3

  1284411

• edwardqin-creator/StableDiffusion-Model-Evaluation-Framework

  This is a framework to evaluate your stable diffusion model

  Language:Python3200