will-thompson-k

will-thompson-k's Stars

• vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Language:Python20.3k1942.9k2.8k

• janhq/jan

  Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

  Language:TypeScript19.5k1111.4k1.1k

• spotify/luigi

  Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

  Language:Python17.4k4749822.4k

• pgvector/pgvector

  Open-source vector similarity search for Postgres

  Language:C9.9k78483434

• microsoft/LoRA

  Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

  Language:Python9.4k62102594

• mistralai/mistral-src

  Reference implementation of Mistral AI 7B v0.1 model.

  Language:Jupyter Notebook8.8k116115761

• karpathy/micrograd

  A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

  Language:Jupyter Notebook8.6k143251.2k

• facebookresearch/xformers

  Hackable and optimized Transformers building blocks, supporting a composable construction.

  Language:Python7.8k76483550

• Lightning-AI/litgpt

  Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.

  Language:Python6.9k73649732

• OpenAccess-AI-Collective/axolotl

  Go ahead and axolotl questions

  Language:Python6.4k48577714

• WooooDyy/LLM-Agent-Paper-List

  The paper list of the 86-page paper "The Rise and Potential of Large Language Model Based Agents: A Survey" by Zhiheng Xi et al.

  5.5k11712327

• google-deepmind/open_spiel

  OpenSpiel is a collection of environments and algorithms for research in general reinforcement learning and search/planning in games.

  Language:C++4k109536893

• huggingface/alignment-handbook

  Robust recipes to align language models with human and AI preferences

  Language:Python4k111117337

• openai/transformer-debugger

  Language:Python3.9k2513231

• yandex/YaLM-100B

  Pretrained language model with 100B parameters

  Language:Python3.7k4828296

• NVIDIA/NeMo-Guardrails

  NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

  Language:Python3.6k33261306

• openai/weak-to-strong

  Language:Python2.4k3418292

• AetherCortex/Llama-X

  Open Academic Research on Improving LLaMA to SOTA LLM

  Language:Python1.6k4220101

• pytorch/torchtitan

  A native PyTorch Library for large model training

  Language:Python1.2k2786108

• EdinburghNLP/awesome-hallucination-detection

  List of papers on hallucination detection in LLMs.

  43426334

• google/paxml

  Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimentation and parallelization, and has demonstrated industry leading model flop utilization rates.

  Language:Python414161762

• kingoflolz/swarm-jax

  Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes

  Language:Python2295121

• lucidrains/triton-transformer

  Implementation of a Transformer, but completely in Triton

  Language:Python22414814

• Mihaiii/llm_steer

  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vectors

  Language:Python1796211

• huggingface/llm-swarm

  Manage scalable open LLM inference endpoints in Slurm clusters

  Language:Python17235013

• lucidrains/speculative-decoding

  Explorations into some recent techniques surrounding speculative decoding

  Language:Python1628114

• teknium1/LLM-Benchmark-Logs

  Just a bunch of benchmark logs for different LLMs

  110602

• XZhang97666/AlpaCare

  Language:Python59117

• hwchase17/chain-of-verification

  Language:Python26304

• yisding/litllm

  Language:TypeScript17201