will-thompson-k

will-thompson-k's Stars

• vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Language:Python30.9k2505.4k4.7k

• janhq/jan

  Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

  Language:TypeScript23.8k1341.9k1.4k

• spotify/luigi

  Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

  Language:Python17.9k4729982.4k

• microsoft/LoRA

  Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

  Language:Python10.8k70107691

• Lightning-AI/litgpt

  20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

  Language:Python10.8k947881.1k

• karpathy/micrograd

  A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

  Language:Jupyter Notebook10.6k150311.5k

• mistralai/mistral-inference

  Official inference library for Mistral models

  Language:Jupyter Notebook9.8k126145872

• facebookresearch/xformers

  Hackable and optimized Transformers building blocks, supporting a composable construction.

  Language:Python8.7k77565622

• axolotl-ai-cloud/axolotl

  Go ahead and axolotl questions

  Language:Python8k44684881

• WooooDyy/LLM-Agent-Paper-List

  The paper list of the 86-page paper "The Rise and Potential of Large Language Model Based Agents: A Survey" by Zhiheng Xi et al.

  6.9k13914410

• langchain-ai/langgraph

  Build resilient language agents as graphs.

  Language:Python6.9k643211.1k

• huggingface/alignment-handbook

  Robust recipes to align language models with human and AI preferences

  Language:Python4.7k112137414

• google-deepmind/open_spiel

  OpenSpiel is a collection of environments and algorithms for research in general reinforcement learning and search/planning in games.

  Language:C++4.3k107559937

• NVIDIA/NeMo-Guardrails

  NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

  Language:Python4.2k36367400

• openai/transformer-debugger

  Language:Python4k2514239

• yandex/YaLM-100B

  Pretrained language model with 100B parameters

  Language:Python3.7k4828301

• pytorch/torchtitan

  A native PyTorch Library for large model training

  Language:Python2.7k43183208

• openai/weak-to-strong

  Language:Python2.5k3317307

• EdinburghNLP/awesome-hallucination-detection

  List of papers on hallucination detection in LLMs.

  68425457

• gordicaleksa/get-started-with-JAX

  The purpose of this repo is to make it easy to get started with JAX, Flax, and Haiku. It contains my "Machine Learning with JAX" series of tutorials (YouTube videos and Jupyter Notebooks) as well as the content I found useful while learning about the JAX ecosystem.

  Language:Jupyter Notebook6629098

• google/paxml

  Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimentation and parallelization, and has demonstrated industry leading model flop utilization rates.

  Language:Python457152168

• lucidrains/triton-transformer

  Implementation of a Transformer, but completely in Triton

  Language:Python24815915

• huggingface/llm-swarm

  Manage scalable open LLM inference endpoints in Slurm clusters

  Language:Python23833123

• kingoflolz/swarm-jax

  Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes

  Language:Python2375122

• lucidrains/speculative-decoding

  Explorations into some recent techniques surrounding speculative decoding

  Language:Python2138416

• Mihaiii/llm_steer

  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vectors

  Language:Python2046212

• teknium1/LLM-Benchmark-Logs

  Just a bunch of benchmark logs for different LLMs

  116702

• XZhang97666/AlpaCare

  Language:Python822311

• hwchase17/chain-of-verification

  Language:Python30305

• yisding/litllm

  Language:TypeScript18201