nking-1

nking-1's Stars

• AUTOMATIC1111/stable-diffusion-webui

  Stable Diffusion web UI

  Language:Python145k1.1k7.7k27.3k

• oobabooga/text-generation-webui

  A Gradio web UI for Large Language Models with support for multiple inference backends.

  Language:Python41.5k3293.7k5.4k

• vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Language:Python33.2k2715.8k5k

• facebookresearch/fairseq

  Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

  Language:Python30.8k4254.2k6.4k

• invoke-ai/InvokeAI

  Invoke is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry leading WebUI, and serves as the foundation for multiple commercial products.

  Language:TypeScript24.1k2063.2k2.5k

• microsoft/semantic-kernel

  Integrate cutting-edge LLM technology quickly and easily into your apps

  Language:C#22.5k2743.4k3.4k

• tailwindlabs/heroicons

  A set of free MIT-licensed high-quality SVG icons for UI development.

  Language:JavaScript21.8k1634041.3k

• guidance-ai/guidance

  A guidance language for controlling large language models.

  Language:Jupyter Notebook19.4k1195501.1k

• BerriAI/litellm

  Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

  Language:Python15.9k903.9k1.9k

• mlc-ai/web-llm

  High-performance In-browser LLM Inference Engine

  Language:TypeScript14.2k127316916

• dottxt-ai/outlines

  Structured Text Generation

  Language:Python10.2k49667533

• andrewyng/aisuite

  Simple, unified interface to multiple Generative AI providers

  Language:Python9.6k11956856

• ollama/ollama-python

  Ollama Python library

  Language:Python5.6k41193483

• MadcowD/ell

  A language model programming library.

  Language:Python5.5k52285326

• microsoft/promptbase

  All things prompt engineering

  Language:Python5.5k5915301

• microsoft/LLMLingua

  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

  Language:Python4.8k34134267

• miguelgrinberg/python-socketio

  Python Socket.IO server and client

  Language:Python4.1k61826597

• dosyago/dn

  💾 dn - offline full-text search and archiving for your Chromium-based browser.

  Language:JavaScript3.8k43111146

• microsoft/promptbench

  A unified evaluation framework for large language models

  Language:Python2.5k2058185

• jackmpcollins/magentic

  Seamlessly integrate LLMs as Python functions

  Language:Python2.1k1183108

• microsoft/aici

  AICI: Prompts as (Wasm) Programs

  Language:Rust2k247578

• jupyter/nbconvert

  Jupyter Notebook Conversion

  Language:Python1.8k501.2k572

• OpenBioLink/ThoughtSource

  A central, open resource for data and tools related to chain-of-thought reasoning in large language models. Developed @ Samwald research group: https://samwald.info/

  Language:Jupyter Notebook914145372

• mlc-ai/xgrammar

  Efficient, Flexible and Portable Structured Generation

  Language:C++540112130

• Sohl-Dickstein/fractal

  The boundary of neural network trainability is fractal

  Language:Jupyter Notebook1683118

• microsoft/eureka-ml-insights

  A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.

  Language:Python10316814

• vlievin/medical-reasoning

  Medical reasoning using large language models

  Language:HTML86636

• AlbanPerli/Noema-Declarative-AI

  A declarative way to control LLMs.

  Language:Python66201

• guidance-ai/llguidance

  Low-level Guidance Parser

  Language:Rust626318

• mmoskal/llguidance-wasm

  Language:TypeScript1