Suggestions welcome through contributions :)

AI Agent Framework

Name (site) Github
AutoGPT
MetaGPT
AgentGPT
Autogen
BabyAGI
CrewAI
SuperAGI
TaskingAI
LaVague
superagent
Rivet AI
AGiXT
cheshirecat
langroid
Griptape
Mirascope
Julep
ControlFlow

AI Gateway

Name (site) Github
Kong
Litellm
Portkey
RouteLLM
GPTRouter
missing studio

AI Workload Manager

Name (site) Github
Ray
higgsfield
Dstack

Copilot Development

Name (site) Github
copilotkit
OpenCopilot

Dataset Engineering

Name (site) Github
label studio
CleanLab
Snorkel
Lilac

Evaluation

Name (site) Github
Eval
RAGAS
Giskard
promptfoo
arize ai
uptrain
truera
tonic-validate

Fine Tuning

Name (site) Github
Unsloth
ludwig
NeMo/Nvidia
LMFlow
litgpt
Axolotl
xTuring

Function Calling

Name (site) Github
Gorilla
Tiger
NPI AI
empower
Composio

Graph RAG

Name (site) Github
graphRAG
cognee
FalkorDB
llm-graph-builder
tidb

Guardrails

Name (site) Github
NeMo-Guardrails
Guardrails

Model Inference - Local

Name (site) Github
llama cpp
whisper cpp
ollama
gpt4all
private-gpt
open-interpreter
LocalAI
jan
dalai

Model Serving/Inferencing

Name (site) Github
vLLM
TensorRT-LLM
bentoml
lightllm
openfoundry

Observability

Name (site) Github
pezzo
helicone
Langfuse

Pre-training

Name (site) Github
Colossal AI
FastChat
pytorch-lightning
llm c
miniGPT

Prompt Engineering

Name (site) Github
DSPy
Langfuse

RAG Framework

Name (site) Github
Langchain
LlamaIndex
FastGPT
ragflow
vanna
FlagEmbedding
llmware
llm-app
Cognita
casibase
SciPhi
trieve
autollm
canopy
NeumAI
WrenAI
ragna

RAG + Agent Framework

Name (site) Github
Dify
Flowise
langflow
Haystack
MemGPT
phidata
PromptFlow
chainlit
ragapp

Structured Extraction

Name (site) Github
Unstructured
omniparse
indexify

Structured Generation

Name (site) Github
guidance
outlines
instructor
jsonformer
sglang

Vector DB

Name (site) Github
milvus
Qdrant
Chroma
Weaviate
pgvector
deeplake
txtai
marqo
lancedb
nucliaDB
oasysdb

Voice Agent

Name (site) Github
vocode
bolna