penglin03's Stars
mlabonne/llm-course
Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
rasbt/LLMs-from-scratch
Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step
microsoft/semantic-kernel
Integrate cutting-edge LLM technology quickly and easily into your apps
RasaHQ/rasa
💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants
triton-lang/triton
Development repository for the Triton language and compiler
BerriAI/litellm
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
NVIDIA/TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
microsoft/TypeChat
TypeChat is a library that makes it easy to build natural language interfaces using types.
langchain-ai/langgraph
Build resilient language agents as graphs.
1rgs/jsonformer
A Bulletproof Way to Generate Structured JSON from Language Models
eth-sri/lmql
A language for constraint-guided and efficient LLM programming.
Arize-ai/phoenix
AI Observability & Evaluation
turboderp/exllamav2
A fast inference library for running LLMs locally on modern consumer-class GPUs
SciPhi-AI/R2R
The all-in-one solution for RAG. Build, scale, and deploy state of the art Retrieval-Augmented Generation applications
linkedin/Liger-Kernel
Efficient Triton Kernels for LLM Training
langroid/langroid
Harness LLMs with Multi-Agent Programming
jackmpcollins/magentic
Seamlessly integrate LLMs as Python functions
griptape-ai/griptape
Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.
facebookresearch/DPR
Dense Passage Retriever - is a set of tools and models for open domain Q&A task.
langchain-ai/langgraph-studio
Desktop app for prototyping and debugging LangGraph applications locally.
SylphAI-Inc/AdalFlow
AdalFlow: The library to build & auto-optimize any LLM tasks.
mckaywrigley/clarity-ai
Come join the best place on the internet to learn AI skills. Use code "clarityai" for an extra 20% off.
BoundaryML/baml
BAML is a language that helps you get structured data from LLMs, with the best DX possible. Works with all languages. Check out the promptfiddle.com playground
mangiucugna/json_repair
A python module to repair invalid JSON, commonly used to parse the output of LLMs
josdejong/jsonrepair
Repair invalid JSON documents
ofirpress/self-ask
Code and data for "Measuring and Narrowing the Compositionality Gap in Language Models"
galatolofederico/microchain
function calling-based LLM agents
google-research-datasets/simulated-dialogue
marshmellow77/automated-prompt-engineering-from-scratch
A repo with an automated prompt engineering workflow from scratch. It leverages the OPRO technique.
microsoft/eureka-ml-insights
A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.