Jeffwan

Jeffwan's Stars

• langchain-ai/langchain

  🦜🔗 Build context-aware reasoning applications

  Language:Jupyter Notebook92.9k6827.6k14.9k

• chenfei-wu/TaskMatrix

  Language:Python34.5k3003523.3k

• vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Language:Python27.6k2254.6k4.1k

• eosphoros-ai/DB-GPT

  AI Native Data App Development framework with AWEL(Agentic Workflow Expression Language) and Agents

  Language:Python13.4k1161.1k1.8k

• cpacker/MemGPT

  Letta (fka MemGPT) is a framework for creating stateful LLM services.

  Language:Python11.8k1177451.3k

• huggingface/text-generation-inference

  Large Language Model Text Generation Inference

  Language:Python8.8k981.3k1k

• InternLM/InternLM

  Official release of InternLM2.5 base and chat models. 1M context support

  Language:Python6.3k54331440

• xlang-ai/OpenAgents

  [COLM 2024] OpenAgents: An Open Platform for Language Agents in the Wild

  Language:Python3.9k4598431

• Zjh-819/LLMDataHub

  A quick guide (especially) for trending instruction finetuning datasets

  2.5k463159

• predibase/lorax

  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

  Language:Python2.1k34237139

• S-LoRA/S-LoRA

  S-LoRA: Serving Thousands of Concurrent LoRA Adapters

  Language:Python1.7k243990

• spegel-org/spegel

  Stateless cluster local OCI registry mirror.

  Language:Go1.1k1010657

• jbilcke-hf/ai-comic-factory

  Generate comic panels using a LLM + SDXL. Powered by Hugging Face 🤗

  Language:TypeScript9951210208

• v6d-io/v6d

  vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)

  Language:C++82727611122

• efeslab/Nanoflow

  A throughput-oriented high-performance serving framework for LLMs

  Language:Cuda53451421

• BeachWang/DAIL-SQL

  A efficient and effective few-shot NL2SQL method on GPT-4.

  Language:Python39354465

• conceptofmind/toolformer

  Language:Python340112138

• DataDog/watermarkpodautoscaler

  Custom controller that extends the Horizontal Pod Autoscaler

  Language:Go21082225

• lambda7xx/awesome-AI-system

  paper and its code for AI System

  2047313

• ServerlessLLM/ServerlessLLM

  Scalable and Efficient Serverless Deployment for Large AI Models.

  Language:Python191124119

• FlagOpen/FlagInstruct

  172723

• ACL2023-Retrieval-LM/ACL2023-Retrieval-LM.github.io

  https://acl2023-retrieval-lm.github.io/

  Language:JavaScript1525113

• kserve/modelmesh

  Distributed Model Serving Framework

  Language:Java148233460

• allegroai/clearml-serving

  ClearML - Model-Serving Orchestration and Repository Solution

  Language:Python138115540

• AlibabaPAI/llumnix

  Efficient and easy multi-instance LLM serving

  Language:Python1289410

• Hsword/SpotServe

  SpotServe: Serving Generative Large Language Models on Preemptible Instances

  93238

• CloudNativeGame/aigc-gateway

  A user gateway that provides serverless AIGC experience.

  Language:Go414138

• volcengine/veTurboIO

  A library developed by Volcano Engine for high-performance reading and writing of PyTorch model files.

  Language:Python10433

• LLMFlow/LLMFlow

  Easy, Fast, Secure and Cost-Efficient LLM Pipelines to generate GhatGPT-like private domain models and knowledgeable agents for your organization.

  61

• nianhuatiandi/Fast-Distributed-Inference-Serving-for-Large-Language-Models

  Fast Distributed Inference Serving for Large Language Models

  3