lynnliu030

lynnliu030's Stars

• triton-inference-server/server

  The Triton Inference Server provides an optimized cloud and edge inferencing solution.

  Language:Python7.8k1.4k

• stanford-oval/storm

  An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.

  Language:Python6.9k680

• Trinity-data-store/Trinity

  EuroSys '24: "Trinity: A Fast Compressed Multi-attribute Data Store"

  Language:C++112

• mda590/cloudping.co

  AWS Inter-Region Latency Monitoring

  Language:Python60453

• google-research/deduplicate-text-datasets

  Language:Rust1.1k104

• lerocha/chinook-database

  Sample database for SQL Server, Oracle, MySQL, PostgreSQL, SQLite, DB2

  Language:TSQL1.8k556

• SqueezeAILab/LLMCompiler

  [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

  Language:Python1.3k94

• jwkirchenbauer/lm-watermarking

  Language:Jupyter Notebook47861

• huggingface/text-embeddings-inference

  A blazing fast inference solution for text embeddings models

  Language:Rust2.3k142

• sgl-project/sglang

  SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.

  Language:Python2.9k186

• intel/intel-extension-for-transformers

  ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

  Language:Python2.1k203

• rclone/rclone

  "rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files

  Language:Go45.2k4k

• supabase/supabase

  The open source Firebase alternative. Supabase gives you a dedicated Postgres database to build your web, mobile, and AI applications.

  Language:TypeScript69.4k6.6k

• run-llama/rags

  Build ChatGPT over your data, all with natural language

  Language:Python6.1k616

• langgenius/dify

  Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

  Language:TypeScript38k5.2k

• ModelTC/lightllm

  LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

  Language:Python2.1k179

• stanford-futuredata/ARES

  Language:Python39043

• S-LoRA/S-LoRA

  S-LoRA: Serving Thousands of Concurrent LoRA Adapters

  Language:Python1.6k83

• outlines-dev/outlines

  Structured Text Generation

  Language:Python7.2k371

• huggingface/text-generation-inference

  Large Language Model Text Generation Inference

  Language:Python8.4k957

• cpacker/MemGPT

  Create LLM agents with long-term memory and custom tools 📚🦙

  Language:Python10.9k1.2k

• andialbrecht/sqlparse

  A non-validating SQL parser module for Python

  Language:Python3.6k687

• rustformers/llm

  [Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

  Language:Rust6.1k353

• pola-rs/polars

  Dataframes powered by a multithreaded, vectorized query engine, written in Rust

  Language:Rust28.1k1.7k

• localstack/localstack

  💻 A fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline

  Language:Python53.1k3.9k

• whitead/paper-qa

  LLM Chain for answering questions from documents with citations

  Language:Python3.8k360

• nmslib/hnswlib

  Header-only C++/python library for fast approximate nearest neighbors

  Language:C++4.2k613

• vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Language:Python23.1k3.3k

• ArianaGu/3D-RSD

  Fast Non-line-of-sight Imaging with Non-planar Relay Surfaces

  Language:MATLAB2

• chanwutk/ucbhciprelim

  Language:HTML1