liang8qi

liang8qi's Stars

• ikaijua/Awesome-AITools

  Collection of AI-related utilities. Welcome to submit issues and pull requests /收藏AI相关的实用工具，欢迎提交issues 或者pull requests

  3.6k243

• wpydcr/LLM-Kit

  🚀WebUI integrated platform for latest LLMs | 各大语言模型的全流程工具 WebUI 整合包。支持主流大模型API接口和开源模型。支持知识库，数据库，角色扮演，mj文生图，LoRA和全参数微调，数据集制作，live2d等全流程应用工具

  Language:Python41549

• Bin-Huang/chatbox

  User-friendly Desktop Client App for AI Models/LLMs (GPT, Claude, Gemini, Ollama...)

  Language:TypeScript19.3k2k

• jupyter/jupyter_client

  Jupyter protocol client APIs

  Language:Python366273

• mudler/LocalAI

  :robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

  Language:C++21k1.6k

• c0sogi/llama-api

  An OpenAI-like LLaMA inference API

  Language:Python10810

• lllyasviel/Omost

  Your image is almost there!

  Language:Python6.1k367

• e2b-dev/awesome-ai-agents

  A list of AI autonomous agents

  7.6k521

• weaviate/Verba

  Retrieval Augmented Generation (RAG) chatbot powered by Weaviate

  Language:Python4.6k454

• langroid/langroid

  Harness LLMs with Multi-Agent Programming

  Language:Python1.8k171

• semanser/codel

  ✨ Fully autonomous AI Agent that can perform complicated tasks and projects using terminal, browser, and editor.

  Language:TypeScript1.9k140

• lm-sys/FastChat

  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

  Language:Python35.2k4.3k

• mlc-ai/mlc-llm

  Universal LLM Deployment Engine with ML Compilation

  Language:Python17.5k1.4k

• EleutherAI/pythia

  The hub for EleutherAI's work on interpretability and learning dynamics

  Language:Jupyter Notebook2.1k152

• huybery/Awesome-Code-LLM

  👨‍💻 An awesome and curated list of best code-LLM for research.

  74841

• xorbitsai/inference

  Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

  Language:Python3.1k254

• meta-llama/PurpleLlama

  Set of tools to assess and improve LLM security.

  Language:Python2.1k336

• pytorch/torchtune

  A Native-PyTorch Library for LLM Fine-tuning

  Language:Python3.4k259

• sangmichaelxie/doremi

  Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets

  Language:HTML25632

• kasnerz/quintd

  Code for the paper Beyond Traditional Benchmarks: Analyzing Behaviors of Open LLMs on Data-to-Text Generation

  Language:Python4

• princeton-nlp/SWE-agent

  SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It solves 12.47% of bugs in the SWE-bench evaluation set and takes just 1 minute to run.

  Language:Python11.6k1.1k

• OpenInterpreter/open-interpreter

  A natural language interface for computers

  Language:Python49.5k4.3k

• Paitesanshi/LLM-Agent-Survey

  2.3k137

• Tlntin/Qwen-TensorRT-LLM

  Language:Python51748

• NVIDIA/TensorRT-LLM

  TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

  Language:C++7.1k758

• huggingface/text-generation-inference

  Large Language Model Text Generation Inference

  Language:Python8.2k910

• InternLM/lmdeploy

  LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

  Language:Python2.9k255

• ray-project/llmperf

  LLMPerf is a library for validating and benchmarking LLMs

  Language:Python44762

• pytorch/builder

  Continuous builder and binary build scripts for pytorch

  Language:Shell320209

• KumaTea/pytorch-aarch64

  PyTorch wheels (whl) & conda for aarch64 / ARMv8 / ARM64

  Language:HTML21218