arch-btw

arch-btw's Stars

• ggerganov/llama.cpp

  LLM inference in C/C++

  Language:C++65k5433.7k9.3k

• hpcaitech/Open-Sora

  Open-Sora: Democratizing Efficient Video Production for All

  Language:Python21.6k1824782.1k

• meta-llama/llama-recipes

  Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.

  Language:Jupyter Notebook11.6k923281.6k

• SJTU-IPADS/PowerInfer

  High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

  Language:C++7.9k76157403

• THUDM/GLM-4

  GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型

  Language:Python4.6k32484364

• ArchGPT/insomnium

  Insomnium is a fast local API testing tool that is privacy-focused and 100% local. For testing GraphQL, REST, WebSockets and gRPC. This is a fork of Kong/insomnia

  Language:JavaScript3.4k1972150

• project-baize/baize-chatbot

  Let ChatGPT teach your own chatbot in hours with a single GPU!

  Language:Python3.2k5053280

• face-hh/webx

  An alternative for the World Wide Web - browse websites such as buss://yippie.rizz made in HTML, CSS and Lua. Custom web browser, custom HTML rendering engine, custom search engine, and more.

  Language:Rust1.8k18142151

• b4rtaz/distributed-llama

  Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.

  Language:C++1.4k265290

• redlib-org/redlib

  Private front-end for Reddit

  Language:Rust1.1k1413873

• beeper/imessage

  A Matrix-iMessage puppeting bridge.

  Language:Go982181770

• opensourcecheemsburgers/RustyTube

  A rusty Youtube client.

  Language:Rust54053332

• roddhjav/apparmor.d

  Full set of AppArmor profiles (~ 1500 profiles)

  Language:Go4291522139

• epfml/landmark-attention

  Landmark Attention: Random-Access Infinite Context Length for Transformers

  Language:Python405401536

• dongri/openai-api-rs

  OpenAI API client library for Rust (unofficial)

  Language:Rust29094347

• iohub/collama

  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.

  Language:TypeScript140308

• qinxs/Ease-Bookmarks

  简单易用的书签管理器

  Language:JavaScript1373319

• shadowfax92/Fyin

  Open source alternative to Perplexity AI with ability to run locally

  Language:Rust130438

• jarusll/keydogger

  Keydogger is a tiny text expander written in C

  Language:C116335

• hitchdev/hitchstory

  Type-safe YAML integration tests. Tests that write your docs. Tests that rewrite themselves.

  Language:Python89563

• thooton/muse

  Let's create synthetic textbooks together :)

  Language:Python69266

• nathanlesage/local-chat

  LocalChat is a ChatGPT-like chat that runs on your computer

  Language:TypeScript65573

• pymike00/tinychat

  🔮 TinyChat is a lightweight Desktop client for modern Language Models designed for straightforward comprehension. Supports OpenAI, Anthropic, Meta, Mistral, Google and Cohere APIs.

  Language:Python38347

• AUGMXNT/deccp

  Evaling and unaligning Chinese LLM censorship

  Language:Python243

• Parking-Master/node_perplexityai

  An unofficial API for Node.js based off of the Perplexity.AI website and mobile app

  Language:JavaScript17120

• firatkiral/kodibot

  Local and Offline AI Chatbot App for Desktop

  Language:CSS13202

• uiuc-focal-lab/llm-priming-attacks

  Language:Python13301

• TohurTV/llama.cpp-qt

  Llama.cpp-qt is a Python-based GUI wrapper for the LLama.cpp server, providing a user-friendly interface for configuring and running the server. LLama.cpp is a lightweight implementation of GPT-like models.

  Language:Python111

• mikeharty/ai-proxy

  AI Proxy

  Language:TypeScript2100

• dawidpotocki/llama.cpp

  LLM inference in C/C++

  Language:C++10