localllama

There are 9 repositories under localllama topic.

moritztng/fltr
Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
Language:Rust365 6 26
sozercan/aikit
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
Language:Go307 6 3727
SqueezeAILab/KVQuant
KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
Language:Python244 13 1219
BrutalCoding/aub.ai
AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.
Language:Dart185 11 1518
poloclub/wordflow
Social and customizable AI writing assistant! ✍️
Language:TypeScript162 7 623
Belluxx/LlamaTerm
Use your open source local model from the terminal
Language:Python8 4 00
seyf1elislam/LocalLLM_OneClick_Colab
Run gguf LLM models in Latest Version TextGen-webui
Language:Jupyter Notebook4 1 00
OleksiiHorishnii/tldr-email-summarizer
Summarize emails received by Thunderbird mail client extension via locally run LLM. Early development.
Language:Python0 1 00
av1d/LAISer
Local AI Search assistant web or CLI for ollama and llama.cpp. Lightweight and easy to run, providing a Perplexity-like experience.
Language:Python2 01