LaiLaK918's Stars
BerriAI/litellm
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
mlabonne/llm-autoeval
Automatically evaluate your LLMs in Google Colab
reorproject/reor
Private & local AI personal knowledge management app for high entropy people.
vslavik/diff-pdf
A simple tool for visually comparing two PDF files
xorbitsai/inference
Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.
lyogavin/airllm
AirLLM 70B inference with single 4GB GPU
stanfordnlp/dspy
DSPy: The framework for programming—not prompting—language models
unslothai/unsloth
Finetune Llama 3.2, Mistral, Phi, Qwen 2.5 & Gemma LLMs 2-5x faster with 80% less memory
bentoml/OpenLLM
Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.
mudler/LocalAI
:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference
ItzCrazyKns/Perplexica
Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI
apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
vocodedev/vocode-core
🤖 Build voice-based LLM agents. Modular + open source.
0xeb/TheBigPromptLibrary
A collection of prompts, system prompts and LLM instructions
docmost/docmost
Docmost is an open-source collaborative wiki and documentation software. It is an open-source alternative to Confluence and Notion.
Dicklesworthstone/llm_aided_ocr
Enhance Tesseract OCR output for scanned PDFs by applying Large Language Model (LLM) corrections.
exo-explore/exo
Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚
mem0ai/mem0
The Memory layer for your AI apps
filip-michalsky/SalesGPT
Context-aware AI Sales Agent to automate sales outreach.
ArslanS1997/Auto-Analyst
AI data scientist
useplunk/plunk
The Open-Source Email Platform
davabase/whisper_real_time
Real time transcription with OpenAI Whisper.
raznem/parsera
Lightweight library for scraping web-sites with LLMs
noamgat/lm-format-enforcer
Enforce the output format (JSON Schema, Regex etc) of a language model
guidance-ai/guidance
A guidance language for controlling large language models.
Permify/permify
An open-source authorization as a service inspired by Google Zanzibar, designed to build and manage fine-grained and scalable authorization systems for any application.
fate-ubw/RAGLAB
[EMNLP 2024: Demo Oral] RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation
ParisNeo/ollama_proxy_server
A proxy server for multiple ollama instances with Key security
oobabooga/text-generation-webui
A Gradio web UI for Large Language Models.
shramos/Awesome-Cybersecurity-Datasets
A curated list of amazingly awesome Cybersecurity datasets