pramjan

pramjan's Stars

• cloudmercato/ollama-benchmark

  Handy tool to measure the performance and efficiency of LLMs workloads.

  Language:Python182

• matthewrenze/self-reflection

  Self-Reflection in LLM Agents: Effects on Problem-Solving Performance

  Language:Python434

• langwatch/langwatch

  The ultimate LLM Ops platform - Monitoring, Analytics, Evaluations, Datasets and Prompt Optimization ✨

  Language:TypeScript57933

• interestingLSY/swiftLLM

  A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of vLLM).

  Language:Python1267

• kagisearch/pyllms

  Minimal Python library to connect to LLMs (OpenAI, Anthropic, Google, Groq, Reka, Together, AI21, Cohere, Aleph Alpha, HuggingfaceHub), with a built-in model performance benchmark.

  Language:Python73046

• openlit/openlit

  Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

  Language:Python97885

• yigitkonur/swift-ocr-llm-powered-pdf-to-markdown

  An open-source OCR API that leverages OpenAI's powerful language models with optimized performance techniques like parallel processing and batching to deliver high-quality text extraction from complex PDF documents. Ideal for businesses seeking efficient document digitization and data extraction solutions.

  Language:Python80160

• efeslab/Nanoflow

  A throughput-oriented high-performance serving framework for LLMs

  Language:Cuda67127

• huggingface/llm_training_handbook

  An open collection of methodologies to help with successful training of large language models.

  Language:Python46535

• vectorch-ai/ScaleLLM

  A high-performance inference system for large language models, designed for production environments.

  Language:C++39830

• abilzerian/LLM-Prompt-Library

  Advanced Code and Text Manipulation Prompts for Various LLMs. Suitable for Siri, GPT-4o, Claude, Llama3, Gemini, and other high-performance open-source LLMs.

  80178

• Lightning-AI/litgpt

  20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

  Language:Python11k1.1k

• microsoft/LLMLingua

  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

  Language:Python4.8k266

• InternLM/lmdeploy

  LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

  Language:Python5k448

• antibitcoin/ReflectionAnyLLM

  This project demonstrates a basic chain-of-thought interaction with any LLM (Large Language Model)

  Language:HTML31255

• yamalight/litlytics

  🔥 LitLytics - an affordable, simple analytics platform that leverages LLMs to automate data analysis

  Language:TypeScript934

• QiuYannnn/Local-File-Organizer

  An AI-powered file management tool that ensures privacy by organizing local texts, images. Using Llama3.2 3B and Llava v1.6 models with the Nexa SDK, it intuitively scans, restructures, and organizes files for quick, seamless access and easy retrieval.

  Language:Python1.8k134

• workos/authkit

  The world's best login box powered by WorkOS and Radix.

  Language:TypeScript2.4k99

• abrenneke/rivet-plugin-ollama

  Rivet plugin for integration with Ollama, the tool for running LLMs locally easily

  Language:TypeScript344

• unclecode/crawl4ai

  🚀🤖 Crawl4AI: Crawl Smarter, Faster, Freely. For AI.

  Language:HTML18.9k1.4k

• sheshbabu/Chital

  A native macOS app for chatting with local LLMs

  Language:Swift30612

• afadil/wealthfolio

  A Beautiful Private and Secure Desktop Investment Tracking Application

  Language:TypeScript4.5k231

• lihaoyun6/AirBattery

  Get the battery usage of all your devices on your Mac and put them on the Dock / Menu Bar / Widget! && 在Mac上获取你所有设备的电量信息并显示在Dock / 状态栏 / 小组件上!

  Language:Swift1.5k44

• alienator88/Viz

  Capture text/QR Codes/Barcodes from screen snippets

  Language:Swift1856

• AIxHunter/FileWizardAI

  Add AI capabilities to your file system using Ollama, Groq, OpenAi and other's api

  Language:Python16910

• janhq/jan

  Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

  Language:TypeScript24.4k1.4k

• vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Language:Python32.7k5k

• philipbelesky/gray-matter

  A colour scheme for Sublime Text and Visual Studio Code that takes design cues from popular minimalist Markdown text editors.

  Language:Shell7812

• dendronhq/dendron

  The personal knowledge management (PKM) tool that grows as you do!

  Language:TypeScript6.8k262

• alex0809/netsurf-reMarkable

  NetSurf is a lightweight and portable open-source web browser. This projects adapts NetSurf for the reMarkable E Ink tablet.

  Language:Shell532