gatepoet's Stars
google-ai-edge/mediapipe
Cross-platform, customizable ML solutions for live and streaming media.
microsoft/JARVIS
JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf
guidance-ai/guidance
A guidance language for controlling large language models.
sweepai/sweep
Sweep: open-source AI-powered Software Developer for small features and bug fixes.
ijl/orjson
Fast, correct Python JSON library supporting dataclasses, datetimes, and numpy
microsoft/LLMLingua
To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
huggingface/parler-tts
Inference and training library for high-quality TTS models.
mshumer/gpt-llm-trainer
OpenNMT/CTranslate2
Fast inference engine for Transformer models
KoljaB/RealtimeSTT
A robust, efficient, low-latency speech-to-text library with advanced voice activity detection, wake word activation and instant transcription.
trypromptly/LLMStack
No-code multi-agent framework to build LLM Agents, workflows and applications with your data
FoundationVision/LlamaGen
Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation
punica-ai/punica
Serving multiple LoRA finetuned LLM as one
TransformerOptimus/SuperCoder
Open Source Autonomous Software Development System
PrithivirajDamodaran/FlashRank
Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cross-encoders and more. Created by Prithivi Da, open for PRs & Collaborations.
KoljaB/LocalAIVoiceChat
Local AI talk with a custom voice based on Zephyr 7B model. Uses RealtimeSTT with faster_whisper for transcription and RealtimeTTS with Coqui XTTS for synthesis.
chujiezheng/chat_templates
Chat Templates for 🤗 HuggingFace Large Language Models
varunshenoy/super-json-mode
Low latency JSON generation using LLMs ⚡️
KoljaB/Linguflex
Command Your World with Voice
matatonic/openedai-speech
An OpenAI API compatible text to speech server using Coqui AI's xtts_v2 and/or piper tts as the backend.
microsoft/Trace
Trace, the New AutoDiff for AI Systems and LLM Agents
microsoft/sarathi-serve
A low-latency & high-throughput serving engine for LLMs
SakanaAI/DiscoPOP
Code for Discovering Preference Optimization Algorithms with and for Large Language Models
jundaf2/INT8-Flash-Attention-FMHA-Quantization
lunamidori5/Midori-AI
crashr/gppm
GPU Power and Performance Manager
KoljaB/stream2sentence
Real-time processing and delivery of sentences from a continuous stream of characters or text chunks.
LLMparser/LLMparser
JamesHutchison/learning-progressions
Use GPT-4 to create learning progressions
PrithivirajDamodaran/beir
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.