semantic-cache
There are 10 repositories under semantic-cache topic.
codefuse-ai/ModelCache
A LLM semantic caching system aiming to enhance user experience by reducing response time via cached query-result pairs.
redis/redis-vl-python
Redis Vector Library (RedisVL) -- the AI-native Python client for Redis.
Harras3/Enterprise-Grade-RAG
This is a RAG based chatbot in which semantic cache and guardrails have been incorporated.
aws-samples/Reducing-Hallucinations-in-LLM-Agents-with-a-Verified-Semantic-Cache
This repository contains sample code demonstrating how to implement a verified semantic cache using Amazon Bedrock Knowledge Bases to prevent hallucinations in Large Language Model (LLM) responses while improving latency and reducing costs.
jonathanscholtes/LLM-Performance-with-Azure-Cosmos-DB-Semantic-Cache
Enhance LLM retrieval performance with Azure Cosmos DB Semantic Cache. Learn how to integrate and optimize caching strategies in real-world web applications.
mar1boroman/redis-movies-gen-ai
Redis Vector Similarity Search, Semantic Caching, Recommendation Systems and RAG
mar1boroman/ask-redis-blogs
A ChatBot using Redis Vector Similarity Search, which can recommend blogs based on user prompt
benitomartin/semantic-caching-qdrant-splade
RAG Application with Optimizations on HNSW Index, Quantization, Hybrid Search and Semantic Caching
mar1boroman/text-sql-chatbot
Redis Database offers unique capability to keep your data fresh while serving through LLM chatbot
semioz/simcache
Semantic cache for your LLM apps in Go!