Pinned Repositories
Awesome-LLMOps
An awesome & curated list of best LLMOps tools for developers
bettershot
bettertest
clerkie-cli
Clerkie-cli is a terminal tool that uses an LLM to help debug and troubleshoot coding errors in any programming language. It offers explanations, suggested fixes, guidance, alternative approaches, and code examples. It is useful for developers of all skill levels.
instructprompt
litellm
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
litellm-CodeLlama-server
liteLLM-proxy
openai-proxy
reliableGPT
Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors
Berri AI's Repositories
BerriAI/litellm
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
BerriAI/reliableGPT
Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors
BerriAI/liteLLM-proxy
BerriAI/bettertest
BerriAI/Awesome-LLMOps
An awesome & curated list of best LLMOps tools for developers
BerriAI/openai-proxy
BerriAI/litellm-CodeLlama-server
BerriAI/litellm_playground_fe_template
BerriAI/llm-benchmark
List of good LLM Benchmarks
BerriAI/example_openai_endpoint
An example OpenAI /chat/completions endpoint
BerriAI/proxy_load_tester
BerriAI/openai-proxy-ab-testing
BerriAI/simple_litellm_proxy
BerriAI/anthropic_playground
BerriAI/example_anthropic_endpoint
An example anthropic API Endpoint
BerriAI/example_litellm_gcp_cloud_run
Example Repo to deploy LiteLLM Proxy (AI Gateway) on GCP Cloud Run
BerriAI/litellm-staging
Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)
BerriAI/llm-zoo
BerriAI/provider-litellm-http
Crossplane Provider designed to facilitate sending LiteLLM HTTP requests as resources.
BerriAI/proxy_load_tester_2
BerriAI/simple_proxy_openai
BerriAI/assistants_test_project
test project using OpenAI assistants API
BerriAI/error-logs-ui
BerriAI/locust-github-action
BerriAI/locust-load-tester
BerriAI/prometheus-deploy
A Blueprint for deploying Prometheus to render.com
BerriAI/provider-litellm
LiteLLM Gateway (Proxy) crossplane provider
BerriAI/proxy_load_tester_3
BerriAI/proxy_load_tester_4
BerriAI/trend-api
Anomaly detection and forecasting API