Pinned Repositories
.github
alphatrion
AlphaTrion is an open-source and all-in-one platform to build LLM-powered applications and frameworks.
Awesome-LLMOps
🎉 An awesome & curated list of best LLMOps tools.
llmaz
☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
llmlite
🌵 A library helps to communicate with all kinds of LLMs consistently.
Manta
💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯
omnistore
🎯 An unified python client to communicate with various kinds of object-store providers.
PR-Copilot
Your AI pair programmer 🤖️ specialized in code review, code summary and even code completion. 🧑💻🐛
scheduler-plugins
Scheduler-Plugins maintains a list of kubernetes scheduler plugins used in InftyAI community.
website
Website and Blogs.
InftyAI's Repositories
InftyAI/llmaz
☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
InftyAI/Awesome-LLMOps
🎉 An awesome & curated list of best LLMOps tools.
InftyAI/Manta
💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯
InftyAI/llmlite
🌵 A library helps to communicate with all kinds of LLMs consistently.
InftyAI/scheduler-plugins
Scheduler-Plugins maintains a list of kubernetes scheduler plugins used in InftyAI community.
InftyAI/alphatrion
AlphaTrion is an open-source and all-in-one platform to build LLM-powered applications and frameworks.
InftyAI/PR-Copilot
Your AI pair programmer 🤖️ specialized in code review, code summary and even code completion. 🧑💻🐛
InftyAI/omnistore
🎯 An unified python client to communicate with various kinds of object-store providers.
InftyAI/website
Website and Blogs.
InftyAI/.github
InftyAI/community
The InftyAI community.
InftyAI/karpenter
This is a fork of Karpenter focused on GPU scaling with llmaz.
InftyAI/template-repo
A template repo.