Pinned Repositories
.github
Awesome-LLMOps
🎉 An awesome & curated list of best LLMOps tools.
llmaz
☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
llmboard
ChatUI for LLMs on llmaz.
llmlite
🌵 A library helps to communicate with all kinds of LLMs consistently.
Manta
💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯
omnistore
🎯 An unified python client to communicate with various kinds of object-store providers.
PR-Copilot
Your AI pair programmer 🤖️ specialized in code review, code summary and even code completion. 🧑💻🐛
scheduler-plugins
Scheduler plugins designed for smart scheduling with llmaz.
website
Website and Blogs.
InftyAI's Repositories
InftyAI/llmaz
☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
InftyAI/Awesome-LLMOps
🎉 An awesome & curated list of best LLMOps tools.
InftyAI/llmlite
🌵 A library helps to communicate with all kinds of LLMs consistently.
InftyAI/Manta
💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯
InftyAI/llmboard
ChatUI for LLMs on llmaz.
InftyAI/scheduler-plugins
Scheduler plugins designed for smart scheduling with llmaz.
InftyAI/omnistore
🎯 An unified python client to communicate with various kinds of object-store providers.
InftyAI/PR-Copilot
Your AI pair programmer 🤖️ specialized in code review, code summary and even code completion. 🧑💻🐛
InftyAI/website
Website and Blogs.
InftyAI/.github
InftyAI/community
The InftyAI community.
InftyAI/llmaz-helm
Helm installation for llmaz.
InftyAI/template-repo
A template repo.