[helm-charts] Support more components
yongfengdu opened this issue · 4 comments
OPEA is supporting more and more components (https://github.com/opea-project/GenAIComps), helm charts should be updated accordingly to provide more building blocks for AI application.
Helm Charts can provide extra values like ease of use, built in experiences to run in kubernetes environment.
This issue is to analyze components' gaps and develop charts accordingly.
Add watching to this issue since it will lead to GMC controller change
First to add support for components used by GenAIExamples.
ChatQnA for more components:
Guardrails, vllm, ray, qdant
VisualQnA:
lvm-tgi, llava-tgi for gaudi.
AgentQnA support.
The components support will be added by different PRs.
Will provide helm chart component support for this before AgentQnA.
#281 #280
FAQ:
https://github.com/opea-project/GenAIComps/tree/main/comps/llms/faq-generation/tgi/langchain
This is also tgi support, we should be able to reuse tgi helm chart and just change the image to faqgen.
chathistory:
https://github.com/opea-project/GenAIComps/tree/main/comps/chathistory/mongo
We'll provide the chathistory microservice deployment/manifests only, not integrate with current ChatQnA example and UI.
Milvus support
#468