GenAIInfra is the containerization and cloud native suite for OPEA, including artifacts to deploy GenAIExamples in a cloud native way, which can be used by enterprise users to deploy to their own cloud.
The GenAIInfra repository is organized under four main directories, which include artifacts for OPEA deploying:
Directory | Purpose |
---|---|
helm-charts |
Helm charts for deploying GenAIExamples on Kubernetes. |
kubernetes-addons |
Deploy Kubernetes add-ons for OPEA. |
manifests |
Manifests for deploying GenAIExamples on Kubernetes and on Docker Compose. |
scripts |
Scripts for testing, tools for facilitate OPEA deployment, and etc. |
GenAIInfra uses Kubernetes as the cloud native infrastructure. You will need the access to either managed kubernetes services (e.g., EKS,ASK,GKE and etc) or self managed kubernetes.
To deploy GenAIExamples to Kubernetes using helm charts, you need Helm installed on your machine.
Clone the GenAIInfra repository and change into the helm-charts
directory:
git clone https://github.com/opea-project/GenAIInfra.git
cd GenAIInfra/helm-charts
Select the example workflow you want to deploy, set the customized values in values.yaml
and deploy the example (e.g. codegen) using helm
:
helm install codegen ./codegen
GenAIInfra also supports deploy GenAIExamples using manifests, you need kubectl installed on your machine.
Clone the GenAIInfra repository and change into the manifests
directory:
git clone https://github.com/opea-project/GenAIInfra.git
cd GenAIInfra/manifests
Select the example workflow you want to deploy, deploy the example (e.g. DocSum) using kubectl
:
kubectl apply -f ./DocSum/manifests/