sozercan/k8s-distributed-inference

🦄 Distributed Inference on Kubernetes with DRA and MIG

k8s-distributed-inference

1. Set up host
2. Deploy Local AI