/worker-vllm-AI

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.

Primary LanguagePythonMIT LicenseMIT

This repository is not active