A simple deployment package to run vLLM inference server on UbiOps
Primary LanguagePython
This repository is not active