runpod-workers/worker-vllm
The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
PythonMIT
Stargazers
- 188140040
- ahsan3219GenStack AI
- alpayariyakTogetherAI
- ashleykleynhansSouth Africa
- carlfm01Costa Rica
- chuanmingliuWesteros
- dav009Optimizely
- eugenesiowSingapore
- eukuznetsovPortugal
- fly51flyPRIS
- G-structureSan Francisco Bay Area, California
- hommayushi3Stanford, CA
- JacobGoldenArtJacobGoldenArt
- JamesBonddu
- johncordeiroIlhasoft
- kenny019Singapore
- kilimchoi
- lukepietteSan Francisco
- mplummeridgemarv.app Limited
- Mr-Nobody1
- MrlolDev@get-wildfire
- ojus1Observe.ai
- omarmhaimdatDatarise
- qhduan知未智能KDF
- setiankeBomml.ai
- seyferhttps://seyfer.github.io/your-life/
- shanjiecai
- thanhan-a17
- usrbinkat@NASA
- viktor-ferencziAI-42 Sweden AB
- willsamuBerlin
- winchesterdeeplay
- wsuff
- zhl146
- ziozzangSeoul, Korea
- zjc17Beijing · China