/vllm-experiments

Official VLLM Implementation is available for mixtral. This version supports the DiscoLM mixtral models

Primary LanguagePythonApache License 2.0Apache-2.0

Stargazers