/azarrot

An OpenAI compatible server, focusing on OpenVINO and IPEX-LLM usage.

Primary LanguagePythonApache License 2.0Apache-2.0

No issues in this repository yet.