null-dev/llmcode-server

LLM server that provides an optimized version of the WizardCoder model as an API endpoint

llmcode-server

llmcode-server provides an API endpoint for using the WizardCoder-15B model.

Features:

• Optimized for fast responses
  • Uses CTranslate2 and https://huggingface.co/michaelfeil/ct2fast-WizardCoder-15B-V1.0
• Designed for: https://github.com/videogameaholic/starcoder-intellij