/autogen-based-self-hosted-llm

This repository provides inference sever to host any open-source LLM, providing the user OpenAI API colpatabile inference server, and AutoGen agents with function calling.

Primary LanguagePython

Stargazers