/embed_server

host models and route requests to third-party models. has server-side caching via sqlite. stability: 2

Primary LanguagePythonMIT LicenseMIT

README

Dependencies

Python 3.11

Running

poetry run uvicorn embed_server:app --port 6009 --host localhost