/ParrotServe

[OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable

Primary LanguagePythonMIT LicenseMIT

Watchers