/llmss

LLM simple serving (tensor model parallel, pubsub, grpc)

Primary LanguagePythonMIT LicenseMIT

llmss

LLM simple serving (tensor model parallel, pubsub, grpc)