serverless-inference

There are 3 repositories under serverless-inference topic.

ServerlessLLM/ServerlessLLM
Serverless LLM Serving for Everyone.
Language:Python396 13 7337
Picovoice/serverless-picollm
LLM Inference on AWS Lambda
Language:Python10 5 0
tensorchord/modelz-py
Python SDK and CLI for modelz.ai, which is a developer-first platform for prototyping and deploying machine learning models.
Language:Python7 7 106