/ray-serve-demo

Taking Ray Serve for a spin.

Primary LanguagePython

Ray Serve Demo

Follows this official Ray tutorial (GitHub commit).

Minimal test

poetry install --no-root

serve run serve_deployment:translator_app
python model_client.py  # Returns: Bonjour monde!

serve run graph:app
python composed_client.py # Returns: c'était le meilleur des temps, c'était le pire des temps .