TORCHSERVE

This source code is used to learn TorchServe

Table of Contents
  1. About The Project
  2. Getting Started
  3. Usage
  4. Roadmap
  5. Acknowledgments

About The Project

This source code is used to learn TorchServe

(back to top)

Getting Started

Install Packages

pip install -r requirements.txt

(back to top)

Usage

  • Run Multi models
    cd examples/multi_models
    sh cli/archive.sh
    sh cli/start.sh
    sh cli/stop

(back to top)

Roadmap

  • Seminar slide
  • Custom TS examples
    • Multi models
  • [] Batch Inference
  • [] Advanced configuration
  • [] Integrate TorchServe in Docker

(back to top)

Acknowledgments

(back to top)