developmentseed/chip-n-scale-queue-arranger

Running Chip N Scale with multiple TFServing images

Opened this issue · 0 comments

Geoyi commented

Currently, Chip N Scale only sends tiles to a single TFServing image, and soon we may need to send a single image to multiple TFServing images for model inference.

cc: @drewbo.