pytorch/serve

"Model mode control" for gRPC

udaij12 opened this issue ยท 0 comments

๐Ÿš€ The feature

Current model mode control is being developed for HTTP (#3165). Future development should be included to add this feature to support gRPC as well.

Motivation, pitch

Currently gRPC ports are bound to local host however if user decided to open those ports we would like to add this feature for those cases.

Alternatives

No response

Additional context

No response