aws-samples/amazon-sagemaker-workshop-for-huggingface

how do i modify torchserve config in deployment?

taepd opened this issue · 0 comments

taepd commented

Hello.

I want to adjust the torchserve's dynamic batch, but I'm not sure how to access those settings.

Currently, the default batchsize seems to be 1, how can I adjust the ts-config that includes this value?