aws/sagemaker-huggingface-inference-toolkit

Can’t create an inference service for models that depend on packages i.e. `espeak`

ghubnerr opened this issue · 0 comments

I'm trying to deploy an inference endpoint for a speech-to-IPA model on SageMaker, using HuggingFace's toolkit for "facebook/wav2vec2-lv-60-espeak-cv-ft", which depends on espeak (sudo yum install speak) to perform some speech conversions. The VM that the service spins up doesn't contain the option for me to input a specific package to be installed or a script to do so.

ModelError: An error occurred (ModelError) when calling the InvokeEndpoint operation: Received client error (400) from primary with message "{
  "code": 400,
  "type": "InternalServerException",
  "message": "espeak not installed on your system"
}```