Best practice for deploying TimesFM on SageMaker

Question

Best practice for deploying TimesFM on SageMaker

Opened this issue 4 months ago · 1 comments

👋 What are the best practices for running TimesFM on Amazon SageMaker, considering the dynamic nature of horizon_len. Can the model be loaded and initialized first, so I can specify the horizon_len parameter at inference/forecast time?

Answer 1 · 2024-09-11T15:58:05.000Z

I think its best to set the horizon_len to the maximum of what you would need at init. This way it will be jitted and all subsequent forecasts would be very fast.