download model weights once in a Drive

Question

aniketmaurya opened this issue 2 years ago · 5 comments

model weights are downloaded in each of the works on the cloud. We can download it in a single Drive and share it with all the works

Answer 1 · 2022-10-03T10:48:19.000Z

@krshrimali is working on a component for cloud weights API, we can use that once ready

Answer 2 · 2023-01-06T10:27:38.000Z

Any updates on this one?

Answer 3 · 2023-01-06T12:27:46.000Z

yes, the model weights are only downloaded on the model serving work machines.

Answer 4 · 2023-01-06T22:50:52.000Z

But it's downloaded for each worker every time, no?

Answer 5 · 2023-01-07T05:12:20.000Z

yes, the model weights are downloaded only for the Model serving workers. Even with Drive it will have to load the model to the serving worker.