puthurr/python-azure-function-gpu

Multiple functions using the same GPU

Opened this issue · 1 comments

Hello! Thanks for sharing this! It looks very interesting.

Can you clarify something for me? If I set this up on a cluster can I have multiple functions use the GPU? I'm not talking about actual fractional GPU usage for each function, rather running one entire function at a time using the entire GPU (assuming I have only one GPU), then switching to another function once it's finished?

Thanks @davystrong for your question. I do not see any obstacle for the scenario you're describing since within the Azure Function there is no GPU scheduling mechanism. It takes what the underlying host gives so running multiple functions on the same GPU host should be possible. Assuming you don't have any K8S restriction in your way.