Can be used on CPU?

Question

Can be used on CPU?

SalvatoreRa opened this issue 2 years ago · 3 comments

SalvatoreRa commented 2 years ago

Hi,

amazing works and very curious to try

can be used on a CPU (or parallelized on different CPUs)?

thank you,

Salvatore

Answer 1 · 2022-11-19T17:15:25.000Z

Hi Salvatore. Yes it is possible using the Hugging Face integration. The Readme has been uodated with the details.

Answer 2 · 2022-11-21T09:00:36.000Z

Thank you, I have just seen and definitely curious to try

Answer 3 · 2022-12-09T11:20:47.000Z

Hi @SalvatoreRa, as of galai version 1.1.0 you should be able to easily run the inference on CPU with load_model(..., num_gpus=0) (the default if there's no CUDA device). Please reopen if you still have any issues.