is this running with cpu? just tested for the first time in my M2 8Gb ram
Flizyx opened this issue · 1 comments
Flizyx commented
ran the commands in https://replicate.com/blog/run-latent-consistency-model-on-macAbeEstrada commented
It is running on the GPU, check for this line:
model.to(torch_device="cpu", torch_dtype=torch.float32).to('mps:0')
If I'm correct, that is telling the machine to use MPS (Metal Performance Shaders)
Those three spikes in my screenshot are my tests:
