dvmazur/mixtral-offloading

Trition Issues in Running the Code Locally

Closed this issue · 1 comments

Hey, thanks for sharing the code for the repository. I ran into the following issue while trying to run the code on a remote server:
Screenshot 2024-04-10 at 10 15 09 PM

Can you suggest a possible resolution for the issue?

Nvm, I found the specific kernel code is not meant to be run on a v100 GPU