sangmichaelxie/doremi

Cuda version problem

RRaphaell opened this issue · 2 comments

I'm trying to run this script on aws sagemaker

cd doremi && bash scripts/setup_flash.sh

it throws an error:

The detected CUDA version (12.1) mismatches the version that was used to compile
      PyTorch (11.7). Please make sure to use the same CUDA versions.

May I ask if you have solved this problem? I face the same problem.

You can install a cuda 11.7 in /usr/local and add the following configuration to the bashrc file:
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/cuda-11.7/lib64
export PATH=$PATH:/usr/local/cuda-11.7/bin
export CUDA_HOME=/usr/local/cuda-11.7
Finally, run source bashrc. Then the compilation will succeed.