OptimalScale/LMFlow

LMFlow not support NVIDIA driver 11070?

Closed this issue · 2 comments

research4pan commented

Thanks for your interest in LMFlow! You may use LMFlow <=v0.0.5 to resolve this problem as a temporary solution.

This issue is majorly caused by the dependency chain of transformers <- pytorch <- cuda. To use the latest model supported by transformers, one need the latest transformers, which normally requires torch >= 2.0.0. And this version of torch commonly requires a higher cuda version.

It is highly recommended to install cuda >= 12.0 to support latest transformers. Hope this information can be helpful 😄

  • 👍1
13416157913 commented

Thanks for your interest in LMFlow! You may use LMFlow <=v0.0.5 to resolve this problem as a temporary solution.

This issue is majorly caused by the dependency chain of transformers <- pytorch <- cuda. To use the latest model supported by transformers, one need the latest transformers, which normally requires torch >= 2.0.0. And this version of torch commonly requires a higher cuda version.

It is highly recommended to install cuda >= 12.0 to support latest transformers. Hope this information can be helpful 😄

execute conda install pytorch==2.0.1 torchvision==0.15.2 torchaudio==2.0.2 pytorch-cuda=11.7 -c pytorch -c nvidia
the problem solved.