Predict runtime error
Borshig opened this issue · 2 comments
Describe the bug
Predict runtime error
To Reproduce
Steps to reproduce the behavior:
i run:
python main.py --model "GPTModels\GPT3_XL\config.json" --auto_layout_and_mesh_shape --gpu_ids device:gpu:0 --predict --prompt example_prompt.txt
and get error (as in the screeenshot)
looks like mesh-tensorflow dont know or dont correctly detect my single gpu device.
Screenshots
Environment (please complete the following information):
- GPUs: 3080ti
- Configs: GPT3_XL
Additional context
i tried different spellings "gpu:0", "0", same
i dont know what's wrong.
Same error here, was anyone able to fix this ?
GPU: 2080 Ti
Python 3.8.6
We do not officially support GPU with this codebase. People have had success using it with GPUs, but some meaningful changes are necessary.