maitrix-org/llm-reasoners

Blocksworld Example Runtime Error: 'NoneType' object has no attribute 'cadam32bit_grad_fp32'

Closed this issue · 1 comments

Dear llm-reasoners team, we have setup reasoners in a Mac machine and are following the Blocksworld example in order to try out how reasoner works. Executing this command (CUDA_VISIBLE_DEVICES=0,1,2,3 python -m torch.distributed.run --nproc_per_node 4 examples/rap_blocksworld/inference.py --llama_size "30B" --data_path 'examples/rap_blocksworld/data/step_4.json' --depth_limit 4 --output_trace_in_each_iter ) results in the following error:

'NoneType' object has no attribute 'cadam32bit_grad_fp32'

Could we get some hints on how to resolve this?

Thank you for your attention.

Ber666 commented

Hi, the code is mainly for NVIDIA GPUs. If you want to run experiments on Mac, you may want to set up llama.cpp and use our library with llama.cpp interface. We haven't tested it on mac, but it should easy to make it work.