RuntimeError: CUDA error: device-side assert triggered (Assertion `srcIndex < srcSelectDimSize` failed.)
Closed this issue · 1 comments
akash1003 commented
When running this command (python open_source/FLLM_schema-flan-t5.py --log_name ./0.txt --cache_dir ./ --ckp_dir ./) as mentioned in the github repository, facing the above error. Could you please help me understand what is the problem,as I am using the exact codebase and dataset as given in the repo? I read on the pytorch discussion form it could be due to some out of bounds index somewhere.(https://discuss.pytorch.org/t/solved-assertion-srcindex-srcselectdimsize-failed-on-gpu-for-torch-cat/1804)
lzl65825 commented
The error may come from the text generation tool (self.text_generator in FormalLLM/src/combine_model_seq.py). Have you removed all codes related to self.text_generator_tokenizer?