Evaluation pipeline points to missing files

[snps-tonatiuh]

I am following the README to evaluate a model with

CUDA_VISIBLE_DEVICES=0 python main_block_ap.py \
--resume_quant ./output/pre_quantized_models/Llama-2-7b-EfficientQAT-w2g64 \
--net Llama-2 \
--wbits 2 \
--group_size 64 \
--output_dir ./output/inference_results/ \
--eval_ppl \
--eval_tasks  piqa,arc_easy,arc_challenge,hellaswag,winogrande

But I get an error due to hard-coded file locations:

FileNotFoundError: Unable to find '/cpfs01/user/chenmengzhao/huggingface/datasets/allenai___json/allenai--c4-6fbe877195f42de5/0.0.0/0f7e3662623656454fcd2b650f34e886a7db4b9104504885bd462096cc7a9f51/json-train-00000-of-00002.arrow'

[ChenMnZ]

You can delete the following code to solve this problem.

EfficientQAT/datautils_block.py

Lines 47 to 60 in 346d98a

	try:
	# set local path for faster loading
	traindata = load_dataset("arrow",
	data_files={
	"train": "/cpfs01/user/chenmengzhao/huggingface/datasets/allenai___json/allenai--c4-6fbe877195f42de5/0.0.0/0f7e3662623656454fcd2b650f34e886a7db4b9104504885bd462096cc7a9f51/json-train-00000-of-00002.arrow",
	"validation": "/cpfs01/user/chenmengzhao/huggingface/datasets/allenai___json/allenai--c4-efc3d4f4606f44bd/0.0.0/fe5dd6ea2639a6df622901539cb550cf8797e5a6b2dd7af1cf934bed8e233e6e/json-validation.arrow",
	},split='train'
	)
	valdata = load_dataset("arrow",
	data_files={
	"validation": "/cpfs01/user/chenmengzhao/huggingface/datasets/allenai___json/allenai--c4-efc3d4f4606f44bd/0.0.0/fe5dd6ea2639a6df622901539cb550cf8797e5a6b2dd7af1cf934bed8e233e6e/json-validation.arrow",
	},split='validation'
	)
	except:

I have wrapped such code with try & except, it is curious to report error.

[snps-tonatiuh]

I don't understand why the try, except block did not work as expected, but thanks anyways.