examples basic.ipyn

[zl-comment]

from tqdm import tqdm
for prompt in prompts:
preds = []
labels = []
for data in tqdm(dataset):
# process input
input_text = pb.InputProcess.basic_format(prompt, data)
label = data['label']
print(type(input_text))
raw_pred = model(input_text)

    # process output
    pred = pb.OutputProcess.cls(raw_pred, proj_func)
    preds.append(pred)
    labels.append(label)

# evaluate
score = pb.Eval.compute_cls_accuracy(preds, labels)
print(f"{score:.3f}, {prompt}")

but have some quenstion about
TypeError Traceback (most recent call last)
Cell In[22], line 10
8 label = data['label']
9 print(type(input_text))
---> 10 raw_pred = model(input_text)
12 # process output
13 pred = pb.OutputProcess.cls(raw_pred, proj_func)
end in

[Immortalise]

Hi, could you please provide more detailed error messages for us? Thanks!

[zl-comment]

这个复现不了了，一开始也不知道为什么，最后是通过多次重启解决的！

[github-actions]

Stale issue message