rajarshd/ChainsofReasoning

Evaluation

Closed this issue · 1 comments

Hi, thank you for your code, I want to know if you performed link prediction tasks for the evaluation.
For each test entity pair (h, r, t) in WebClue test dataset, you predict (h, r, ?) where you put all entities in place of ? such that:
predict(h, r, e1)
predict(h, r, e2)
...
predict(h, r, en)
Then, compute Average Precision for (h, r, ?)

Is it correct?

I think that sounds right!