how to eval a custom dataset?
zixiliuUSC opened this issue · 2 comments
zixiliuUSC commented
I follow pyserini's doc to build a custom index in my own documents, and I also have some labels for a subset of these documents, how can I fit my data like this library to do evaluation?
zixiliuUSC commented
I follow pyserini's doc to build a custom index in my own documents, and I also have some labels for a subset of these documents, how can I fit my data like this library to do evaluation?
The score I need to calculate is nDCG score
lintool commented
trec_eval
can do that. See an example here: https://github.com/castorini/anserini/blob/master/docs/regressions-dl19-passage.md