NTMC-Community/MatchZoo

The results of matchzoo

xuezzz opened this issue · 2 comments

xuezzz commented

Hi, I wonder the results of the tutorials/wikiqa/esim is the dev datas or the test datas, if it's dev data's result, how can I see the test data's result, and if test data's result , so on!
Thanks!

xuezzz commented

oh! all the files of the wikiqa/
And why the result of esim.ipynb only have MAP but don't have NDCG

bwanglzu commented

checkout readme or tutorials.

You can add NDCG to your metrics:

ranking_task.metrics = [
    mz.metrics.NormalizedDiscountedCumulativeGain(k=3), # NDCG
    mz.metrics.MeanAveragePrecision() # MAP
]