Hello, where can I get the content of the corresponding "sogou-id"?

Hi , as the picture shows that I have printed the content of the file of "test_raw.json" hosted in the pan of tsinghua,

However, it seems that a lot of content corresponding to the "sogou-id" can't be found from any of those files stored in https://cloud.tsinghua.edu.cn/d/1bfff521fd784b95ac45/?p=%2Fjson&mode=list

So I want to ask where can I find the content corresponding to the "sougou-id", e.g. "sogou-14837"?

Thanks in advance.

We do not provide the raw data. You can follow our code

Line 42 in 97525c7

def test_epoch(model, test_data, file_name):

to extract the data from test.pt.

Because it is said that the MRR is calculated from Testing-Raw according to your paper , and NDCG is calculated from Testing-SAME and Testing-DIFF

if I can't get the raw data of Testing-Raw , how can I predict Testing-Raw and calculate MRR like the data from your paper ?

Is there anything I got wrong or misunderstood, please point me out,

Thanks a lot.

For evaluation, please refer to our evaluation instuction https://github.com/thunlp/EntityDuetNeuralRanking/tree/master/evaluation. During the evaluation, we do not need the query text.

OK, I got it.
Thanks for your reply.