Create test suite for asking questions and checking if relevant content is retrieved
Closed this issue · 1 comments
Gautam-Rajeev commented
Create test suite for asking questions and checking if relevant content is retrieved
H4R5H1T-007 commented
Current Benchmark score by using Cosine similarity method in comparison with standard api for content retrieval:-
Standard API Retrieval scores :- {'map@5': 0.18, 'mrr': 0.18, 'ndcg@5': 0.3270117461231739}
Our Method Retrieval scores :- {'map@5': 0.29, 'mrr': 0.29, 'ndcg@5': 0.42618595071429155}
Here's the link to the Colab to reproduce results.