facebookresearch/dynabench

Speed up query for retrieving validation examples

ktirumalafb opened this issue · 0 comments

@maxbartolo mentioned that retrieving validation examples for QA (i.e. https://dynabench.org/tasks/qa/validate) and NLI was timing out, probably due to the inefficiency of the query — need to speed this up