Dataset json file doesn't have "Keywords_A" for any question.
Closed this issue · 1 comments
Abhiram4572 commented
Webqa_train_val.json
For any query, Keywords_A is missing.
But I see this key as part of your baseline evaluation and also Take_a_look_WebQA.ipynb files,
Kindly help with this, please share a data version that has this key, so that we can evaluate our models better.
WebQnA commented
Hi!
The keyword_a field is only for evaluation purposes. We only collected
keywords for the testing data and, unfortunately, it is hidden.
If you want to reproduce the keyword extraction process on val data, we
would suggest you try named entity detection and noun-chunk extraction
tools with Spacy.
Thanks for the question!
…On Sat, Mar 12, 2022 at 1:27 AM Abhirama Subramanyam < ***@***.***> wrote:
Webqa_train_val.json
For any query, Keywords_A is missing.
But I see this key as part of your baseline evaluation and also
Take_a_look_WebQA.ipynb files,
Kindly help with this, please share a data version that has this key, so
that we can evaluate our models better.
—
Reply to this email directly, view it on GitHub
<#5>, or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AT2LVRZW6AGTFSRVH44RPMLU7Q2M7ANCNFSM5QRO6VUQ>
.
Triage notifications on the go with GitHub Mobile for iOS
<https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675>
or Android
<https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.
You are receiving this because you are subscribed to this thread.Message
ID: ***@***.***>