coetaur0/ESIM

Prediction for new set of premise and hypothesis pair

codehunk628 opened this issue · 4 comments

I am having very hard time in understanding how to predict for a new set of premise, hypothesis pair?? #help

The usage of the model is explained in the repository README in details. I'm not sure what your issue is here exactly ? To make predictions on premise/hypothesis pairs, they need to be formatted like the test data of the SNLI or MNLI data sets and fed to the model with the test_snli.py or test_mnli.py scripts.

that means I have to parse those hypothesis and premise sentences with some kind of parser because the snli_1.0_test file contains parsed sentences too.

Yes, out of convenience, I used in my scripts the sentences that had already been parsed in the SNLI and MNLI data sets. This means that, if you want to reuse the train or test scripts for snli or mnli, you will need to parse your data set's sentences first. This is however rather easy to do in Python. You could also simply use the Stanford PCFG Parser, which is what was actually used to produce the pre-parsed sentences in the SNLI and MNLI data sets.

Okay... Thank you..