SRL readme: clarification needed
danyaljj opened this issue · 7 comments
So here in the readme it says:
-[x] [aTs] Test aTr, bTr, cTr, dTr, eTr, fTr, gTr independently. -aTr with constraints.
How should I interpret this?
remove this -[x] [aTs] Test aTr, bTr, cTr, dTr, eTr, fTr, gTr independently. keep this only -aTr with constraints.
if you are working on the SRL documentation make one PR for it and better not to spread various issues and PRs.
No I just need to understand how constrained models are evaluated ...
ok, I saw you had minor edits on the documentation in #428 , thought this is related to the same PR.
As a more broad question, I want to evaluate the performance of current constrained classifiers in SRL, which I think only one of them (argTypeConstraintClassifier) is being used.
Do we have an existing evaluation corresponding to argTypeConstraintClassifier classifier?
Is it this "aTs" in this line?
You see the variations of aTr, cTr and fTr and you see they have been experimented with L+I models i.e. using the constraints. And, yes, the line that you point is aTr with constraints.
Also, please see my above comment this line should be removed -[x] [aTs] Test aTr, bTr, cTr, dTr, eTr, fTr, gTr independently. It has remained there from the primary schedule, but then each table comes with the description like -aTr with constraints.