allenai/ontoemma

Result issues

XHuangSH opened this issue · 0 comments

Hi,
I 'm trying to reproduce your results, but It seems to contradict the results on your paper.
Firstly, how could you take an advantage of the external context information like definitions or Medline contexts which are not included in the code.
Secondly, the results of UMLS test set I reproduced are following.

P R F1 Acc
baseline(LR) 0.9988 0.9567 0.9773
NN+f+w+c 0.9795 0.9569 0.9681