/negation_resolution_evaluation_conll2021

Code for the 2021 paper "Negation-Instance Based Evaluation of End-to-End Negation Resolution"

Primary LanguagePythonBSD 3-Clause "New" or "Revised" LicenseBSD-3-Clause

Instance-based Evaluation of Negation Resolution

This repository contains code for the paper

Elizaveta Sineva, Stefan Grünewald, Annemarie Friedrich, and Jonas Kuhn (2021): Negation-Instance Based Evaluation of End-to-End Negation Resolution

The resources allow users to reproduce and extend the results reported in the study. Please cite the above paper when using them, and direct any questions or feedback regarding our code at Stefan Grünewald.

Disclaimer (purpose of the project): This software is a research prototype, solely developed for and published as part of the publication cited above. It will neither be maintained nor monitored in any way.

Note: Due to licensing complications, this repository as of now only contains the code for the evaluation metrics proposed/studied by us. Code for evaluated baselines may be added if there is significant interest.

Repository Structure

The folder starsem_eval contains code of our reproduction/extension of the original *SEM2012 evaluation script.

The folder instance_based_eval contains code for our proposed instance-based evaluation of negation resolution.

See the README.md files in each folder for further details, including instructions on how to run the code.

License

Our code is open-sourced under the BSD 3-Clause license. See the LICENSE file for details.

The software, including its dependencies, may be covered by third party rights, including patents. You should not execute this code unless you have obtained the appropriate rights, which the authors are not purporting to give.