Extract result to gold standard evaluation to new subproject
leokraemer opened this issue · 1 comments
leokraemer commented
The evaluation of identifier and definiens extractions should be easy to understand and accessible. Therefore it should be moved to a subproject for clarity.
Requirements:
- Must be easily integrated into the existing flink workflows.
- Matching strategy must be defined clearly.
- Clearly defined Json input for interoperability. E.g. with an example file.
- CLI for easy usage of the evaluation in an automated environment.
leokraemer commented
json -> csv
#111
Further improvement: accept wikidatalinks from the gold standard as definition