inter-annotator-agreement

There are 8 repositories under inter-annotator-agreement topic.

pln-fing-udelar/fast-krippendorff
Fast computation of Krippendorff's alpha agreement measure in Python.
Language:Python135 13 1715
CrowdTruth/CrowdTruth-core
CrowdTruth framework for crowdsourcing ground truth for training & evaluation of AI systems
Language:Jupyter Notebook57 16 611
kldtz/bratiaa
Inter-annotator agreement for Brat annotation projects
Language:Python22 2 17
vribeiro1/skin-lesion-segmentation-agreement
Exploring the inter-annotator agreement between ISIC Archive segmentation masks
Language:Python5 3 02
krisstallenberg/evaluating-annotations
This repository holds code to annotate textual data using LLMs, and calculate different measures of Inter-Annotator Agreement (IAA).
Language:Jupyter Notebook2 1 00
nilsreiter/iaa
command line stuff to calculate inter annotator agreement
Language:Awk2 1 00
ancatmara/DL-SFL-2018
Digita Literacy for School of Foreign Languages (NRU HSE, 2018)
3 02
kakumarabhishek/StyleSeg
[MICCAI ISIC 2024] Code for "Segmentation Style Discovery: Application to Skin Lesion Images"
1 0