Pinned Repositories
agreement-phi
mirror of https://github.com/AlessandroChecco/agreement-phi
crowdsourcingTruthfulness
repository for the papers: "Crowdsourcing Truthfulness: The Impact of Judgment Scale and Assessor Bias" and "Can The Crowd Identify Misinformation Objectively? The Effects of Judgment Scale and Assessor's Background"
dilbert
repo for the paper "DiLBERT: Cheap Embeddings for Disease Related Medical NLP""
NewBestSub
mirror of https://github.com/Miccighel/NewBestSub
KevinRoitero's Repositories
KevinRoitero/crowdsourcingTruthfulness
repository for the papers: "Crowdsourcing Truthfulness: The Impact of Judgment Scale and Assessor Bias" and "Can The Crowd Identify Misinformation Objectively? The Effects of Judgment Scale and Assessor's Background"
KevinRoitero/dilbert
repo for the paper "DiLBERT: Cheap Embeddings for Disease Related Medical NLP""
KevinRoitero/NewBestSub
mirror of https://github.com/Miccighel/NewBestSub
KevinRoitero/agreement-phi
mirror of https://github.com/AlessandroChecco/agreement-phi
KevinRoitero/CrowdsourcingRelevanceScales
repository for the paper "On the Effect of Relevance Scales in Crowdsourcing Relevance Assessments for Information Retrieval Evaluation."
KevinRoitero/Extended-HITS
Implementation of an extended version of the HITS algorithm proposed by Kleinberg which allows to include negative values for links weights.
KevinRoitero/how-many-crowd-workers
repository for the TOIS paper "How Many Crowd Workers Do I Need? On Statistical Power when Crowdsourcing Relevance Judgments"
KevinRoitero/human-and-machine-confidence-in-truthfulness
repository for the JDIQ paper "Combining Human and Machine Confidence in Truthfulness Assessment"
KevinRoitero/IRevalOO
mirror of https://github.com/IRevalOO/IRevalOO_Software
KevinRoitero/kevinroitero.github.io
website
KevinRoitero/LeToE-Code
code for the paper "Effectiveness Evaluation Without Human RelevanceJudgments: A Systematic Analysis of Existing Methodsand of their Combinations"
KevinRoitero/PairwiseAgreement
Pairwise Agreement Metric with tie management
KevinRoitero/predict-explain-truthfulness
KevinRoitero/preferences-on-a-budget
repository for the paper "Preferences on a Budget: Prioritizing Document Pairs when Crowdsourcing Relevance Judgments" accepted at TheWebConf 2022
KevinRoitero/Reproducibility_SI_EvalNoJudg
Repo for the paper: "Reproduce. Generalize. Extend. On Information Retrieval Evaluation without Relevance Judgments." by Kevin Roitero, Marco Passon, Giuseppe Serra, and Stefano Mizzaro.
KevinRoitero/set-size-estimation
python implementation of the tools from http://sakailab.com/download/