KranthiGV/bias-evaluation

We study the general trend in bias reduction as newer pre-trained models are released. Three recent models ( ELECTRA, DeBERTa and DistilBERT) are chosen and evaluated against two bias benchmarks, StereoSet and CrowS-Pairs. They are compared to the baseline of BERT using the associated metrics

PythonApache-2.0