/algorithms_testing

Statistical testing for comparing supervised classification algorithms.

Primary LanguagePython

Statistical Testing for Comparing Supervised Classification Algorithms

Presentation

This project is for a Statistics course (STAT500) and we have made a few slides for presentation.

Install

pip3 install statsmodels

Problem Definition

Use statistical testing to determine if two binary classifiers have the same performance

  • Null Hypothesis H0: Two classifiers make errors in the same way
  • Alternative Hypothesis Ha: Two classifiers make errors differently

Usage

Sample code is in demo.py.