/badge-scraper

Scraping badge data from Stack Exchange to generate election statistics.

Primary LanguagePython

Scraping badge data from Stack Exchange and generating some graphs.

Status on Travis CI

Graphs

Election Activity





Run

pip3 install -r requirements.txt &&
python3 -m pytest &&
./election_observer.py

Writing updated data back to disk is very slow.

Flags

-n, --no-update: Don't fetch any new/updated data, just use what you already have.

-m, --no-write: Don't write any new/updated data.

-e, --forever: Repeat forever, with some delay.

Needed Improvements

  • We shouldn't remove the existing data files until we finish writing the updated ones. Interrupting a write can currently cause corruption.