/CompareTheBrew

Website, Crawler & Pipeline to collate prices of alcoholic beverages to discover the most efficient drinks!

Primary LanguagePython

CompareTheBrew.me

🍺🍺 Get the cheapest drink possible across all Aussie alcoholic vendors 🍺🍺

Setup:

$ bash setup.sh

API Queries:

http://comparethebrew.me/api?term=TERM&order=score_desc

Run:

SCRAPING

locally
$ python3 scrape.py [store] [category] [# pages]

-> store (bws, others not implemented yet)

-> category (beer, wine, spirits)

-> # pages (0 for all)

lightsail instance (done automatically via cron)
$ pipeline.sh

WEB SERVER

locally
$ python3 app.py
lightsail instance
$ ./startserver.sh
$ ./seeserver.sh
$ ./killserver.sh

Dependancies (installed in setup)

  • BeautifulSoup4
  • Selenium
  • ChromeWebDriver (headless)
  • flask
  • sqlite3

Made Possible by:

Hamish Bultitude

Matt Costello

Alex Nicholson