Autosites
A small example which demonstrates how to use Crawly in order to extract data from JS based website.
Uses meeseeks, as a parses and Splash.
Getting started
- Start splash Server locally:
docker run -it -p 8050:8050 scrapinghub/splash --max-timeout 300 - Run the iex:
mix deps.get && iex -S mix - Start the spider itself
Crawly.Engine.start_spider(AutotraderCoUK)